2023-09-13T02:00:44.393 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-13T02:00:44.395 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi --verbose --owner scheduled_pdonnell@teuthology --description fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} --archive /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395228 -- /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395228/orig.config.yaml 2023-09-13T02:00:44.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T02:00:44.526 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395228 branch: wip-batrick-testing-20230912.122437 description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} email: pdonnell@redhat.com first_in_suite: false job_id: '7395228' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-batrick-testing-20230912.122437 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 2110e00747b31a0d73768c9e5229da18b26b8aa0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: disabled: true install: ceph: extra_system_packages: deb: - python3-pytest rpm: - python3-pytest flavor: default sha1: 2110e00747b31a0d73768c9e5229da18b26b8aa0 kclient: disabled: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20230912.122437 sha1: 3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 9684 sha1: 2110e00747b31a0d73768c9e5229da18b26b8aa0 sleep_before_teardown: 0 subset: 236/256 suite: fs suite_branch: wip-batrick-testing-20230912.122437 suite_path: /home/teuthworker/src/github.com_batrick_ceph_3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi104.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKuQ/0LipsdT8eZcYRT8/ja79YLlkHp0ISoVAfz0fiD4/ik40V9DG7dDEPYltC0Axq4hXPXvvKyzcnXfGoLn/qI= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLvm45jl5lLd1bnFw9AbofDjpFQ7TaYZ7PxHiJUzszOYx89jnE/xvpxFdpFkvcr0pAUFeoMQTK+RR2ZqG4+au38= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - workunit: clients: client.0: - fs/test_python.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-12_14:07:50 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1394 2023-09-13T02:00:44.527 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f/qa; will attempt to use it 2023-09-13T02:00:44.528 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f/qa/tasks 2023-09-13T02:00:44.528 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-13T02:00:44.530 INFO:teuthology.task.internal:Checking packages... 2023-09-13T02:00:44.554 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2110e00747b31a0d73768c9e5229da18b26b8aa0' 2023-09-13T02:00:44.555 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-13T02:00:44.555 INFO:teuthology.packaging:ref: None 2023-09-13T02:00:44.555 INFO:teuthology.packaging:tag: None 2023-09-13T02:00:44.556 INFO:teuthology.packaging:branch: wip-batrick-testing-20230912.122437 2023-09-13T02:00:44.556 INFO:teuthology.packaging:sha1: 2110e00747b31a0d73768c9e5229da18b26b8aa0 2023-09-13T02:00:44.556 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-batrick-testing-20230912.122437 2023-09-13T02:00:44.702 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6088.g2110e007 2023-09-13T02:00:44.703 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-13T02:00:44.709 INFO:teuthology.task.internal:no buildpackages task found 2023-09-13T02:00:44.710 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-13T02:00:44.754 INFO:teuthology.task.internal:Saving configuration 2023-09-13T02:00:44.772 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-13T02:00:44.780 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T02:00:44.807 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 01:55:45.128920', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKuQ/0LipsdT8eZcYRT8/ja79YLlkHp0ISoVAfz0fiD4/ik40V9DG7dDEPYltC0Axq4hXPXvvKyzcnXfGoLn/qI='} 2023-09-13T02:00:44.829 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 01:55:45.130433', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLvm45jl5lLd1bnFw9AbofDjpFQ7TaYZ7PxHiJUzszOYx89jnE/xvpxFdpFkvcr0pAUFeoMQTK+RR2ZqG4+au38='} 2023-09-13T02:00:44.830 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-13T02:00:44.836 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-09-13T02:00:44.837 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-09-13T02:00:44.837 INFO:teuthology.run_tasks:Running task console_log... 2023-09-13T02:00:44.912 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f268a51ba60>, signals=[15]) 2023-09-13T02:00:44.913 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-13T02:00:44.918 INFO:teuthology.task.internal:Opening connections... 2023-09-13T02:00:44.919 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi104.front.sepia.ceph.com 2023-09-13T02:00:44.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:00:45.007 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2023-09-13T02:00:45.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:00:45.088 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-13T02:00:45.095 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2023-09-13T02:00:45.114 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2023-09-13T02:00:45.115 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-09-13T02:00:45.171 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2023-09-13T02:00:45.172 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9" 2023-09-13T02:00:45.172 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2023-09-13T02:00:45.172 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2023-09-13T02:00:45.172 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9" 2023-09-13T02:00:45.172 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9" 2023-09-13T02:00:45.173 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-13T02:00:45.173 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2023-09-13T02:00:45.173 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon" 2023-09-13T02:00:45.173 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-13T02:00:45.173 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2023-09-13T02:00:45.174 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T02:00:45.174 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-13T02:00:45.174 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-13T02:00:45.175 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-09-13T02:00:45.199 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2023-09-13T02:00:45.216 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2023-09-13T02:00:45.217 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-09-13T02:00:45.273 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2023-09-13T02:00:45.273 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2023-09-13T02:00:45.274 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2023-09-13T02:00:45.274 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2023-09-13T02:00:45.274 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2023-09-13T02:00:45.274 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2023-09-13T02:00:45.275 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-13T02:00:45.275 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-09-13T02:00:45.275 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2023-09-13T02:00:45.275 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-13T02:00:45.275 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2023-09-13T02:00:45.276 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T02:00:45.276 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-13T02:00:45.276 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-13T02:00:45.276 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-09-13T02:00:45.298 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-13T02:00:45.308 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-13T02:00:45.314 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-13T02:00:45.314 DEBUG:teuthology.orchestra.run.smithi104:> test '!' -e /home/ubuntu/cephtest 2023-09-13T02:00:45.317 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2023-09-13T02:00:45.334 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-13T02:00:45.340 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-13T02:00:45.341 DEBUG:teuthology.orchestra.run.smithi104:> test -z $(ls -A /var/lib/ceph) 2023-09-13T02:00:45.374 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2023-09-13T02:00:45.409 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-13T02:00:45.467 INFO:teuthology.run_tasks:Running task kernel... 2023-09-13T02:00:45.481 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-09-13T02:00:45.482 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-09-13T02:00:45.483 DEBUG:teuthology.orchestra.run.smithi104:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-13T02:00:45.484 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-13T02:00:45.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T02:00:45.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T02:00:45.502 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2023-09-13T02:00:45.502 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2023-09-13T02:00:45.558 INFO:teuthology.orchestra.run.smithi119.stdout:5.14.0-361.el9.x86_64 2023-09-13T02:00:45.558 INFO:teuthology.task.kernel:Running kernel on smithi119: 5.14.0-361.el9.x86_64 2023-09-13T02:00:45.559 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum install -y kernel 2023-09-13T02:00:45.561 INFO:teuthology.orchestra.run.smithi104.stdout:5.14.0-361.el9.x86_64 2023-09-13T02:00:45.561 INFO:teuthology.task.kernel:Running kernel on smithi104: 5.14.0-361.el9.x86_64 2023-09-13T02:00:45.561 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum install -y kernel 2023-09-13T02:00:47.629 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS-9 - AppStream 15 MB/s | 6.3 MB 00:00 2023-09-13T02:00:47.688 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS-9 - AppStream 13 MB/s | 6.3 MB 00:00 2023-09-13T02:00:48.929 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS-9 - BaseOS 7.8 MB/s | 2.0 MB 00:00 2023-09-13T02:00:49.055 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS-9 - BaseOS 6.2 MB/s | 2.0 MB 00:00 2023-09-13T02:00:50.120 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 7.8 MB 00:00 2023-09-13T02:00:51.061 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 7.8 MB 00:01 2023-09-13T02:00:51.855 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 25 MB/s | 18 MB 00:00 2023-09-13T02:00:53.062 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 19 MB/s | 18 MB 00:00 2023-09-13T02:00:57.158 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 5.7 MB 00:02 2023-09-13T02:00:57.873 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 5.7 MB 00:01 2023-09-13T02:00:58.490 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 14 kB 00:00 2023-09-13T02:00:59.279 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 14 kB 00:00 2023-09-13T02:00:59.367 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 24 MB/s | 19 MB 00:00 2023-09-13T02:01:01.392 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 9.2 MB/s | 19 MB 00:02 2023-09-13T02:01:03.716 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2023-09-13T02:01:05.615 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-09-13T02:01:05.615 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-09-13T02:01:05.705 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2023-09-13T02:01:05.715 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-09-13T02:01:05.725 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-09-13T02:01:05.725 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2023-09-13T02:01:05.725 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-09-13T02:01:05.726 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-09-13T02:01:05.726 INFO:teuthology.orchestra.run.smithi119.stdout: kernel x86_64 5.14.0-364.el9 baseos 5.0 M 2023-09-13T02:01:05.726 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2023-09-13T02:01:05.726 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-core x86_64 5.14.0-364.el9 baseos 20 M 2023-09-13T02:01:05.726 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules x86_64 5.14.0-364.el9 baseos 37 M 2023-09-13T02:01:05.727 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-core x86_64 5.14.0-364.el9 baseos 32 M 2023-09-13T02:01:05.727 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:01:05.727 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-09-13T02:01:05.727 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-09-13T02:01:05.727 INFO:teuthology.orchestra.run.smithi119.stdout:Install 4 Packages 2023-09-13T02:01:05.728 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:01:05.728 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 93 M 2023-09-13T02:01:05.729 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 120 M 2023-09-13T02:01:05.729 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-09-13T02:01:06.050 INFO:teuthology.orchestra.run.smithi119.stdout:[MIRROR] kernel-core-5.14.0-364.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-364.el9.x86_64.rpm (IP: 163.237.219.7) 2023-09-13T02:01:06.051 INFO:teuthology.orchestra.run.smithi119.stdout:[MIRROR] kernel-modules-5.14.0-364.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-364.el9.x86_64.rpm (IP: 163.237.219.7) 2023-09-13T02:01:06.192 INFO:teuthology.orchestra.run.smithi119.stdout:[MIRROR] kernel-core-5.14.0-364.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-364.el9.x86_64.rpm (IP: 163.237.219.7) 2023-09-13T02:01:06.232 INFO:teuthology.orchestra.run.smithi119.stdout:[MIRROR] kernel-modules-5.14.0-364.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-364.el9.x86_64.rpm (IP: 163.237.219.7) 2023-09-13T02:01:07.036 INFO:teuthology.orchestra.run.smithi119.stdout:[MIRROR] kernel-5.14.0-364.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-364.el9.x86_64.rpm (IP: 163.237.219.7) 2023-09-13T02:01:07.105 INFO:teuthology.orchestra.run.smithi119.stdout:[MIRROR] kernel-5.14.0-364.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-364.el9.x86_64.rpm (IP: 163.237.219.7) 2023-09-13T02:01:07.578 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-09-13T02:01:07.578 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-09-13T02:01:07.672 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2023-09-13T02:01:07.680 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2023-09-13T02:01:07.680 INFO:teuthology.orchestra.run.smithi104.stdout: Package Architecture Version Repository Size 2023-09-13T02:01:07.680 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2023-09-13T02:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2023-09-13T02:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout: kernel x86_64 5.14.0-364.el9 baseos 5.0 M 2023-09-13T02:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2023-09-13T02:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-core x86_64 5.14.0-364.el9 baseos 20 M 2023-09-13T02:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules x86_64 5.14.0-364.el9 baseos 37 M 2023-09-13T02:01:07.682 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-core x86_64 5.14.0-364.el9 baseos 32 M 2023-09-13T02:01:07.682 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:01:07.682 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2023-09-13T02:01:07.682 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2023-09-13T02:01:07.683 INFO:teuthology.orchestra.run.smithi104.stdout:Install 4 Packages 2023-09-13T02:01:07.683 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:01:07.684 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 93 M 2023-09-13T02:01:07.684 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 120 M 2023-09-13T02:01:07.684 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2023-09-13T02:01:07.859 INFO:teuthology.orchestra.run.smithi119.stdout:(1/4): kernel-5.14.0-364.el9.x86_64.rpm 2.6 MB/s | 5.0 MB 00:01 2023-09-13T02:01:07.888 INFO:teuthology.orchestra.run.smithi119.stdout:[MIRROR] kernel-modules-core-5.14.0-364.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-364.el9.x86_64.rpm (IP: 163.237.219.7) 2023-09-13T02:01:07.916 INFO:teuthology.orchestra.run.smithi119.stdout:[MIRROR] kernel-modules-core-5.14.0-364.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-364.el9.x86_64.rpm (IP: 163.237.219.7) 2023-09-13T02:01:10.231 INFO:teuthology.orchestra.run.smithi104.stdout:(1/4): kernel-5.14.0-364.el9.x86_64.rpm 2.1 MB/s | 5.0 MB 00:02 2023-09-13T02:01:10.909 INFO:teuthology.orchestra.run.smithi119.stdout:(2/4): kernel-modules-5.14.0-364.el9.x86_64.rpm 7.4 MB/s | 37 MB 00:05 2023-09-13T02:01:12.218 INFO:teuthology.orchestra.run.smithi119.stdout:(3/4): kernel-modules-core-5.14.0-364.el9.x86_6 7.3 MB/s | 32 MB 00:04 2023-09-13T02:01:12.414 INFO:teuthology.orchestra.run.smithi104.stdout:(2/4): kernel-modules-5.14.0-364.el9.x86_64.rpm 8.1 MB/s | 37 MB 00:04 2023-09-13T02:01:13.956 INFO:teuthology.orchestra.run.smithi104.stdout:(3/4): kernel-modules-core-5.14.0-364.el9.x86_6 8.5 MB/s | 32 MB 00:03 2023-09-13T02:01:14.867 INFO:teuthology.orchestra.run.smithi119.stdout:(4/4): kernel-core-5.14.0-364.el9.x86_64.rpm 2.2 MB/s | 20 MB 00:08 2023-09-13T02:01:14.869 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-09-13T02:01:14.870 INFO:teuthology.orchestra.run.smithi119.stdout:Total 10 MB/s | 93 MB 00:09 2023-09-13T02:01:15.701 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-09-13T02:01:16.099 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-09-13T02:01:16.100 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-09-13T02:01:17.394 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-09-13T02:01:17.395 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-09-13T02:01:19.480 INFO:teuthology.orchestra.run.smithi104.stdout:(4/4): kernel-core-5.14.0-364.el9.x86_64.rpm 1.7 MB/s | 20 MB 00:11 2023-09-13T02:01:19.481 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2023-09-13T02:01:19.481 INFO:teuthology.orchestra.run.smithi104.stdout:Total 7.9 MB/s | 93 MB 00:11 2023-09-13T02:01:19.985 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-09-13T02:01:20.317 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2023-09-13T02:01:20.586 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-modules-core-5.14.0-364.el9.x86_64 1/4 2023-09-13T02:01:20.660 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2023-09-13T02:01:20.661 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2023-09-13T02:01:20.720 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-core-5.14.0-364.el9.x86_64 2/4 2023-09-13T02:01:21.993 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2023-09-13T02:01:21.994 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2023-09-13T02:01:23.474 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-core-5.14.0-364.el9.x86_64 2/4 2023-09-13T02:01:23.656 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-modules-5.14.0-364.el9.x86_64 3/4 2023-09-13T02:01:24.867 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2023-09-13T02:01:25.478 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-modules-core-5.14.0-364.el9.x86_64 1/4 2023-09-13T02:01:25.595 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-core-5.14.0-364.el9.x86_64 2/4 2023-09-13T02:01:28.201 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-5.14.0-364.el9.x86_64 3/4 2023-09-13T02:01:28.297 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-core-5.14.0-364.el9.x86_64 2/4 2023-09-13T02:01:28.401 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-5.14.0-364.el9.x86_64 4/4 2023-09-13T02:01:28.487 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-modules-5.14.0-364.el9.x86_64 3/4 2023-09-13T02:01:32.977 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-core-5.14.0-364.el9.x86_64 4/4 2023-09-13T02:01:33.091 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-5.14.0-364.el9.x86_64 3/4 2023-09-13T02:01:33.382 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-5.14.0-364.el9.x86_64 4/4 2023-09-13T02:01:37.987 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-core-5.14.0-364.el9.x86_64 4/4 2023-09-13T02:02:02.123 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-core-5.14.0-364.el9.x86_64 4/4 2023-09-13T02:02:02.164 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-5.14.0-364.el9.x86_64 4/4 2023-09-13T02:02:02.523 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-5.14.0-364.el9.x86_64 4/4 2023-09-13T02:02:02.524 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-5.14.0-364.el9.x86_64 1/4 2023-09-13T02:02:02.524 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-core-5.14.0-364.el9.x86_64 2/4 2023-09-13T02:02:02.524 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-modules-5.14.0-364.el9.x86_64 3/4 2023-09-13T02:02:02.946 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-modules-core-5.14.0-364.el9.x86_64 4/4 2023-09-13T02:02:02.947 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:02:02.947 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-09-13T02:02:02.947 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-5.14.0-364.el9.x86_64 2023-09-13T02:02:02.948 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-core-5.14.0-364.el9.x86_64 2023-09-13T02:02:02.948 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-5.14.0-364.el9.x86_64 2023-09-13T02:02:02.948 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-core-5.14.0-364.el9.x86_64 2023-09-13T02:02:02.948 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:02:02.949 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-09-13T02:02:03.415 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel | sort -rV | head -n 1 2023-09-13T02:02:03.547 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-5.14.0-364.el9.x86_64 2023-09-13T02:02:03.548 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-364.el9.x86_64 2023-09-13T02:02:03.548 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-364.el9.x86_64 2023-09-13T02:02:03.548 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-13T02:02:03.549 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-13T02:02:03.549 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-09-13T02:02:03.549 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi119.front.sepia.ceph.com, path=None, version=distro) 2023-09-13T02:02:03.549 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel | sort -rV | head -n 1 2023-09-13T02:02:03.663 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-5.14.0-364.el9.x86_64 2023-09-13T02:02:03.663 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-364.el9.x86_64 2023-09-13T02:02:03.664 DEBUG:teuthology.orchestra.run.smithi119:> sudo rpm -qi grub2-tools 2023-09-13T02:02:03.706 INFO:teuthology.orchestra.run.smithi119.stdout:Name : grub2-tools 2023-09-13T02:02:03.706 INFO:teuthology.orchestra.run.smithi119.stdout:Epoch : 1 2023-09-13T02:02:03.706 INFO:teuthology.orchestra.run.smithi119.stdout:Version : 2.06 2023-09-13T02:02:03.707 INFO:teuthology.orchestra.run.smithi119.stdout:Release : 68.el9 2023-09-13T02:02:03.707 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: x86_64 2023-09-13T02:02:03.707 INFO:teuthology.orchestra.run.smithi119.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-09-13T02:02:03.707 INFO:teuthology.orchestra.run.smithi119.stdout:Group : Unspecified 2023-09-13T02:02:03.707 INFO:teuthology.orchestra.run.smithi119.stdout:Size : 8264254 2023-09-13T02:02:03.708 INFO:teuthology.orchestra.run.smithi119.stdout:License : GPLv3+ 2023-09-13T02:02:03.708 INFO:teuthology.orchestra.run.smithi119.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-09-13T02:02:03.708 INFO:teuthology.orchestra.run.smithi119.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-09-13T02:02:03.708 INFO:teuthology.orchestra.run.smithi119.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-09-13T02:02:03.708 INFO:teuthology.orchestra.run.smithi119.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-09-13T02:02:03.709 INFO:teuthology.orchestra.run.smithi119.stdout:Packager : builder@centos.org 2023-09-13T02:02:03.709 INFO:teuthology.orchestra.run.smithi119.stdout:Vendor : CentOS 2023-09-13T02:02:03.709 INFO:teuthology.orchestra.run.smithi119.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-13T02:02:03.709 INFO:teuthology.orchestra.run.smithi119.stdout:Summary : Support tools for GRUB. 2023-09-13T02:02:03.709 INFO:teuthology.orchestra.run.smithi119.stdout:Description : 2023-09-13T02:02:03.709 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:02:03.710 INFO:teuthology.orchestra.run.smithi119.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-13T02:02:03.710 INFO:teuthology.orchestra.run.smithi119.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-13T02:02:03.710 INFO:teuthology.orchestra.run.smithi119.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-13T02:02:03.710 INFO:teuthology.orchestra.run.smithi119.stdout:hardware devices. 2023-09-13T02:02:03.710 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:02:03.711 INFO:teuthology.orchestra.run.smithi119.stdout:This subpackage provides tools for support of all platforms. 2023-09-13T02:02:03.712 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-13T02:02:03.712 INFO:teuthology.task.kernel:Updating grub on smithi119 to boot 5.14.0-364.el9.x86_64 2023-09-13T02:02:03.712 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-13T02:02:04.326 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2023-09-13T02:02:05.723 INFO:teuthology.orchestra.run.smithi119.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-09-13T02:02:05.760 INFO:teuthology.orchestra.run.smithi119.stderr:done 2023-09-13T02:02:05.762 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2023-09-13T02:02:05.778 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.4fKzjwhNIU 2023-09-13T02:02:05.778 DEBUG:teuthology.orchestra.run.smithi119:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4fKzjwhNIU 2023-09-13T02:02:05.847 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.4fKzjwhNIU 2023-09-13T02:02:05.980 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.4fKzjwhNIU is 6KB 2023-09-13T02:02:06.030 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.4fKzjwhNIU 2023-09-13T02:02:06.044 DEBUG:teuthology.orchestra.run.smithi119:> sudo /bin/ls /boot/loader/entries || true 2023-09-13T02:02:06.109 INFO:teuthology.orchestra.run.smithi119.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-09-13T02:02:06.109 INFO:teuthology.orchestra.run.smithi119.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-09-13T02:02:06.110 INFO:teuthology.orchestra.run.smithi119.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-09-13T02:02:06.110 INFO:teuthology.orchestra.run.smithi119.stdout:15949e3c88704300882482eddfd7baae-5.14.0-364.el9.x86_64.conf 2023-09-13T02:02:06.111 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-364.el9.x86_64 2023-09-13T02:02:06.254 DEBUG:teuthology.orchestra.run.smithi119:> sudo shutdown -r now 2023-09-13T02:02:06.911 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-core-5.14.0-364.el9.x86_64 4/4 2023-09-13T02:02:06.952 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-5.14.0-364.el9.x86_64 4/4 2023-09-13T02:02:07.359 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-5.14.0-364.el9.x86_64 4/4 2023-09-13T02:02:07.359 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-5.14.0-364.el9.x86_64 1/4 2023-09-13T02:02:07.360 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-core-5.14.0-364.el9.x86_64 2/4 2023-09-13T02:02:07.360 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-modules-5.14.0-364.el9.x86_64 3/4 2023-09-13T02:02:07.732 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-modules-core-5.14.0-364.el9.x86_64 4/4 2023-09-13T02:02:07.732 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:02:07.733 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2023-09-13T02:02:07.733 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-5.14.0-364.el9.x86_64 2023-09-13T02:02:07.733 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-core-5.14.0-364.el9.x86_64 2023-09-13T02:02:07.733 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-5.14.0-364.el9.x86_64 2023-09-13T02:02:07.733 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-core-5.14.0-364.el9.x86_64 2023-09-13T02:02:07.734 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:02:07.734 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2023-09-13T02:02:08.169 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2023-09-13T02:02:08.307 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-5.14.0-364.el9.x86_64 2023-09-13T02:02:08.308 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-364.el9.x86_64 2023-09-13T02:02:08.308 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-364.el9.x86_64 2023-09-13T02:02:08.308 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-13T02:02:08.308 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-13T02:02:08.309 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-09-13T02:02:08.309 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi104.front.sepia.ceph.com, path=None, version=distro) 2023-09-13T02:02:08.309 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2023-09-13T02:02:08.421 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-5.14.0-364.el9.x86_64 2023-09-13T02:02:08.421 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-364.el9.x86_64 2023-09-13T02:02:08.422 DEBUG:teuthology.orchestra.run.smithi104:> sudo rpm -qi grub2-tools 2023-09-13T02:02:08.456 INFO:teuthology.orchestra.run.smithi104.stdout:Name : grub2-tools 2023-09-13T02:02:08.457 INFO:teuthology.orchestra.run.smithi104.stdout:Epoch : 1 2023-09-13T02:02:08.457 INFO:teuthology.orchestra.run.smithi104.stdout:Version : 2.06 2023-09-13T02:02:08.457 INFO:teuthology.orchestra.run.smithi104.stdout:Release : 68.el9 2023-09-13T02:02:08.457 INFO:teuthology.orchestra.run.smithi104.stdout:Architecture: x86_64 2023-09-13T02:02:08.458 INFO:teuthology.orchestra.run.smithi104.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-09-13T02:02:08.458 INFO:teuthology.orchestra.run.smithi104.stdout:Group : Unspecified 2023-09-13T02:02:08.458 INFO:teuthology.orchestra.run.smithi104.stdout:Size : 8264254 2023-09-13T02:02:08.458 INFO:teuthology.orchestra.run.smithi104.stdout:License : GPLv3+ 2023-09-13T02:02:08.458 INFO:teuthology.orchestra.run.smithi104.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-09-13T02:02:08.459 INFO:teuthology.orchestra.run.smithi104.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-09-13T02:02:08.459 INFO:teuthology.orchestra.run.smithi104.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-09-13T02:02:08.459 INFO:teuthology.orchestra.run.smithi104.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-09-13T02:02:08.459 INFO:teuthology.orchestra.run.smithi104.stdout:Packager : builder@centos.org 2023-09-13T02:02:08.459 INFO:teuthology.orchestra.run.smithi104.stdout:Vendor : CentOS 2023-09-13T02:02:08.460 INFO:teuthology.orchestra.run.smithi104.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-13T02:02:08.460 INFO:teuthology.orchestra.run.smithi104.stdout:Summary : Support tools for GRUB. 2023-09-13T02:02:08.460 INFO:teuthology.orchestra.run.smithi104.stdout:Description : 2023-09-13T02:02:08.460 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:02:08.461 INFO:teuthology.orchestra.run.smithi104.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-13T02:02:08.461 INFO:teuthology.orchestra.run.smithi104.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-13T02:02:08.461 INFO:teuthology.orchestra.run.smithi104.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-13T02:02:08.461 INFO:teuthology.orchestra.run.smithi104.stdout:hardware devices. 2023-09-13T02:02:08.461 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:02:08.462 INFO:teuthology.orchestra.run.smithi104.stdout:This subpackage provides tools for support of all platforms. 2023-09-13T02:02:08.463 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-13T02:02:08.463 INFO:teuthology.task.kernel:Updating grub on smithi104 to boot 5.14.0-364.el9.x86_64 2023-09-13T02:02:08.463 DEBUG:teuthology.orchestra.run.smithi104:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-13T02:02:09.128 INFO:teuthology.orchestra.run.smithi104.stderr:Generating grub configuration file ... 2023-09-13T02:02:10.475 INFO:teuthology.orchestra.run.smithi104.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-09-13T02:02:10.504 INFO:teuthology.orchestra.run.smithi104.stderr:done 2023-09-13T02:02:10.508 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2023-09-13T02:02:10.524 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.8VmWzVpZpS 2023-09-13T02:02:10.524 DEBUG:teuthology.orchestra.run.smithi104:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8VmWzVpZpS 2023-09-13T02:02:10.593 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.8VmWzVpZpS 2023-09-13T02:02:10.730 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.8VmWzVpZpS is 6KB 2023-09-13T02:02:10.778 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.8VmWzVpZpS 2023-09-13T02:02:10.792 DEBUG:teuthology.orchestra.run.smithi104:> sudo /bin/ls /boot/loader/entries || true 2023-09-13T02:02:10.864 INFO:teuthology.orchestra.run.smithi104.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-09-13T02:02:10.865 INFO:teuthology.orchestra.run.smithi104.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-09-13T02:02:10.865 INFO:teuthology.orchestra.run.smithi104.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-09-13T02:02:10.865 INFO:teuthology.orchestra.run.smithi104.stdout:15949e3c88704300882482eddfd7baae-5.14.0-364.el9.x86_64.conf 2023-09-13T02:02:10.866 DEBUG:teuthology.orchestra.run.smithi104:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-364.el9.x86_64 2023-09-13T02:02:11.025 DEBUG:teuthology.orchestra.run.smithi104:> sudo shutdown -r now 2023-09-13T02:02:36.282 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-09-13T02:02:36.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-09-13T02:02:36.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:02:41.030 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-09-13T02:02:41.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-09-13T02:02:41.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:03:15.482 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-13T02:03:24.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-09-13T02:03:24.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:03:36.299 DEBUG:teuthology.orchestra.remote:timed out 2023-09-13T02:03:42.874 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-13T02:03:45.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-09-13T02:03:45.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:03:45.802 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-09-13T02:03:46.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-09-13T02:03:46.359 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-364.el9.x86_64"... 2023-09-13T02:03:46.359 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2023-09-13T02:03:46.373 INFO:teuthology.orchestra.run.smithi119.stdout:5.14.0-364.el9.x86_64 2023-09-13T02:03:46.374 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-364.el9.x86_64 vs 5.14.0-364.el9.x86_64 2023-09-13T02:03:46.374 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-13T02:03:46.375 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-09-13T02:03:47.376 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-09-13T02:03:47.376 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-13T02:03:47.473 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2023-09-13T02:03:47.527 DEBUG:teuthology.parallel:result is None 2023-09-13T02:03:54.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-09-13T02:03:54.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:03:55.300 DEBUG:teuthology.orchestra.run.smithi104:> true 2023-09-13T02:03:55.673 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-09-13T02:03:55.674 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-364.el9.x86_64"... 2023-09-13T02:03:55.674 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2023-09-13T02:03:55.688 INFO:teuthology.orchestra.run.smithi104.stdout:5.14.0-364.el9.x86_64 2023-09-13T02:03:55.688 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-364.el9.x86_64 vs 5.14.0-364.el9.x86_64 2023-09-13T02:03:55.688 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-13T02:03:55.689 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-09-13T02:03:56.689 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-09-13T02:03:56.690 DEBUG:teuthology.orchestra.run.smithi104:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-13T02:03:56.776 INFO:teuthology.orchestra.run.smithi104.stdout:ttyS1 2023-09-13T02:03:56.817 DEBUG:teuthology.parallel:result is None 2023-09-13T02:03:56.818 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-13T02:03:56.825 INFO:teuthology.task.internal:Creating test directory... 2023-09-13T02:03:56.825 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-13T02:03:56.828 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-13T02:03:56.847 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-13T02:03:56.854 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-13T02:03:56.864 INFO:teuthology.task.internal:Creating archive directory... 2023-09-13T02:03:56.864 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-13T02:03:56.888 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-13T02:03:56.998 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-13T02:03:57.006 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-13T02:03:57.006 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-13T02:03:57.008 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-13T02:03:57.042 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T02:03:57.043 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T02:03:57.055 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T02:03:57.056 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T02:03:57.057 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-13T02:03:57.065 INFO:teuthology.task.internal:Configuring sudo... 2023-09-13T02:03:57.065 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-13T02:03:57.103 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-13T02:03:57.133 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-13T02:03:57.143 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-13T02:03:57.143 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-13T02:03:57.174 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-13T02:03:57.190 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-13T02:03:57.273 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-13T02:03:57.331 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-13T02:03:57.415 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-13T02:03:57.460 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:03:57.461 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-13T02:03:57.530 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-13T02:03:57.575 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-13T02:03:57.625 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-13T02:03:57.710 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-13T02:03:57.752 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:03:57.752 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-13T02:03:57.820 DEBUG:teuthology.orchestra.run.smithi104:> sudo service rsyslog restart 2023-09-13T02:03:57.823 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2023-09-13T02:03:57.877 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-13T02:03:57.905 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-13T02:03:58.414 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-13T02:03:58.422 INFO:teuthology.task.internal:Starting timer... 2023-09-13T02:03:58.422 INFO:teuthology.run_tasks:Running task pcp... 2023-09-13T02:03:58.433 INFO:teuthology.run_tasks:Running task selinux... 2023-09-13T02:03:58.442 DEBUG:teuthology.orchestra.run.smithi104:> sudo service auditd rotate 2023-09-13T02:03:58.621 INFO:teuthology.orchestra.run.smithi104.stdout:Rotating logs: 2023-09-13T02:03:58.622 DEBUG:teuthology.orchestra.run.smithi119:> sudo service auditd rotate 2023-09-13T02:03:58.681 INFO:teuthology.orchestra.run.smithi119.stdout:Rotating logs: 2023-09-13T02:03:58.683 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-13T02:03:58.683 DEBUG:teuthology.orchestra.run.smithi104:> /usr/sbin/getenforce 2023-09-13T02:03:58.709 INFO:teuthology.orchestra.run.smithi104.stdout:Permissive 2023-09-13T02:03:58.709 DEBUG:teuthology.orchestra.run.smithi119:> /usr/sbin/getenforce 2023-09-13T02:03:58.728 INFO:teuthology.orchestra.run.smithi119.stdout:Permissive 2023-09-13T02:03:58.728 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi104.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi119.front.sepia.ceph.com': 'permissive'} 2023-09-13T02:03:58.729 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-13T02:03:58.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T02:03:58.776 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-13T02:03:58.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T02:03:58.805 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-13T02:03:58.805 DEBUG:teuthology.orchestra.run.smithi104:> sudo /usr/sbin/setenforce permissive 2023-09-13T02:03:58.853 DEBUG:teuthology.orchestra.run.smithi119:> sudo /usr/sbin/setenforce permissive 2023-09-13T02:03:58.888 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-13T02:03:58.900 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-09-13T02:03:58.900 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-13T02:03:58.922 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-13T02:03:58.924 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi104.front.sepia.ceph.com,smithi119.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-13T02:09:15.701 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi104.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com')] 2023-09-13T02:09:15.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-09-13T02:09:15.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:09:15.790 DEBUG:teuthology.orchestra.run.smithi104:> true 2023-09-13T02:09:15.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-09-13T02:09:15.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-09-13T02:09:15.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:09:15.943 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-09-13T02:09:16.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-09-13T02:09:16.018 INFO:teuthology.run_tasks:Running task clock... 2023-09-13T02:09:16.029 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-13T02:09:16.029 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-13T02:09:16.030 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-13T02:09:16.032 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-13T02:09:16.032 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-13T02:09:16.061 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-13T02:09:16.078 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-13T02:09:16.091 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-13T02:09:16.107 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: ntpd: command not found 2023-09-13T02:09:16.108 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-13T02:09:16.121 INFO:teuthology.orchestra.run.smithi104.stdout:506 Cannot talk to daemon 2023-09-13T02:09:16.136 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-13T02:09:16.139 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: ntpd: command not found 2023-09-13T02:09:16.152 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-13T02:09:16.153 INFO:teuthology.orchestra.run.smithi119.stdout:506 Cannot talk to daemon 2023-09-13T02:09:16.170 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-13T02:09:16.186 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-13T02:09:16.195 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2023-09-13T02:09:16.199 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-13T02:09:16.199 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2023-09-13T02:09:16.199 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T02:09:16.199 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T02:09:16.199 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T02:09:16.200 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T02:09:16.229 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2023-09-13T02:09:16.232 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-13T02:09:16.232 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2023-09-13T02:09:16.232 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T02:09:16.232 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T02:09:16.232 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T02:09:16.233 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T02:09:16.234 INFO:teuthology.run_tasks:Running task install... 2023-09-13T02:09:16.242 DEBUG:teuthology.task.install:project ceph 2023-09-13T02:09:16.243 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_system_packages': {'deb': ['python3-pytest'], 'rpm': ['python3-pytest']}, 'flavor': 'default', 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0'}} 2023-09-13T02:09:16.243 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'python3-pytest'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'python3-pytest']}, 'flavor': 'default', 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0'} 2023-09-13T02:09:16.244 INFO:teuthology.task.install:Using flavor: default 2023-09-13T02:09:16.251 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-13T02:09:16.251 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-09-13T02:09:16.252 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'python3-pytest'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'python3-pytest']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0', 'tag': None, 'wait_for_package': False} 2023-09-13T02:09:16.253 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2110e00747b31a0d73768c9e5229da18b26b8aa0 2023-09-13T02:09:16.255 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'python3-pytest'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'python3-pytest']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0', 'tag': None, 'wait_for_package': False} 2023-09-13T02:09:16.255 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2110e00747b31a0d73768c9e5229da18b26b8aa0 2023-09-13T02:09:16.401 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230912.122437/2110e00747b31a0d73768c9e5229da18b26b8aa0/centos/9/flavors/default/ 2023-09-13T02:09:16.402 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6088.g2110e007 2023-09-13T02:09:16.469 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230912.122437/2110e00747b31a0d73768c9e5229da18b26b8aa0/centos/9/flavors/default/ 2023-09-13T02:09:16.470 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6088.g2110e007 2023-09-13T02:09:16.583 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230912.122437/2110e00747b31a0d73768c9e5229da18b26b8aa0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230912.122437/2110e00747b31a0d73768c9e5229da18b26b8aa0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230912.122437/2110e00747b31a0d73768c9e5229da18b26b8aa0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-13T02:09:16.583 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:09:16.584 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-13T02:09:16.590 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230912.122437/2110e00747b31a0d73768c9e5229da18b26b8aa0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230912.122437/2110e00747b31a0d73768c9e5229da18b26b8aa0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230912.122437/2110e00747b31a0d73768c9e5229da18b26b8aa0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-13T02:09:16.591 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:09:16.591 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-13T02:09:16.611 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, python3-pytest, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, python3-pytest, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, python3-pytest on remote rpm x86_64 2023-09-13T02:09:16.611 DEBUG:teuthology.orchestra.run.smithi119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2110e00747b31a0d73768c9e5229da18b26b8aa0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-13T02:09:16.620 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, python3-pytest, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, python3-pytest, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, python3-pytest, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, python3-pytest on remote rpm x86_64 2023-09-13T02:09:16.620 DEBUG:teuthology.orchestra.run.smithi104:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2110e00747b31a0d73768c9e5229da18b26b8aa0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-13T02:09:16.678 DEBUG:teuthology.orchestra.run.smithi119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-13T02:09:16.688 DEBUG:teuthology.orchestra.run.smithi104:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-13T02:09:16.758 DEBUG:teuthology.orchestra.run.smithi119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-13T02:09:16.767 DEBUG:teuthology.orchestra.run.smithi104:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-13T02:09:16.824 INFO:teuthology.orchestra.run.smithi119.stdout:check_obsoletes = 1 2023-09-13T02:09:16.825 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum clean all 2023-09-13T02:09:16.834 INFO:teuthology.orchestra.run.smithi104.stdout:check_obsoletes = 1 2023-09-13T02:09:16.835 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum clean all 2023-09-13T02:09:17.071 INFO:teuthology.orchestra.run.smithi119.stdout:66 files removed 2023-09-13T02:09:17.084 INFO:teuthology.orchestra.run.smithi104.stdout:66 files removed 2023-09-13T02:09:17.097 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib python3-pytest bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib python3-pytest bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib python3-pytest bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib python3-pytest 2023-09-13T02:09:17.111 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib python3-pytest bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib python3-pytest bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib python3-pytest bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib python3-pytest 2023-09-13T02:09:17.819 INFO:teuthology.orchestra.run.smithi104.stdout:ceph packages for x86_64 196 kB/s | 78 kB 00:00 2023-09-13T02:09:17.842 INFO:teuthology.orchestra.run.smithi119.stdout:ceph packages for x86_64 179 kB/s | 78 kB 00:00 2023-09-13T02:09:18.170 INFO:teuthology.orchestra.run.smithi104.stdout:ceph noarch packages 30 kB/s | 9.4 kB 00:00 2023-09-13T02:09:18.268 INFO:teuthology.orchestra.run.smithi119.stdout:ceph noarch packages 25 kB/s | 9.4 kB 00:00 2023-09-13T02:09:18.579 INFO:teuthology.orchestra.run.smithi104.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2023-09-13T02:09:18.602 INFO:teuthology.orchestra.run.smithi119.stdout:ceph source packages 6.1 kB/s | 1.9 kB 00:00 2023-09-13T02:09:19.156 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS-9 - AppStream 11 MB/s | 6.3 MB 00:00 2023-09-13T02:09:19.212 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS-9 - AppStream 11 MB/s | 6.3 MB 00:00 2023-09-13T02:09:20.606 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS-9 - BaseOS 4.9 MB/s | 2.0 MB 00:00 2023-09-13T02:09:20.621 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS-9 - BaseOS 5.1 MB/s | 2.0 MB 00:00 2023-09-13T02:09:21.731 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 7.8 MB 00:00 2023-09-13T02:09:25.063 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 7.5 MB/s | 18 MB 00:02 2023-09-13T02:09:33.889 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 1.0 MB/s | 5.7 MB 00:05 2023-09-13T02:09:35.540 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 14 kB 00:00 2023-09-13T02:09:37.410 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 10 MB/s | 19 MB 00:01 2023-09-13T02:09:41.708 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-09-13T02:09:43.821 INFO:teuthology.orchestra.run.smithi119.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-09-13T02:09:43.821 INFO:teuthology.orchestra.run.smithi119.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-09-13T02:09:43.834 INFO:teuthology.orchestra.run.smithi119.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-09-13T02:09:43.835 INFO:teuthology.orchestra.run.smithi119.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-09-13T02:09:43.836 INFO:teuthology.orchestra.run.smithi119.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-09-13T02:09:43.837 INFO:teuthology.orchestra.run.smithi119.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-09-13T02:09:43.839 INFO:teuthology.orchestra.run.smithi119.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-09-13T02:09:43.842 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-09-13T02:09:43.843 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-09-13T02:09:43.912 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-09-13T02:09:43.926 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================================ 2023-09-13T02:09:43.927 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2023-09-13T02:09:43.927 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================================ 2023-09-13T02:09:43.927 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-09-13T02:09:43.927 INFO:teuthology.orchestra.run.smithi119.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-09-13T02:09:43.927 INFO:teuthology.orchestra.run.smithi119.stdout: ceph x86_64 2:18.0.0-6088.g2110e007.el9 ceph 6.5 k 2023-09-13T02:09:43.928 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base x86_64 2:18.0.0-6088.g2110e007.el9 ceph 5.2 M 2023-09-13T02:09:43.928 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse x86_64 2:18.0.0-6088.g2110e007.el9 ceph 850 k 2023-09-13T02:09:43.928 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6088.g2110e007.el9 ceph 141 k 2023-09-13T02:09:43.928 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr x86_64 2:18.0.0-6088.g2110e007.el9 ceph 1.5 M 2023-09-13T02:09:43.928 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 132 k 2023-09-13T02:09:43.929 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 1.7 M 2023-09-13T02:09:43.929 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 7.4 M 2023-09-13T02:09:43.929 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 47 k 2023-09-13T02:09:43.929 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw x86_64 2:18.0.0-6088.g2110e007.el9 ceph 8.2 M 2023-09-13T02:09:43.929 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test x86_64 2:18.0.0-6088.g2110e007.el9 ceph 40 M 2023-09-13T02:09:43.930 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 262 k 2023-09-13T02:09:43.930 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 242 k 2023-09-13T02:09:43.930 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror x86_64 2:18.0.0-6088.g2110e007.el9 ceph 218 k 2023-09-13T02:09:43.930 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 18 k 2023-09-13T02:09:43.930 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-09-13T02:09:43.931 INFO:teuthology.orchestra.run.smithi119.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-09-13T02:09:43.931 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-09-13T02:09:43.931 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel x86_64 2:18.0.0-6088.g2110e007.el9 ceph 31 k 2023-09-13T02:09:43.931 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 x86_64 2:18.0.0-6088.g2110e007.el9 ceph 668 k 2023-09-13T02:09:43.931 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel x86_64 2:18.0.0-6088.g2110e007.el9 ceph 126 k 2023-09-13T02:09:43.932 INFO:teuthology.orchestra.run.smithi119.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-09-13T02:09:43.932 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-09-13T02:09:43.932 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-09-13T02:09:43.932 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-09-13T02:09:43.932 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-09-13T02:09:43.933 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-09-13T02:09:43.933 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs x86_64 2:18.0.0-6088.g2110e007.el9 ceph 161 k 2023-09-13T02:09:43.933 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytest noarch 6.2.2-6.el9 CentOS-AppStream 474 k 2023-09-13T02:09:43.933 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados x86_64 2:18.0.0-6088.g2110e007.el9 ceph 320 k 2023-09-13T02:09:43.933 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd x86_64 2:18.0.0-6088.g2110e007.el9 ceph 297 k 2023-09-13T02:09:43.934 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw x86_64 2:18.0.0-6088.g2110e007.el9 ceph 99 k 2023-09-13T02:09:43.935 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse x86_64 2:18.0.0-6088.g2110e007.el9 ceph 85 k 2023-09-13T02:09:43.935 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror x86_64 2:18.0.0-6088.g2110e007.el9 ceph 3.0 M 2023-09-13T02:09:43.935 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd x86_64 2:18.0.0-6088.g2110e007.el9 ceph 168 k 2023-09-13T02:09:43.935 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-09-13T02:09:43.936 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrading: 2023-09-13T02:09:43.936 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager x86_64 1:1.45.2-1.el9 baseos 2.2 M 2023-09-13T02:09:43.936 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-libnm x86_64 1:1.45.2-1.el9 baseos 1.8 M 2023-09-13T02:09:43.937 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-team x86_64 1:1.45.2-1.el9 baseos 42 k 2023-09-13T02:09:43.937 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-tui x86_64 1:1.45.2-1.el9 baseos 247 k 2023-09-13T02:09:43.937 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 x86_64 2:18.0.0-6088.g2110e007.el9 ceph 3.3 M 2023-09-13T02:09:43.937 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1 x86_64 2:18.0.0-6088.g2110e007.el9 ceph 3.0 M 2023-09-13T02:09:43.937 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2023-09-13T02:09:43.938 INFO:teuthology.orchestra.run.smithi119.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-09-13T02:09:43.938 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-09-13T02:09:43.938 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common x86_64 2:18.0.0-6088.g2110e007.el9 ceph 19 M 2023-09-13T02:09:43.938 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 23 k 2023-09-13T02:09:43.938 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds x86_64 2:18.0.0-6088.g2110e007.el9 ceph 2.1 M 2023-09-13T02:09:43.939 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 242 k 2023-09-13T02:09:43.939 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon x86_64 2:18.0.0-6088.g2110e007.el9 ceph 4.4 M 2023-09-13T02:09:43.939 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd x86_64 2:18.0.0-6088.g2110e007.el9 ceph 18 M 2023-09-13T02:09:43.939 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 15 k 2023-09-13T02:09:43.940 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux x86_64 2:18.0.0-6088.g2110e007.el9 ceph 24 k 2023-09-13T02:09:43.940 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-09-13T02:09:43.940 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-09-13T02:09:43.941 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-09-13T02:09:43.941 INFO:teuthology.orchestra.run.smithi119.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-09-13T02:09:43.941 INFO:teuthology.orchestra.run.smithi119.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-09-13T02:09:43.941 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-09-13T02:09:43.941 INFO:teuthology.orchestra.run.smithi119.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-09-13T02:09:43.942 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-09-13T02:09:43.943 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-09-13T02:09:43.943 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite x86_64 2:18.0.0-6088.g2110e007.el9 ceph 163 k 2023-09-13T02:09:43.943 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran x86_64 11.4.1-2.1.el9 baseos 809 k 2023-09-13T02:09:43.943 INFO:teuthology.orchestra.run.smithi119.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-09-13T02:09:43.943 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-09-13T02:09:43.944 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath x86_64 11.4.1-2.1.el9 baseos 198 k 2023-09-13T02:09:43.944 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-09-13T02:09:43.944 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 x86_64 2:18.0.0-6088.g2110e007.el9 ceph 473 k 2023-09-13T02:09:43.945 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-09-13T02:09:43.945 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2 x86_64 2:18.0.0-6088.g2110e007.el9 ceph 4.7 M 2023-09-13T02:09:43.945 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-09-13T02:09:43.945 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-09-13T02:09:43.945 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-09-13T02:09:43.946 INFO:teuthology.orchestra.run.smithi119.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-09-13T02:09:43.946 INFO:teuthology.orchestra.run.smithi119.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-09-13T02:09:43.947 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-09-13T02:09:43.947 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-09-13T02:09:43.947 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-09-13T02:09:43.947 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-09-13T02:09:43.947 INFO:teuthology.orchestra.run.smithi119.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-09-13T02:09:43.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-09-13T02:09:43.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-09-13T02:09:43.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-09-13T02:09:43.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse x86_64 2:18.0.0-6088.g2110e007.el9 ceph 45 k 2023-09-13T02:09:43.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common x86_64 2:18.0.0-6088.g2110e007.el9 ceph 127 k 2023-09-13T02:09:43.949 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-09-13T02:09:43.949 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-09-13T02:09:43.949 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-09-13T02:09:43.949 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-09-13T02:09:43.950 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-09-13T02:09:43.950 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-09-13T02:09:43.950 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth noarch 1:2.22.0-1.el9 epel 197 k 2023-09-13T02:09:43.950 INFO:teuthology.orchestra.run.smithi119.stdout: python3-iniconfig noarch 1.1.1-7.el9 CentOS-AppStream 16 k 2023-09-13T02:09:43.950 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-09-13T02:09:43.951 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-09-13T02:09:43.951 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-09-13T02:09:43.951 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-09-13T02:09:43.951 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-09-13T02:09:43.951 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-09-13T02:09:43.952 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-09-13T02:09:43.952 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-09-13T02:09:43.952 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-09-13T02:09:43.952 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-09-13T02:09:43.952 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-09-13T02:09:43.952 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-09-13T02:09:43.953 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-09-13T02:09:43.953 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-09-13T02:09:43.954 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-09-13T02:09:43.954 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-09-13T02:09:43.955 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-09-13T02:09:43.955 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-09-13T02:09:43.955 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2023-09-13T02:09:43.955 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-09-13T02:09:43.955 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pluggy noarch 0.13.1-7.el9 CentOS-AppStream 38 k 2023-09-13T02:09:43.956 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-09-13T02:09:43.956 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-09-13T02:09:43.956 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-09-13T02:09:43.956 INFO:teuthology.orchestra.run.smithi119.stdout: python3-py noarch 1.10.0-6.el9 CentOS-AppStream 427 k 2023-09-13T02:09:43.957 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-09-13T02:09:43.957 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-09-13T02:09:43.957 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-09-13T02:09:43.957 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-09-13T02:09:43.958 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-09-13T02:09:43.958 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-09-13T02:09:43.958 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-09-13T02:09:43.958 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-09-13T02:09:43.958 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-09-13T02:09:43.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-09-13T02:09:43.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-09-13T02:09:43.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-09-13T02:09:43.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-09-13T02:09:43.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-09-13T02:09:43.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-09-13T02:09:43.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-09-13T02:09:43.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-09-13T02:09:43.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-09-13T02:09:43.961 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-09-13T02:09:43.961 INFO:teuthology.orchestra.run.smithi119.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-09-13T02:09:43.961 INFO:teuthology.orchestra.run.smithi119.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-09-13T02:09:43.961 INFO:teuthology.orchestra.run.smithi119.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-09-13T02:09:43.961 INFO:teuthology.orchestra.run.smithi119.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-09-13T02:09:43.961 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-09-13T02:09:43.962 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-09-13T02:09:43.962 INFO:teuthology.orchestra.run.smithi119.stdout:Installing weak dependencies: 2023-09-13T02:09:43.962 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-09-13T02:09:43.962 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:09:43.962 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-09-13T02:09:43.963 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================================ 2023-09-13T02:09:43.963 INFO:teuthology.orchestra.run.smithi119.stdout:Install 139 Packages 2023-09-13T02:09:43.963 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrade 6 Packages 2023-09-13T02:09:43.963 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:09:43.964 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 199 M 2023-09-13T02:09:43.964 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-09-13T02:09:55.300 INFO:teuthology.orchestra.run.smithi119.stdout:(1/145): ceph-18.0.0-6088.g2110e007.el9.x86_64. 23 kB/s | 6.5 kB 00:00 2023-09-13T02:09:55.516 INFO:teuthology.orchestra.run.smithi119.stdout:(2/145): ceph-fuse-18.0.0-6088.g2110e007.el9.x8 3.8 MB/s | 850 kB 00:00 2023-09-13T02:09:55.575 INFO:teuthology.orchestra.run.smithi119.stdout:(3/145): ceph-immutable-object-cache-18.0.0-608 2.4 MB/s | 141 kB 00:00 2023-09-13T02:09:55.867 INFO:teuthology.orchestra.run.smithi119.stdout:(4/145): ceph-base-18.0.0-6088.g2110e007.el9.x8 6.1 MB/s | 5.2 MB 00:00 2023-09-13T02:09:55.917 INFO:teuthology.orchestra.run.smithi119.stdout:(5/145): ceph-mds-18.0.0-6088.g2110e007.el9.x86 6.2 MB/s | 2.1 MB 00:00 2023-09-13T02:09:56.051 INFO:teuthology.orchestra.run.smithi119.stdout:(6/145): ceph-mgr-18.0.0-6088.g2110e007.el9.x86 7.9 MB/s | 1.5 MB 00:00 2023-09-13T02:09:56.576 INFO:teuthology.orchestra.run.smithi119.stdout:(7/145): ceph-mon-18.0.0-6088.g2110e007.el9.x86 6.6 MB/s | 4.4 MB 00:00 2023-09-13T02:09:57.201 INFO:teuthology.orchestra.run.smithi119.stdout:(8/145): ceph-common-18.0.0-6088.g2110e007.el9. 8.6 MB/s | 19 MB 00:02 2023-09-13T02:09:57.268 INFO:teuthology.orchestra.run.smithi119.stdout:(9/145): ceph-selinux-18.0.0-6088.g2110e007.el9 363 kB/s | 24 kB 00:00 2023-09-13T02:09:57.802 INFO:teuthology.orchestra.run.smithi119.stdout:(10/145): ceph-osd-18.0.0-6088.g2110e007.el9.x8 10 MB/s | 18 MB 00:01 2023-09-13T02:09:57.902 INFO:teuthology.orchestra.run.smithi119.stdout:(11/145): ceph-radosgw-18.0.0-6088.g2110e007.el 6.2 MB/s | 8.2 MB 00:01 2023-09-13T02:09:57.927 INFO:teuthology.orchestra.run.smithi119.stdout:(12/145): cephfs-mirror-18.0.0-6088.g2110e007.e 1.7 MB/s | 218 kB 00:00 2023-09-13T02:09:58.036 INFO:teuthology.orchestra.run.smithi119.stdout:(13/145): libcephfs-devel-18.0.0-6088.g2110e007 234 kB/s | 31 kB 00:00 2023-09-13T02:09:58.119 INFO:teuthology.orchestra.run.smithi119.stdout:(14/145): libcephfs2-18.0.0-6088.g2110e007.el9. 3.4 MB/s | 668 kB 00:00 2023-09-13T02:09:58.145 INFO:teuthology.orchestra.run.smithi119.stdout:(15/145): libcephsqlite-18.0.0-6088.g2110e007.e 1.5 MB/s | 163 kB 00:00 2023-09-13T02:09:58.170 INFO:teuthology.orchestra.run.smithi119.stdout:(16/145): librados-devel-18.0.0-6088.g2110e007. 2.5 MB/s | 126 kB 00:00 2023-09-13T02:09:58.203 INFO:teuthology.orchestra.run.smithi119.stdout:(17/145): libradosstriper1-18.0.0-6088.g2110e00 7.9 MB/s | 473 kB 00:00 2023-09-13T02:09:58.279 INFO:teuthology.orchestra.run.smithi119.stdout:(18/145): python3-ceph-argparse-18.0.0-6088.g21 602 kB/s | 45 kB 00:00 2023-09-13T02:09:58.354 INFO:teuthology.orchestra.run.smithi119.stdout:(19/145): python3-ceph-common-18.0.0-6088.g2110 1.7 MB/s | 127 kB 00:00 2023-09-13T02:09:58.446 INFO:teuthology.orchestra.run.smithi119.stdout:(20/145): python3-cephfs-18.0.0-6088.g2110e007. 1.7 MB/s | 161 kB 00:00 2023-09-13T02:09:58.538 INFO:teuthology.orchestra.run.smithi119.stdout:(21/145): python3-rados-18.0.0-6088.g2110e007.e 3.4 MB/s | 320 kB 00:00 2023-09-13T02:09:58.613 INFO:teuthology.orchestra.run.smithi119.stdout:(22/145): librgw2-18.0.0-6088.g2110e007.el9.x86 11 MB/s | 4.7 MB 00:00 2023-09-13T02:09:58.639 INFO:teuthology.orchestra.run.smithi119.stdout:(23/145): python3-rbd-18.0.0-6088.g2110e007.el9 2.9 MB/s | 297 kB 00:00 2023-09-13T02:09:58.672 INFO:teuthology.orchestra.run.smithi119.stdout:(24/145): python3-rgw-18.0.0-6088.g2110e007.el9 1.7 MB/s | 99 kB 00:00 2023-09-13T02:09:58.697 INFO:teuthology.orchestra.run.smithi119.stdout:(25/145): rbd-fuse-18.0.0-6088.g2110e007.el9.x8 1.4 MB/s | 85 kB 00:00 2023-09-13T02:09:58.798 INFO:teuthology.orchestra.run.smithi119.stdout:(26/145): rbd-nbd-18.0.0-6088.g2110e007.el9.x86 1.6 MB/s | 168 kB 00:00 2023-09-13T02:09:58.873 INFO:teuthology.orchestra.run.smithi119.stdout:(27/145): ceph-grafana-dashboards-18.0.0-6088.g 310 kB/s | 23 kB 00:00 2023-09-13T02:09:58.957 INFO:teuthology.orchestra.run.smithi119.stdout:(28/145): ceph-mgr-cephadm-18.0.0-6088.g2110e00 1.5 MB/s | 132 kB 00:00 2023-09-13T02:09:59.015 INFO:teuthology.orchestra.run.smithi119.stdout:(29/145): rbd-mirror-18.0.0-6088.g2110e007.el9. 8.8 MB/s | 3.0 MB 00:00 2023-09-13T02:09:59.241 INFO:teuthology.orchestra.run.smithi119.stdout:(30/145): ceph-mgr-dashboard-18.0.0-6088.g2110e 6.2 MB/s | 1.7 MB 00:00 2023-09-13T02:09:59.341 INFO:teuthology.orchestra.run.smithi119.stdout:(31/145): ceph-mgr-modules-core-18.0.0-6088.g21 2.4 MB/s | 242 kB 00:00 2023-09-13T02:09:59.416 INFO:teuthology.orchestra.run.smithi119.stdout:(32/145): ceph-mgr-rook-18.0.0-6088.g2110e007.e 637 kB/s | 47 kB 00:00 2023-09-13T02:09:59.492 INFO:teuthology.orchestra.run.smithi119.stdout:(33/145): ceph-prometheus-alerts-18.0.0-6088.g2 196 kB/s | 15 kB 00:00 2023-09-13T02:09:59.584 INFO:teuthology.orchestra.run.smithi119.stdout:(34/145): ceph-volume-18.0.0-6088.g2110e007.el9 2.8 MB/s | 262 kB 00:00 2023-09-13T02:09:59.726 INFO:teuthology.orchestra.run.smithi119.stdout:(35/145): ceph-mgr-diskprediction-local-18.0.0- 10 MB/s | 7.4 MB 00:00 2023-09-13T02:09:59.751 INFO:teuthology.orchestra.run.smithi119.stdout:(36/145): cephadm-18.0.0-6088.g2110e007.el9.noa 1.4 MB/s | 242 kB 00:00 2023-09-13T02:09:59.776 INFO:teuthology.orchestra.run.smithi119.stdout:(37/145): cephfs-top-18.0.0-6088.g2110e007.el9. 361 kB/s | 18 kB 00:00 2023-09-13T02:10:00.310 INFO:teuthology.orchestra.run.smithi119.stdout:(38/145): ceph-test-18.0.0-6088.g2110e007.el9.x 13 MB/s | 40 MB 00:03 2023-09-13T02:10:00.335 INFO:teuthology.orchestra.run.smithi119.stdout:(39/145): boost-program-options-1.75.0-8.el9.x8 189 kB/s | 106 kB 00:00 2023-09-13T02:10:00.394 INFO:teuthology.orchestra.run.smithi119.stdout:(40/145): bison-3.7.4-5.el9.x86_64.rpm 1.4 MB/s | 920 kB 00:00 2023-09-13T02:10:00.419 INFO:teuthology.orchestra.run.smithi119.stdout:(41/145): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 307 kB 00:00 2023-09-13T02:10:00.444 INFO:teuthology.orchestra.run.smithi119.stdout:(42/145): flexiblas-3.0.4-8.el9.x86_64.rpm 291 kB/s | 32 kB 00:00 2023-09-13T02:10:00.665 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 202 kB/s | 7.8 MB 00:39 2023-09-13T02:10:00.744 INFO:teuthology.orchestra.run.smithi119.stdout:(43/145): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.5 MB/s | 3.0 MB 00:00 2023-09-13T02:10:00.770 INFO:teuthology.orchestra.run.smithi119.stdout:(44/145): libaio-devel-0.3.111-13.el9.x86_64.rp 31 kB/s | 10 kB 00:00 2023-09-13T02:10:00.795 INFO:teuthology.orchestra.run.smithi119.stdout:(45/145): flexiblas-openblas-openmp-3.0.4-8.el9 49 kB/s | 17 kB 00:00 2023-09-13T02:10:00.820 INFO:teuthology.orchestra.run.smithi119.stdout:(46/145): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2023-09-13T02:10:00.871 INFO:teuthology.orchestra.run.smithi119.stdout:(47/145): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 661 kB 00:00 2023-09-13T02:10:00.921 INFO:teuthology.orchestra.run.smithi119.stdout:(48/145): libtool-2.4.6-45.el9.x86_64.rpm 4.5 MB/s | 578 kB 00:00 2023-09-13T02:10:00.946 INFO:teuthology.orchestra.run.smithi119.stdout:(49/145): libzstd-devel-1.5.1-2.el9.x86_64.rpm 371 kB/s | 46 kB 00:00 2023-09-13T02:10:00.971 INFO:teuthology.orchestra.run.smithi119.stdout:(50/145): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 282 kB 00:00 2023-09-13T02:10:00.997 INFO:teuthology.orchestra.run.smithi119.stdout:(51/145): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2023-09-13T02:10:01.022 INFO:teuthology.orchestra.run.smithi119.stdout:(52/145): openblas-0.3.21-2.el9.x86_64.rpm 453 kB/s | 34 kB 00:00 2023-09-13T02:10:01.489 INFO:teuthology.orchestra.run.smithi119.stdout:(53/145): postgresql-contrib-13.11-1.el9.x86_64 1.7 MB/s | 811 kB 00:00 2023-09-13T02:10:01.597 INFO:teuthology.orchestra.run.smithi119.stdout:(54/145): openblas-openmp-0.3.21-2.el9.x86_64.r 7.6 MB/s | 4.7 MB 00:00 2023-09-13T02:10:01.639 INFO:teuthology.orchestra.run.smithi119.stdout:(55/145): postgresql-13.11-1.el9.x86_64.rpm 2.4 MB/s | 1.5 MB 00:00 2023-09-13T02:10:01.664 INFO:teuthology.orchestra.run.smithi119.stdout:(56/145): postgresql-private-libs-13.11-1.el9.x 766 kB/s | 134 kB 00:00 2023-09-13T02:10:01.948 INFO:teuthology.orchestra.run.smithi119.stdout:(57/145): python3-attrs-20.3.0-7.el9.noarch.rpm 275 kB/s | 78 kB 00:00 2023-09-13T02:10:02.082 INFO:teuthology.orchestra.run.smithi119.stdout:(58/145): postgresql-server-13.11-1.el9.x86_64. 12 MB/s | 5.7 MB 00:00 2023-09-13T02:10:02.157 INFO:teuthology.orchestra.run.smithi119.stdout:(59/145): python3-devel-3.9.17-2.el9.x86_64.rpm 987 kB/s | 205 kB 00:00 2023-09-13T02:10:02.274 INFO:teuthology.orchestra.run.smithi119.stdout:(60/145): python3-babel-2.9.1-2.el9.noarch.rpm 9.5 MB/s | 5.8 MB 00:00 2023-09-13T02:10:02.316 INFO:teuthology.orchestra.run.smithi119.stdout:(61/145): python3-iniconfig-1.1.1-7.el9.noarch. 71 kB/s | 16 kB 00:00 2023-09-13T02:10:02.341 INFO:teuthology.orchestra.run.smithi119.stdout:(62/145): python3-jinja2-2.11.3-4.el9.noarch.rp 1.2 MB/s | 228 kB 00:00 2023-09-13T02:10:02.358 INFO:teuthology.orchestra.run.smithi119.stdout:(63/145): python3-jsonpatch-1.21-16.el9.noarch. 294 kB/s | 24 kB 00:00 2023-09-13T02:10:02.375 INFO:teuthology.orchestra.run.smithi119.stdout:(64/145): python3-jsonpointer-2.0-4.el9.noarch. 542 kB/s | 18 kB 00:00 2023-09-13T02:10:02.400 INFO:teuthology.orchestra.run.smithi119.stdout:(65/145): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2023-09-13T02:10:02.417 INFO:teuthology.orchestra.run.smithi119.stdout:(66/145): python3-markupsafe-1.1.1-12.el9.x86_6 538 kB/s | 32 kB 00:00 2023-09-13T02:10:02.617 INFO:teuthology.orchestra.run.smithi119.stdout:(67/145): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 4.8 MB 00:00 2023-09-13T02:10:02.643 INFO:teuthology.orchestra.run.smithi119.stdout:(68/145): python3-oauthlib-3.1.1-5.el9.noarch.r 780 kB/s | 174 kB 00:00 2023-09-13T02:10:02.657 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 18 MB/s | 18 MB 00:01 2023-09-13T02:10:02.668 INFO:teuthology.orchestra.run.smithi119.stdout:(69/145): python3-numpy-f2py-1.20.1-5.el9.x86_6 874 kB/s | 217 kB 00:00 2023-09-13T02:10:02.693 INFO:teuthology.orchestra.run.smithi119.stdout:(70/145): python3-packaging-20.9-5.el9.noarch.r 917 kB/s | 69 kB 00:00 2023-09-13T02:10:02.710 INFO:teuthology.orchestra.run.smithi119.stdout:(71/145): python3-pluggy-0.13.1-7.el9.noarch.rp 569 kB/s | 38 kB 00:00 2023-09-13T02:10:02.727 INFO:teuthology.orchestra.run.smithi119.stdout:(72/145): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2023-09-13T02:10:02.760 INFO:teuthology.orchestra.run.smithi119.stdout:(73/145): python3-py-1.10.0-6.el9.noarch.rpm 6.2 MB/s | 427 kB 00:00 2023-09-13T02:10:02.786 INFO:teuthology.orchestra.run.smithi119.stdout:(74/145): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2023-09-13T02:10:02.811 INFO:teuthology.orchestra.run.smithi119.stdout:(75/145): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2023-09-13T02:10:02.828 INFO:teuthology.orchestra.run.smithi119.stdout:(76/145): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 43 kB 00:00 2023-09-13T02:10:02.853 INFO:teuthology.orchestra.run.smithi119.stdout:(77/145): python3-pytest-6.2.2-6.el9.noarch.rpm 7.0 MB/s | 474 kB 00:00 2023-09-13T02:10:03.062 INFO:teuthology.orchestra.run.smithi119.stdout:(78/145): python3-toml-0.10.2-6.el9.noarch.rpm 166 kB/s | 39 kB 00:00 2023-09-13T02:10:03.104 INFO:teuthology.orchestra.run.smithi119.stdout:(79/145): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 300 kB 00:00 2023-09-13T02:10:03.262 INFO:teuthology.orchestra.run.smithi119.stdout:(80/145): uuid-1.6.2-55.el9.x86_64.rpm 282 kB/s | 56 kB 00:00 2023-09-13T02:10:03.446 INFO:teuthology.orchestra.run.smithi119.stdout:(81/145): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2023-09-13T02:10:03.471 INFO:teuthology.orchestra.run.smithi119.stdout:(82/145): xmlstarlet-1.6.1-20.el9.x86_64.rpm 171 kB/s | 63 kB 00:00 2023-09-13T02:10:03.496 INFO:teuthology.orchestra.run.smithi119.stdout:(83/145): fuse-2.9.9-15.el9.x86_64.rpm 339 kB/s | 79 kB 00:00 2023-09-13T02:10:03.521 INFO:teuthology.orchestra.run.smithi119.stdout:(84/145): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2023-09-13T02:10:03.547 INFO:teuthology.orchestra.run.smithi119.stdout:(85/145): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 103 kB 00:00 2023-09-13T02:10:03.572 INFO:teuthology.orchestra.run.smithi119.stdout:(86/145): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 124 kB 00:00 2023-09-13T02:10:03.597 INFO:teuthology.orchestra.run.smithi119.stdout:(87/145): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-09-13T02:10:03.623 INFO:teuthology.orchestra.run.smithi119.stdout:(88/145): python3-urllib3-1.26.5-3.el9.noarch.r 3.7 MB/s | 188 kB 00:00 2023-09-13T02:10:03.748 INFO:teuthology.orchestra.run.smithi119.stdout:(89/145): libquadmath-11.4.1-2.1.el9.x86_64.rpm 1.3 MB/s | 198 kB 00:00 2023-09-13T02:10:03.831 INFO:teuthology.orchestra.run.smithi119.stdout:(90/145): libgfortran-11.4.1-2.1.el9.x86_64.rpm 3.1 MB/s | 809 kB 00:00 2023-09-13T02:10:03.873 INFO:teuthology.orchestra.run.smithi119.stdout:(91/145): automake-1.16.2-8.el9.noarch.rpm 5.4 MB/s | 689 kB 00:00 2023-09-13T02:10:03.899 INFO:teuthology.orchestra.run.smithi119.stdout:(92/145): elfutils-libelf-devel-0.189-3.el9.x86 334 kB/s | 22 kB 00:00 2023-09-13T02:10:03.941 INFO:teuthology.orchestra.run.smithi119.stdout:(93/145): jq-1.6-15.el9.x86_64.rpm 2.7 MB/s | 187 kB 00:00 2023-09-13T02:10:03.958 INFO:teuthology.orchestra.run.smithi119.stdout:(94/145): librabbitmq-0.11.0-7.el9.x86_64.rpm 772 kB/s | 45 kB 00:00 2023-09-13T02:10:04.000 INFO:teuthology.orchestra.run.smithi119.stdout:(95/145): libuuid-devel-2.37.4-15.el9.x86_64.rp 437 kB/s | 26 kB 00:00 2023-09-13T02:10:04.058 INFO:teuthology.orchestra.run.smithi119.stdout:(96/145): python3-pytz-2021.1-5.el9.noarch.rpm 877 kB/s | 51 kB 00:00 2023-09-13T02:10:04.192 INFO:teuthology.orchestra.run.smithi119.stdout:(97/145): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 647 kB/s | 86 kB 00:00 2023-09-13T02:10:04.259 INFO:teuthology.orchestra.run.smithi119.stdout:(98/145): openssl-devel-3.0.7-24.el9.x86_64.rpm 14 MB/s | 4.1 MB 00:00 2023-09-13T02:10:04.276 INFO:teuthology.orchestra.run.smithi119.stdout:(99/145): zlib-devel-1.2.11-40.el9.x86_64.rpm 540 kB/s | 45 kB 00:00 2023-09-13T02:10:04.618 INFO:teuthology.orchestra.run.smithi119.stdout:(100/145): fmt-8.1.1-5.el9.x86_64.rpm 309 kB/s | 111 kB 00:00 2023-09-13T02:10:04.718 INFO:teuthology.orchestra.run.smithi119.stdout:(101/145): python3-cryptography-36.0.1-4.el9.x8 1.1 MB/s | 1.2 MB 00:01 2023-09-13T02:10:04.743 INFO:teuthology.orchestra.run.smithi119.stdout:(102/145): gperftools-libs-2.9.1-2.el9.x86_64.r 661 kB/s | 309 kB 00:00 2023-09-13T02:10:04.835 INFO:teuthology.orchestra.run.smithi119.stdout:(103/145): liboath-2.6.7-2.el9.x86_64.rpm 531 kB/s | 49 kB 00:00 2023-09-13T02:10:04.944 INFO:teuthology.orchestra.run.smithi119.stdout:(104/145): libunwind-1.6.2-1.el9.x86_64.rpm 621 kB/s | 67 kB 00:00 2023-09-13T02:10:05.036 INFO:teuthology.orchestra.run.smithi119.stdout:(105/145): libarrow-doc-9.0.0-9.el9.noarch.rpm 77 kB/s | 24 kB 00:00 2023-09-13T02:10:05.144 INFO:teuthology.orchestra.run.smithi119.stdout:(106/145): libarrow-9.0.0-9.el9.x86_64.rpm 8.4 MB/s | 4.4 MB 00:00 2023-09-13T02:10:05.203 INFO:teuthology.orchestra.run.smithi119.stdout:(107/145): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.2 MB/s | 837 kB 00:00 2023-09-13T02:10:05.223 INFO:teuthology.orchestra.run.smithi119.stdout:(108/145): python3-bcrypt-3.2.2-1.el9.x86_64.rp 578 kB/s | 43 kB 00:00 2023-09-13T02:10:05.278 INFO:teuthology.orchestra.run.smithi119.stdout:(109/145): python3-cachetools-4.2.4-1.el9.noarc 430 kB/s | 32 kB 00:00 2023-09-13T02:10:05.295 INFO:teuthology.orchestra.run.smithi119.stdout:(110/145): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2023-09-13T02:10:05.354 INFO:teuthology.orchestra.run.smithi119.stdout:(111/145): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2023-09-13T02:10:05.387 INFO:teuthology.orchestra.run.smithi119.stdout:(112/145): python3-asyncssh-2.13.2-3.el9.noarch 1.5 MB/s | 548 kB 00:00 2023-09-13T02:10:05.421 INFO:teuthology.orchestra.run.smithi119.stdout:(113/145): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2023-09-13T02:10:05.447 INFO:teuthology.orchestra.run.smithi119.stdout:(114/145): python3-google-auth-2.22.0-1.el9.noa 2.1 MB/s | 197 kB 00:00 2023-09-13T02:10:05.464 INFO:teuthology.orchestra.run.smithi119.stdout:(115/145): python3-jaraco-8.2.1-3.el9.noarch.rp 141 kB/s | 11 kB 00:00 2023-09-13T02:10:05.489 INFO:teuthology.orchestra.run.smithi119.stdout:(116/145): python3-jaraco-classes-3.2.1-5.el9.n 263 kB/s | 18 kB 00:00 2023-09-13T02:10:05.514 INFO:teuthology.orchestra.run.smithi119.stdout:(117/145): python3-jaraco-collections-3.0.0-8.e 345 kB/s | 23 kB 00:00 2023-09-13T02:10:05.531 INFO:teuthology.orchestra.run.smithi119.stdout:(118/145): python3-jaraco-functools-3.5.0-2.el9 289 kB/s | 19 kB 00:00 2023-09-13T02:10:05.565 INFO:teuthology.orchestra.run.smithi119.stdout:(119/145): python3-jaraco-text-3.2.0-6.el9.noar 260 kB/s | 20 kB 00:00 2023-09-13T02:10:05.615 INFO:teuthology.orchestra.run.smithi119.stdout:(120/145): python3-jwt+crypto-2.4.0-1.el9.noarc 90 kB/s | 9.0 kB 00:00 2023-09-13T02:10:05.640 INFO:teuthology.orchestra.run.smithi119.stdout:(121/145): python3-jwt-2.4.0-1.el9.noarch.rpm 376 kB/s | 41 kB 00:00 2023-09-13T02:10:05.699 INFO:teuthology.orchestra.run.smithi119.stdout:(122/145): python3-logutils-0.3.5-21.el9.noarch 554 kB/s | 46 kB 00:00 2023-09-13T02:10:05.724 INFO:teuthology.orchestra.run.smithi119.stdout:(123/145): python3-more-itertools-8.12.0-2.el9. 942 kB/s | 79 kB 00:00 2023-09-13T02:10:05.758 INFO:teuthology.orchestra.run.smithi119.stdout:(124/145): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2023-09-13T02:10:05.783 INFO:teuthology.orchestra.run.smithi119.stdout:(125/145): python3-natsort-7.1.1-5.el9.noarch.r 688 kB/s | 58 kB 00:00 2023-09-13T02:10:05.825 INFO:teuthology.orchestra.run.smithi119.stdout:(126/145): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2023-09-13T02:10:05.850 INFO:teuthology.orchestra.run.smithi119.stdout:(127/145): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2023-09-13T02:10:05.876 INFO:teuthology.orchestra.run.smithi119.stdout:(128/145): python3-pyOpenSSL-21.0.0-1.el9.noarc 975 kB/s | 90 kB 00:00 2023-09-13T02:10:05.917 INFO:teuthology.orchestra.run.smithi119.stdout:(129/145): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2023-09-13T02:10:05.943 INFO:teuthology.orchestra.run.smithi119.stdout:(130/145): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2023-09-13T02:10:05.968 INFO:teuthology.orchestra.run.smithi119.stdout:(131/145): python3-rsa-4.9-2.el9.noarch.rpm 640 kB/s | 59 kB 00:00 2023-09-13T02:10:06.010 INFO:teuthology.orchestra.run.smithi119.stdout:(132/145): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2023-09-13T02:10:06.035 INFO:teuthology.orchestra.run.smithi119.stdout:(133/145): python3-typing-extensions-4.4.0-2.el 554 kB/s | 51 kB 00:00 2023-09-13T02:10:06.061 INFO:teuthology.orchestra.run.smithi119.stdout:(134/145): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2023-09-13T02:10:06.111 INFO:teuthology.orchestra.run.smithi119.stdout:(135/145): python3-websocket-client-1.2.3-2.el9 892 kB/s | 90 kB 00:00 2023-09-13T02:10:06.136 INFO:teuthology.orchestra.run.smithi119.stdout:(136/145): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2023-09-13T02:10:06.161 INFO:teuthology.orchestra.run.smithi119.stdout:(137/145): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2023-09-13T02:10:06.220 INFO:teuthology.orchestra.run.smithi119.stdout:(138/145): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2023-09-13T02:10:06.304 INFO:teuthology.orchestra.run.smithi119.stdout:(139/145): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2023-09-13T02:10:06.347 INFO:teuthology.orchestra.run.smithi119.stdout:[MIRROR] NetworkManager-1.45.2-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-1.45.2-1.el9.x86_64.rpm (IP: 163.237.219.7) 2023-09-13T02:10:06.546 INFO:teuthology.orchestra.run.smithi119.stdout:(140/145): librbd1-18.0.0-6088.g2110e007.el9.x8 9.3 MB/s | 3.0 MB 00:00 2023-09-13T02:10:06.546 INFO:teuthology.orchestra.run.smithi119.stdout:[MIRROR] NetworkManager-1.45.2-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-1.45.2-1.el9.x86_64.rpm (IP: 163.237.219.7) 2023-09-13T02:10:06.604 INFO:teuthology.orchestra.run.smithi119.stdout:(141/145): librados2-18.0.0-6088.g2110e007.el9. 7.4 MB/s | 3.3 MB 00:00 2023-09-13T02:10:06.605 INFO:teuthology.orchestra.run.smithi119.stdout:[MIRROR] NetworkManager-libnm-1.45.2-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-libnm-1.45.2-1.el9.x86_64.rpm (IP: 163.237.219.7) 2023-09-13T02:10:06.651 INFO:teuthology.orchestra.run.smithi119.stdout:[MIRROR] NetworkManager-team-1.45.2-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-team-1.45.2-1.el9.x86_64.rpm (IP: 163.237.219.7) 2023-09-13T02:10:06.651 INFO:teuthology.orchestra.run.smithi119.stdout:[MIRROR] NetworkManager-libnm-1.45.2-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-libnm-1.45.2-1.el9.x86_64.rpm (IP: 163.237.219.7) 2023-09-13T02:10:06.697 INFO:teuthology.orchestra.run.smithi119.stdout:[MIRROR] NetworkManager-team-1.45.2-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-team-1.45.2-1.el9.x86_64.rpm (IP: 163.237.219.7) 2023-09-13T02:10:06.871 INFO:teuthology.orchestra.run.smithi119.stdout:(142/145): NetworkManager-team-1.45.2-1.el9.x86 158 kB/s | 42 kB 00:00 2023-09-13T02:10:06.926 INFO:teuthology.orchestra.run.smithi119.stdout:[MIRROR] NetworkManager-tui-1.45.2-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-tui-1.45.2-1.el9.x86_64.rpm (IP: 163.237.219.7) 2023-09-13T02:10:07.038 INFO:teuthology.orchestra.run.smithi119.stdout:(143/145): NetworkManager-1.45.2-1.el9.x86_64.r 3.1 MB/s | 2.2 MB 00:00 2023-09-13T02:10:07.039 INFO:teuthology.orchestra.run.smithi119.stdout:[MIRROR] NetworkManager-tui-1.45.2-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-tui-1.45.2-1.el9.x86_64.rpm (IP: 163.237.219.7) 2023-09-13T02:10:07.097 INFO:teuthology.orchestra.run.smithi119.stdout:(144/145): NetworkManager-tui-1.45.2-1.el9.x86_ 1.1 MB/s | 247 kB 00:00 2023-09-13T02:10:07.188 INFO:teuthology.orchestra.run.smithi119.stdout:(145/145): NetworkManager-libnm-1.45.2-1.el9.x8 2.8 MB/s | 1.8 MB 00:00 2023-09-13T02:10:07.194 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-09-13T02:10:07.195 INFO:teuthology.orchestra.run.smithi119.stdout:Total 8.6 MB/s | 199 MB 00:23 2023-09-13T02:10:07.446 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-09-13T02:10:07.571 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-09-13T02:10:07.571 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-09-13T02:10:07.877 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 5.7 MB 00:01 2023-09-13T02:10:09.409 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-09-13T02:10:09.410 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-09-13T02:10:09.800 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 14 kB 00:00 2023-09-13T02:10:11.273 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 13 MB/s | 19 MB 00:01 2023-09-13T02:10:14.934 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-09-13T02:10:15.007 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/151 2023-09-13T02:10:15.075 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/151 2023-09-13T02:10:15.235 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/151 2023-09-13T02:10:15.293 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/151 2023-09-13T02:10:15.493 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2023-09-13T02:10:15.667 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/151 2023-09-13T02:10:15.709 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librados2-2:18.0.0-6088.g2110e007.el9.x86_64 6/151 2023-09-13T02:10:15.825 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:18.0.0-6088.g2110e007.el9.x86_64 6/151 2023-09-13T02:10:15.852 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs2-2:18.0.0-6088.g2110e007.el9.x86_64 7/151 2023-09-13T02:10:15.926 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs2-2:18.0.0-6088.g2110e007.el9.x86_64 7/151 2023-09-13T02:10:15.977 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rados-2:18.0.0-6088.g2110e007.el9.x86_64 8/151 2023-09-13T02:10:16.049 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/151 2023-09-13T02:10:16.103 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 10/151 2023-09-13T02:10:16.143 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 11/151 2023-09-13T02:10:16.322 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/151 2023-09-13T02:10:16.391 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/151 2023-09-13T02:10:16.425 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephsqlite-2:18.0.0-6088.g2110e007.el9.x86_64 14/151 2023-09-13T02:10:16.523 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6088.g2110e007.el9.x86_64 14/151 2023-09-13T02:10:16.560 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libradosstriper1-2:18.0.0-6088.g2110e007.el9.x86 15/151 2023-09-13T02:10:16.790 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6088.g2110e007.el9.x86 15/151 2023-09-13T02:10:16.922 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-libnm-1:1.45.2-1.el9.x86_64 16/151 2023-09-13T02:10:16.965 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.2-1.el9.x86_64 16/151 2023-09-13T02:10:17.062 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.45.2-1.el9.x86_64 17/151 2023-09-13T02:10:17.109 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-1:1.45.2-1.el9.x86_64 17/151 2023-09-13T02:10:17.382 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.45.2-1.el9.x86_64 17/151 2023-09-13T02:10:17.456 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/151 2023-09-13T02:10:17.457 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/151 2023-09-13T02:10:17.474 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/151 2023-09-13T02:10:17.517 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libquadmath-11.4.1-2.1.el9.x86_64 21/151 2023-09-13T02:10:17.554 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libgfortran-11.4.1-2.1.el9.x86_64 22/151 2023-09-13T02:10:17.584 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 23/151 2023-09-13T02:10:17.649 INFO:teuthology.orchestra.run.smithi104.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-09-13T02:10:17.650 INFO:teuthology.orchestra.run.smithi104.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-09-13T02:10:17.654 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 24/151 2023-09-13T02:10:17.660 INFO:teuthology.orchestra.run.smithi104.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-09-13T02:10:17.661 INFO:teuthology.orchestra.run.smithi104.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-09-13T02:10:17.662 INFO:teuthology.orchestra.run.smithi104.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-09-13T02:10:17.662 INFO:teuthology.orchestra.run.smithi104.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-09-13T02:10:17.664 INFO:teuthology.orchestra.run.smithi104.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-09-13T02:10:17.666 INFO:teuthology.orchestra.run.smithi104.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-09-13T02:10:17.668 INFO:teuthology.orchestra.run.smithi104.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-09-13T02:10:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/151 2023-09-13T02:10:17.730 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/151 2023-09-13T02:10:17.734 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2023-09-13T02:10:17.747 INFO:teuthology.orchestra.run.smithi104.stdout:============================================================================================ 2023-09-13T02:10:17.747 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2023-09-13T02:10:17.747 INFO:teuthology.orchestra.run.smithi104.stdout:============================================================================================ 2023-09-13T02:10:17.748 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2023-09-13T02:10:17.748 INFO:teuthology.orchestra.run.smithi104.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-09-13T02:10:17.748 INFO:teuthology.orchestra.run.smithi104.stdout: ceph x86_64 2:18.0.0-6088.g2110e007.el9 ceph 6.5 k 2023-09-13T02:10:17.748 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base x86_64 2:18.0.0-6088.g2110e007.el9 ceph 5.2 M 2023-09-13T02:10:17.749 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse x86_64 2:18.0.0-6088.g2110e007.el9 ceph 850 k 2023-09-13T02:10:17.749 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6088.g2110e007.el9 ceph 141 k 2023-09-13T02:10:17.749 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr x86_64 2:18.0.0-6088.g2110e007.el9 ceph 1.5 M 2023-09-13T02:10:17.749 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 132 k 2023-09-13T02:10:17.749 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 1.7 M 2023-09-13T02:10:17.750 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 7.4 M 2023-09-13T02:10:17.750 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 47 k 2023-09-13T02:10:17.750 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw x86_64 2:18.0.0-6088.g2110e007.el9 ceph 8.2 M 2023-09-13T02:10:17.751 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test x86_64 2:18.0.0-6088.g2110e007.el9 ceph 40 M 2023-09-13T02:10:17.751 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 262 k 2023-09-13T02:10:17.751 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 242 k 2023-09-13T02:10:17.751 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-mirror x86_64 2:18.0.0-6088.g2110e007.el9 ceph 218 k 2023-09-13T02:10:17.751 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-top noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 18 k 2023-09-13T02:10:17.752 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-09-13T02:10:17.752 INFO:teuthology.orchestra.run.smithi104.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-09-13T02:10:17.752 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-09-13T02:10:17.752 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel x86_64 2:18.0.0-6088.g2110e007.el9 ceph 31 k 2023-09-13T02:10:17.752 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2 x86_64 2:18.0.0-6088.g2110e007.el9 ceph 668 k 2023-09-13T02:10:17.753 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel x86_64 2:18.0.0-6088.g2110e007.el9 ceph 126 k 2023-09-13T02:10:17.753 INFO:teuthology.orchestra.run.smithi104.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-09-13T02:10:17.753 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-09-13T02:10:17.753 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-09-13T02:10:17.753 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-09-13T02:10:17.754 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-09-13T02:10:17.754 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-09-13T02:10:17.754 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs x86_64 2:18.0.0-6088.g2110e007.el9 ceph 161 k 2023-09-13T02:10:17.754 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytest noarch 6.2.2-6.el9 CentOS-AppStream 474 k 2023-09-13T02:10:17.754 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados x86_64 2:18.0.0-6088.g2110e007.el9 ceph 320 k 2023-09-13T02:10:17.755 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd x86_64 2:18.0.0-6088.g2110e007.el9 ceph 297 k 2023-09-13T02:10:17.755 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw x86_64 2:18.0.0-6088.g2110e007.el9 ceph 99 k 2023-09-13T02:10:17.755 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse x86_64 2:18.0.0-6088.g2110e007.el9 ceph 85 k 2023-09-13T02:10:17.755 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror x86_64 2:18.0.0-6088.g2110e007.el9 ceph 3.0 M 2023-09-13T02:10:17.755 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd x86_64 2:18.0.0-6088.g2110e007.el9 ceph 168 k 2023-09-13T02:10:17.756 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-09-13T02:10:17.756 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrading: 2023-09-13T02:10:17.756 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager x86_64 1:1.45.2-1.el9 baseos 2.2 M 2023-09-13T02:10:17.756 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-libnm x86_64 1:1.45.2-1.el9 baseos 1.8 M 2023-09-13T02:10:17.756 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-team x86_64 1:1.45.2-1.el9 baseos 42 k 2023-09-13T02:10:17.757 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-tui x86_64 1:1.45.2-1.el9 baseos 247 k 2023-09-13T02:10:17.757 INFO:teuthology.orchestra.run.smithi104.stdout: librados2 x86_64 2:18.0.0-6088.g2110e007.el9 ceph 3.3 M 2023-09-13T02:10:17.757 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1 x86_64 2:18.0.0-6088.g2110e007.el9 ceph 3.0 M 2023-09-13T02:10:17.758 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2023-09-13T02:10:17.758 INFO:teuthology.orchestra.run.smithi104.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-09-13T02:10:17.758 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-09-13T02:10:17.758 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common x86_64 2:18.0.0-6088.g2110e007.el9 ceph 19 M 2023-09-13T02:10:17.758 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 23 k 2023-09-13T02:10:17.759 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds x86_64 2:18.0.0-6088.g2110e007.el9 ceph 2.1 M 2023-09-13T02:10:17.759 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 242 k 2023-09-13T02:10:17.759 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon x86_64 2:18.0.0-6088.g2110e007.el9 ceph 4.4 M 2023-09-13T02:10:17.759 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd x86_64 2:18.0.0-6088.g2110e007.el9 ceph 18 M 2023-09-13T02:10:17.760 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6088.g2110e007.el9 ceph-noarch 15 k 2023-09-13T02:10:17.760 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux x86_64 2:18.0.0-6088.g2110e007.el9 ceph 24 k 2023-09-13T02:10:17.760 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-09-13T02:10:17.760 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-09-13T02:10:17.761 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-09-13T02:10:17.761 INFO:teuthology.orchestra.run.smithi104.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-09-13T02:10:17.761 INFO:teuthology.orchestra.run.smithi104.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-09-13T02:10:17.761 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-09-13T02:10:17.762 INFO:teuthology.orchestra.run.smithi104.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-09-13T02:10:17.762 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-09-13T02:10:17.762 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-09-13T02:10:17.762 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite x86_64 2:18.0.0-6088.g2110e007.el9 ceph 163 k 2023-09-13T02:10:17.762 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran x86_64 11.4.1-2.1.el9 baseos 809 k 2023-09-13T02:10:17.763 INFO:teuthology.orchestra.run.smithi104.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-09-13T02:10:17.763 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-09-13T02:10:17.763 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath x86_64 11.4.1-2.1.el9 baseos 198 k 2023-09-13T02:10:17.763 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-09-13T02:10:17.764 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1 x86_64 2:18.0.0-6088.g2110e007.el9 ceph 473 k 2023-09-13T02:10:17.764 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-09-13T02:10:17.764 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2 x86_64 2:18.0.0-6088.g2110e007.el9 ceph 4.7 M 2023-09-13T02:10:17.764 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-09-13T02:10:17.764 INFO:teuthology.orchestra.run.smithi104.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-09-13T02:10:17.765 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-09-13T02:10:17.765 INFO:teuthology.orchestra.run.smithi104.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-09-13T02:10:17.765 INFO:teuthology.orchestra.run.smithi104.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-09-13T02:10:17.765 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-09-13T02:10:17.765 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-09-13T02:10:17.766 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-09-13T02:10:17.766 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-09-13T02:10:17.766 INFO:teuthology.orchestra.run.smithi104.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-09-13T02:10:17.766 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-09-13T02:10:17.767 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-09-13T02:10:17.767 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-09-13T02:10:17.767 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse x86_64 2:18.0.0-6088.g2110e007.el9 ceph 45 k 2023-09-13T02:10:17.767 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common x86_64 2:18.0.0-6088.g2110e007.el9 ceph 127 k 2023-09-13T02:10:17.767 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-09-13T02:10:17.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-09-13T02:10:17.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-09-13T02:10:17.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-09-13T02:10:17.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-09-13T02:10:17.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-09-13T02:10:17.769 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth noarch 1:2.22.0-1.el9 epel 197 k 2023-09-13T02:10:17.769 INFO:teuthology.orchestra.run.smithi104.stdout: python3-iniconfig noarch 1.1.1-7.el9 CentOS-AppStream 16 k 2023-09-13T02:10:17.769 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-09-13T02:10:17.769 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-09-13T02:10:17.769 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-09-13T02:10:17.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-09-13T02:10:17.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-09-13T02:10:17.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-09-13T02:10:17.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-09-13T02:10:17.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-09-13T02:10:17.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-09-13T02:10:17.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-09-13T02:10:17.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-09-13T02:10:17.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-09-13T02:10:17.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-09-13T02:10:17.772 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-09-13T02:10:17.772 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-09-13T02:10:17.772 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-09-13T02:10:17.772 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-09-13T02:10:17.772 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-09-13T02:10:17.773 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2023-09-13T02:10:17.773 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-09-13T02:10:17.773 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pluggy noarch 0.13.1-7.el9 CentOS-AppStream 38 k 2023-09-13T02:10:17.773 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-09-13T02:10:17.773 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-09-13T02:10:17.774 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-09-13T02:10:17.774 INFO:teuthology.orchestra.run.smithi104.stdout: python3-py noarch 1.10.0-6.el9 CentOS-AppStream 427 k 2023-09-13T02:10:17.774 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-09-13T02:10:17.774 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-09-13T02:10:17.774 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-09-13T02:10:17.775 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-09-13T02:10:17.775 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-09-13T02:10:17.775 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-09-13T02:10:17.775 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-09-13T02:10:17.775 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-09-13T02:10:17.776 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-09-13T02:10:17.776 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-09-13T02:10:17.776 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-09-13T02:10:17.776 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-09-13T02:10:17.776 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-09-13T02:10:17.777 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-09-13T02:10:17.777 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-09-13T02:10:17.777 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-09-13T02:10:17.777 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-09-13T02:10:17.777 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-09-13T02:10:17.778 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-09-13T02:10:17.778 INFO:teuthology.orchestra.run.smithi104.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-09-13T02:10:17.778 INFO:teuthology.orchestra.run.smithi104.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-09-13T02:10:17.778 INFO:teuthology.orchestra.run.smithi104.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-09-13T02:10:17.778 INFO:teuthology.orchestra.run.smithi104.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-09-13T02:10:17.779 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-09-13T02:10:17.779 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-09-13T02:10:17.779 INFO:teuthology.orchestra.run.smithi104.stdout:Installing weak dependencies: 2023-09-13T02:10:17.779 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-09-13T02:10:17.779 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:10:17.780 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2023-09-13T02:10:17.780 INFO:teuthology.orchestra.run.smithi104.stdout:============================================================================================ 2023-09-13T02:10:17.780 INFO:teuthology.orchestra.run.smithi104.stdout:Install 139 Packages 2023-09-13T02:10:17.780 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrade 6 Packages 2023-09-13T02:10:17.780 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:10:17.781 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 199 M 2023-09-13T02:10:17.781 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2023-09-13T02:10:17.798 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/151 2023-09-13T02:10:17.834 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-common-2:18.0.0-6088.g2110e007.el9. 28/151 2023-09-13T02:10:17.878 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-argparse-2:18.0.0-6088.g2110e007.el 29/151 2023-09-13T02:10:17.953 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cephfs-2:18.0.0-6088.g2110e007.el9.x86_6 30/151 2023-09-13T02:10:18.086 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/151 2023-09-13T02:10:18.139 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/151 2023-09-13T02:10:18.171 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/151 2023-09-13T02:10:18.212 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 34/151 2023-09-13T02:10:18.246 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 35/151 2023-09-13T02:10:18.694 INFO:teuthology.orchestra.run.smithi104.stdout:(1/145): ceph-18.0.0-6088.g2110e007.el9.x86_64. 38 kB/s | 6.5 kB 00:00 2023-09-13T02:10:18.784 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 36/151 2023-09-13T02:10:18.861 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 37/151 2023-09-13T02:10:18.900 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 38/151 2023-09-13T02:10:18.910 INFO:teuthology.orchestra.run.smithi104.stdout:(2/145): ceph-fuse-18.0.0-6088.g2110e007.el9.x8 3.8 MB/s | 850 kB 00:00 2023-09-13T02:10:18.937 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librados-devel-2:18.0.0-6088.g2110e007.el9.x86_6 39/151 2023-09-13T02:10:18.967 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/151 2023-09-13T02:10:18.977 INFO:teuthology.orchestra.run.smithi104.stdout:(3/145): ceph-immutable-object-cache-18.0.0-608 2.1 MB/s | 141 kB 00:00 2023-09-13T02:10:19.001 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 41/151 2023-09-13T02:10:19.108 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/151 2023-09-13T02:10:19.147 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 43/151 2023-09-13T02:10:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/151 2023-09-13T02:10:19.275 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/151 2023-09-13T02:10:19.306 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/151 2023-09-13T02:10:19.342 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/151 2023-09-13T02:10:19.369 INFO:teuthology.orchestra.run.smithi104.stdout:(4/145): ceph-mds-18.0.0-6088.g2110e007.el9.x86 5.4 MB/s | 2.1 MB 00:00 2023-09-13T02:10:19.389 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/151 2023-09-13T02:10:19.434 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/151 2023-09-13T02:10:19.477 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/151 2023-09-13T02:10:19.620 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/151 2023-09-13T02:10:19.661 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/151 2023-09-13T02:10:19.669 INFO:teuthology.orchestra.run.smithi104.stdout:(5/145): ceph-mgr-18.0.0-6088.g2110e007.el9.x86 4.9 MB/s | 1.5 MB 00:00 2023-09-13T02:10:19.703 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/151 2023-09-13T02:10:19.805 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/151 2023-09-13T02:10:19.846 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-google-auth-1:2.22.0-1.el9.noarch 55/151 2023-09-13T02:10:19.861 INFO:teuthology.orchestra.run.smithi104.stdout:(6/145): ceph-common-18.0.0-6088.g2110e007.el9. 14 MB/s | 19 MB 00:01 2023-09-13T02:10:19.886 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/151 2023-09-13T02:10:19.919 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/151 2023-09-13T02:10:19.945 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 58/151 2023-09-13T02:10:19.971 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fmt-8.1.1-5.el9.x86_64 59/151 2023-09-13T02:10:19.999 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 60/151 2023-09-13T02:10:20.078 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 61/151 2023-09-13T02:10:20.123 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : automake-1.16.2-8.el9.noarch 62/151 2023-09-13T02:10:20.136 INFO:teuthology.orchestra.run.smithi104.stdout:(7/145): ceph-base-18.0.0-6088.g2110e007.el9.x8 3.2 MB/s | 5.2 MB 00:01 2023-09-13T02:10:20.180 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/151 2023-09-13T02:10:20.236 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/151 2023-09-13T02:10:20.362 INFO:teuthology.orchestra.run.smithi104.stdout:(8/145): ceph-mon-18.0.0-6088.g2110e007.el9.x86 6.3 MB/s | 4.4 MB 00:00 2023-09-13T02:10:20.434 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/151 2023-09-13T02:10:20.437 INFO:teuthology.orchestra.run.smithi104.stdout:(9/145): ceph-selinux-18.0.0-6088.g2110e007.el9 321 kB/s | 24 kB 00:00 2023-09-13T02:10:20.486 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/151 2023-09-13T02:10:20.565 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/151 2023-09-13T02:10:20.653 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 68/151 2023-09-13T02:10:20.794 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 69/151 2023-09-13T02:10:20.840 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 70/151 2023-09-13T02:10:20.878 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 71/151 2023-09-13T02:10:20.912 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 72/151 2023-09-13T02:10:20.944 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 73/151 2023-09-13T02:10:20.977 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fuse-2.9.9-15.el9.x86_64 74/151 2023-09-13T02:10:21.012 INFO:teuthology.orchestra.run.smithi104.stdout:(10/145): ceph-osd-18.0.0-6088.g2110e007.el9.x8 15 MB/s | 18 MB 00:01 2023-09-13T02:10:21.031 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 75/151 2023-09-13T02:10:21.071 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : uuid-1.6.2-55.el9.x86_64 76/151 2023-09-13T02:10:21.087 INFO:teuthology.orchestra.run.smithi104.stdout:(11/145): cephfs-mirror-18.0.0-6088.g2110e007.e 2.9 MB/s | 218 kB 00:00 2023-09-13T02:10:21.130 INFO:teuthology.orchestra.run.smithi104.stdout:(12/145): libcephfs-devel-18.0.0-6088.g2110e007 745 kB/s | 31 kB 00:00 2023-09-13T02:10:21.204 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 77/151 2023-09-13T02:10:21.222 INFO:teuthology.orchestra.run.smithi104.stdout:(13/145): ceph-radosgw-18.0.0-6088.g2110e007.el 7.6 MB/s | 8.2 MB 00:01 2023-09-13T02:10:21.238 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-py-1.10.0-6.el9.noarch 78/151 2023-09-13T02:10:21.264 INFO:teuthology.orchestra.run.smithi104.stdout:(14/145): libcephfs2-18.0.0-6088.g2110e007.el9. 4.9 MB/s | 668 kB 00:00 2023-09-13T02:10:21.295 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/151 2023-09-13T02:10:21.314 INFO:teuthology.orchestra.run.smithi104.stdout:(15/145): libcephsqlite-18.0.0-6088.g2110e007.e 1.7 MB/s | 163 kB 00:00 2023-09-13T02:10:21.339 INFO:teuthology.orchestra.run.smithi104.stdout:(16/145): librados-devel-18.0.0-6088.g2110e007. 1.6 MB/s | 126 kB 00:00 2023-09-13T02:10:21.344 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pluggy-0.13.1-7.el9.noarch 80/151 2023-09-13T02:10:21.414 INFO:teuthology.orchestra.run.smithi104.stdout:(17/145): libradosstriper1-18.0.0-6088.g2110e00 4.6 MB/s | 473 kB 00:00 2023-09-13T02:10:21.444 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-packaging-20.9-5.el9.noarch 81/151 2023-09-13T02:10:21.499 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/151 2023-09-13T02:10:21.523 INFO:teuthology.orchestra.run.smithi104.stdout:(18/145): python3-ceph-argparse-18.0.0-6088.g21 417 kB/s | 45 kB 00:00 2023-09-13T02:10:21.665 INFO:teuthology.orchestra.run.smithi104.stdout:(19/145): librgw2-18.0.0-6088.g2110e007.el9.x86 14 MB/s | 4.7 MB 00:00 2023-09-13T02:10:21.690 INFO:teuthology.orchestra.run.smithi104.stdout:(20/145): python3-ceph-common-18.0.0-6088.g2110 760 kB/s | 127 kB 00:00 2023-09-13T02:10:21.715 INFO:teuthology.orchestra.run.smithi104.stdout:(21/145): python3-cephfs-18.0.0-6088.g2110e007. 3.2 MB/s | 161 kB 00:00 2023-09-13T02:10:21.766 INFO:teuthology.orchestra.run.smithi104.stdout:(22/145): python3-rados-18.0.0-6088.g2110e007.e 4.1 MB/s | 320 kB 00:00 2023-09-13T02:10:21.791 INFO:teuthology.orchestra.run.smithi104.stdout:(23/145): python3-rbd-18.0.0-6088.g2110e007.el9 3.9 MB/s | 297 kB 00:00 2023-09-13T02:10:21.833 INFO:teuthology.orchestra.run.smithi104.stdout:(24/145): python3-rgw-18.0.0-6088.g2110e007.el9 1.4 MB/s | 99 kB 00:00 2023-09-13T02:10:21.858 INFO:teuthology.orchestra.run.smithi104.stdout:(25/145): rbd-fuse-18.0.0-6088.g2110e007.el9.x8 1.2 MB/s | 85 kB 00:00 2023-09-13T02:10:21.933 INFO:teuthology.orchestra.run.smithi104.stdout:(26/145): rbd-nbd-18.0.0-6088.g2110e007.el9.x86 2.2 MB/s | 168 kB 00:00 2023-09-13T02:10:21.984 INFO:teuthology.orchestra.run.smithi104.stdout:(27/145): ceph-grafana-dashboards-18.0.0-6088.g 464 kB/s | 23 kB 00:00 2023-09-13T02:10:22.051 INFO:teuthology.orchestra.run.smithi104.stdout:(28/145): ceph-mgr-cephadm-18.0.0-6088.g2110e00 1.9 MB/s | 132 kB 00:00 2023-09-13T02:10:22.118 INFO:teuthology.orchestra.run.smithi104.stdout:(29/145): rbd-mirror-18.0.0-6088.g2110e007.el9. 11 MB/s | 3.0 MB 00:00 2023-09-13T02:10:22.176 INFO:teuthology.orchestra.run.smithi104.stdout:(30/145): ceph-mgr-dashboard-18.0.0-6088.g2110e 14 MB/s | 1.7 MB 00:00 2023-09-13T02:10:22.235 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/151 2023-09-13T02:10:22.243 INFO:teuthology.orchestra.run.smithi104.stdout:(31/145): ceph-mgr-modules-core-18.0.0-6088.g21 3.6 MB/s | 242 kB 00:00 2023-09-13T02:10:22.287 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/151 2023-09-13T02:10:22.310 INFO:teuthology.orchestra.run.smithi104.stdout:(32/145): ceph-mgr-rook-18.0.0-6088.g2110e007.e 714 kB/s | 47 kB 00:00 2023-09-13T02:10:22.321 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/151 2023-09-13T02:10:22.355 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/151 2023-09-13T02:10:22.385 INFO:teuthology.orchestra.run.smithi104.stdout:(33/145): ceph-prometheus-alerts-18.0.0-6088.g2 195 kB/s | 15 kB 00:00 2023-09-13T02:10:22.454 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-iniconfig-1.1.1-7.el9.noarch 87/151 2023-09-13T02:10:22.477 INFO:teuthology.orchestra.run.smithi104.stdout:(34/145): ceph-volume-18.0.0-6088.g2110e007.el9 2.8 MB/s | 262 kB 00:00 2023-09-13T02:10:22.513 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 88/151 2023-09-13T02:10:22.548 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/151 2023-09-13T02:10:22.561 INFO:teuthology.orchestra.run.smithi104.stdout:(35/145): cephadm-18.0.0-6088.g2110e007.el9.noa 2.8 MB/s | 242 kB 00:00 2023-09-13T02:10:22.669 INFO:teuthology.orchestra.run.smithi104.stdout:(36/145): ceph-mgr-diskprediction-local-18.0.0- 13 MB/s | 7.4 MB 00:00 2023-09-13T02:10:22.695 INFO:teuthology.orchestra.run.smithi104.stdout:(37/145): cephfs-top-18.0.0-6088.g2110e007.el9. 135 kB/s | 18 kB 00:00 2023-09-13T02:10:22.723 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-0.3.21-2.el9.x86_64 90/151 2023-09-13T02:10:22.746 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 91/151 2023-09-13T02:10:22.820 INFO:teuthology.orchestra.run.smithi104.stdout:(38/145): boost-program-options-1.75.0-8.el9.x8 848 kB/s | 106 kB 00:00 2023-09-13T02:10:22.823 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 92/151 2023-09-13T02:10:22.870 INFO:teuthology.orchestra.run.smithi104.stdout:(39/145): bison-3.7.4-5.el9.x86_64.rpm 4.5 MB/s | 920 kB 00:00 2023-09-13T02:10:22.904 INFO:teuthology.orchestra.run.smithi104.stdout:(40/145): flex-2.6.4-9.el9.x86_64.rpm 3.6 MB/s | 307 kB 00:00 2023-09-13T02:10:22.929 INFO:teuthology.orchestra.run.smithi104.stdout:(41/145): flexiblas-3.0.4-8.el9.x86_64.rpm 544 kB/s | 32 kB 00:00 2023-09-13T02:10:23.030 INFO:teuthology.orchestra.run.smithi104.stdout:(42/145): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2023-09-13T02:10:23.046 INFO:teuthology.orchestra.run.smithi104.stdout:(43/145): flexiblas-openblas-openmp-3.0.4-8.el9 148 kB/s | 17 kB 00:00 2023-09-13T02:10:23.064 INFO:teuthology.orchestra.run.smithi104.stdout:(44/145): libaio-devel-0.3.111-13.el9.x86_64.rp 301 kB/s | 10 kB 00:00 2023-09-13T02:10:23.089 INFO:teuthology.orchestra.run.smithi104.stdout:(45/145): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2023-09-13T02:10:23.114 INFO:teuthology.orchestra.run.smithi104.stdout:(46/145): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-09-13T02:10:23.148 INFO:teuthology.orchestra.run.smithi104.stdout:(47/145): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2023-09-13T02:10:23.173 INFO:teuthology.orchestra.run.smithi104.stdout:(48/145): libzstd-devel-1.5.1-2.el9.x86_64.rpm 805 kB/s | 46 kB 00:00 2023-09-13T02:10:23.198 INFO:teuthology.orchestra.run.smithi104.stdout:(49/145): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-09-13T02:10:23.223 INFO:teuthology.orchestra.run.smithi104.stdout:(50/145): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2023-09-13T02:10:23.249 INFO:teuthology.orchestra.run.smithi104.stdout:(51/145): openblas-0.3.21-2.el9.x86_64.rpm 684 kB/s | 34 kB 00:00 2023-09-13T02:10:23.366 INFO:teuthology.orchestra.run.smithi104.stdout:(52/145): openblas-openmp-0.3.21-2.el9.x86_64.r 33 MB/s | 4.7 MB 00:00 2023-09-13T02:10:23.408 INFO:teuthology.orchestra.run.smithi104.stdout:(53/145): postgresql-13.11-1.el9.x86_64.rpm 9.7 MB/s | 1.5 MB 00:00 2023-09-13T02:10:23.433 INFO:teuthology.orchestra.run.smithi104.stdout:(54/145): postgresql-contrib-13.11-1.el9.x86_64 12 MB/s | 811 kB 00:00 2023-09-13T02:10:23.458 INFO:teuthology.orchestra.run.smithi104.stdout:(55/145): postgresql-private-libs-13.11-1.el9.x 2.7 MB/s | 134 kB 00:00 2023-09-13T02:10:23.474 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 93/151 2023-09-13T02:10:23.585 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 94/151 2023-09-13T02:10:23.592 INFO:teuthology.orchestra.run.smithi104.stdout:(56/145): postgresql-server-13.11-1.el9.x86_64. 36 MB/s | 5.7 MB 00:00 2023-09-13T02:10:23.617 INFO:teuthology.orchestra.run.smithi104.stdout:(57/145): python3-attrs-20.3.0-7.el9.noarch.rpm 496 kB/s | 78 kB 00:00 2023-09-13T02:10:23.759 INFO:teuthology.orchestra.run.smithi104.stdout:(58/145): python3-babel-2.9.1-2.el9.noarch.rpm 35 MB/s | 5.8 MB 00:00 2023-09-13T02:10:23.776 INFO:teuthology.orchestra.run.smithi104.stdout:(59/145): python3-devel-3.9.17-2.el9.x86_64.rpm 1.3 MB/s | 205 kB 00:00 2023-09-13T02:10:23.801 INFO:teuthology.orchestra.run.smithi104.stdout:(60/145): python3-iniconfig-1.1.1-7.el9.noarch. 398 kB/s | 16 kB 00:00 2023-09-13T02:10:23.826 INFO:teuthology.orchestra.run.smithi104.stdout:(61/145): python3-jinja2-2.11.3-4.el9.noarch.rp 4.5 MB/s | 228 kB 00:00 2023-09-13T02:10:23.852 INFO:teuthology.orchestra.run.smithi104.stdout:(62/145): python3-jsonpatch-1.21-16.el9.noarch. 487 kB/s | 24 kB 00:00 2023-09-13T02:10:23.877 INFO:teuthology.orchestra.run.smithi104.stdout:(63/145): python3-jsonpointer-2.0-4.el9.noarch. 360 kB/s | 18 kB 00:00 2023-09-13T02:10:23.902 INFO:teuthology.orchestra.run.smithi104.stdout:(64/145): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2023-09-13T02:10:23.927 INFO:teuthology.orchestra.run.smithi104.stdout:(65/145): python3-markupsafe-1.1.1-12.el9.x86_6 631 kB/s | 32 kB 00:00 2023-09-13T02:10:24.312 INFO:teuthology.orchestra.run.smithi104.stdout:(66/145): ceph-test-18.0.0-6088.g2110e007.el9.x 10 MB/s | 40 MB 00:03 2023-09-13T02:10:24.387 INFO:teuthology.orchestra.run.smithi104.stdout:(67/145): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.9 MB/s | 4.8 MB 00:00 2023-09-13T02:10:24.412 INFO:teuthology.orchestra.run.smithi104.stdout:(68/145): python3-numpy-f2py-1.20.1-5.el9.x86_6 450 kB/s | 217 kB 00:00 2023-09-13T02:10:24.437 INFO:teuthology.orchestra.run.smithi104.stdout:(69/145): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 174 kB 00:00 2023-09-13T02:10:24.487 INFO:teuthology.orchestra.run.smithi104.stdout:(70/145): python3-packaging-20.9-5.el9.noarch.r 920 kB/s | 69 kB 00:00 2023-09-13T02:10:24.512 INFO:teuthology.orchestra.run.smithi104.stdout:(71/145): python3-pluggy-0.13.1-7.el9.noarch.rp 378 kB/s | 38 kB 00:00 2023-09-13T02:10:24.538 INFO:teuthology.orchestra.run.smithi104.stdout:(72/145): python3-prettytable-0.7.2-27.el9.noar 408 kB/s | 41 kB 00:00 2023-09-13T02:10:24.572 INFO:teuthology.orchestra.run.smithi104.stdout:(73/145): python3-py-1.10.0-6.el9.noarch.rpm 5.0 MB/s | 427 kB 00:00 2023-09-13T02:10:24.597 INFO:teuthology.orchestra.run.smithi104.stdout:(74/145): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 132 kB 00:00 2023-09-13T02:10:24.622 INFO:teuthology.orchestra.run.smithi104.stdout:(75/145): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2023-09-13T02:10:24.647 INFO:teuthology.orchestra.run.smithi104.stdout:(76/145): python3-pytest-6.2.2-6.el9.noarch.rpm 6.2 MB/s | 474 kB 00:00 2023-09-13T02:10:24.673 INFO:teuthology.orchestra.run.smithi104.stdout:(77/145): python3-requests-oauthlib-1.3.0-12.el 570 kB/s | 43 kB 00:00 2023-09-13T02:10:24.859 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/151 2023-09-13T02:10:24.937 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 96/151 2023-09-13T02:10:24.956 INFO:teuthology.orchestra.run.smithi104.stdout:(78/145): python3-toml-0.10.2-6.el9.noarch.rpm 125 kB/s | 39 kB 00:00 2023-09-13T02:10:24.968 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 97/151 2023-09-13T02:10:24.981 INFO:teuthology.orchestra.run.smithi104.stdout:(79/145): socat-1.7.4.1-5.el9.x86_64.rpm 976 kB/s | 300 kB 00:00 2023-09-13T02:10:24.999 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : jq-1.6-15.el9.x86_64 98/151 2023-09-13T02:10:25.026 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/151 2023-09-13T02:10:25.265 INFO:teuthology.orchestra.run.smithi104.stdout:(80/145): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2023-09-13T02:10:25.282 INFO:teuthology.orchestra.run.smithi104.stdout:(81/145): uuid-1.6.2-55.el9.x86_64.rpm 173 kB/s | 56 kB 00:00 2023-09-13T02:10:25.299 INFO:teuthology.orchestra.run.smithi104.stdout:(82/145): xmlstarlet-1.6.1-20.el9.x86_64.rpm 199 kB/s | 63 kB 00:00 2023-09-13T02:10:25.324 INFO:teuthology.orchestra.run.smithi104.stdout:(83/145): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-09-13T02:10:25.337 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/151 2023-09-13T02:10:25.349 INFO:teuthology.orchestra.run.smithi104.stdout:(84/145): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-09-13T02:10:25.365 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librbd1-2:18.0.0-6088.g2110e007.el9.x86_64 101/151 2023-09-13T02:10:25.374 INFO:teuthology.orchestra.run.smithi104.stdout:(85/145): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 103 kB 00:00 2023-09-13T02:10:25.400 INFO:teuthology.orchestra.run.smithi104.stdout:(86/145): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 124 kB 00:00 2023-09-13T02:10:25.425 INFO:teuthology.orchestra.run.smithi104.stdout:(87/145): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2023-09-13T02:10:25.450 INFO:teuthology.orchestra.run.smithi104.stdout:(88/145): python3-urllib3-1.26.5-3.el9.noarch.r 2.5 MB/s | 188 kB 00:00 2023-09-13T02:10:25.456 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:18.0.0-6088.g2110e007.el9.x86_64 101/151 2023-09-13T02:10:25.486 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rbd-2:18.0.0-6088.g2110e007.el9.x86_64 102/151 2023-09-13T02:10:25.523 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/151 2023-09-13T02:10:25.634 INFO:teuthology.orchestra.run.smithi104.stdout:(89/145): libquadmath-11.4.1-2.1.el9.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2023-09-13T02:10:25.676 INFO:teuthology.orchestra.run.smithi104.stdout:(90/145): libgfortran-11.4.1-2.1.el9.x86_64.rpm 2.9 MB/s | 809 kB 00:00 2023-09-13T02:10:25.742 INFO:teuthology.orchestra.run.smithi104.stdout:(91/145): python3-cryptography-36.0.1-4.el9.x86 4.2 MB/s | 1.2 MB 00:00 2023-09-13T02:10:25.768 INFO:teuthology.orchestra.run.smithi104.stdout:(92/145): elfutils-libelf-devel-0.189-3.el9.x86 243 kB/s | 22 kB 00:00 2023-09-13T02:10:25.818 INFO:teuthology.orchestra.run.smithi104.stdout:(93/145): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2023-09-13T02:10:25.876 INFO:teuthology.orchestra.run.smithi104.stdout:(94/145): libuuid-devel-2.37.4-15.el9.x86_64.rp 440 kB/s | 26 kB 00:00 2023-09-13T02:10:25.902 INFO:teuthology.orchestra.run.smithi104.stdout:(95/145): jq-1.6-15.el9.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2023-09-13T02:10:25.940 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 104/151 2023-09-13T02:10:25.952 INFO:teuthology.orchestra.run.smithi104.stdout:(96/145): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2023-09-13T02:10:25.967 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librgw2-2:18.0.0-6088.g2110e007.el9.x86_64 105/151 2023-09-13T02:10:26.019 INFO:teuthology.orchestra.run.smithi104.stdout:(97/145): automake-1.16.2-8.el9.noarch.rpm 1.7 MB/s | 689 kB 00:00 2023-09-13T02:10:26.039 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librgw2-2:18.0.0-6088.g2110e007.el9.x86_64 105/151 2023-09-13T02:10:26.044 INFO:teuthology.orchestra.run.smithi104.stdout:(98/145): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 938 kB/s | 86 kB 00:00 2023-09-13T02:10:26.069 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rgw-2:18.0.0-6088.g2110e007.el9.x86_64 106/151 2023-09-13T02:10:26.070 INFO:teuthology.orchestra.run.smithi104.stdout:(99/145): zlib-devel-1.2.11-40.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2023-09-13T02:10:26.295 INFO:teuthology.orchestra.run.smithi104.stdout:(100/145): fmt-8.1.1-5.el9.x86_64.rpm 443 kB/s | 111 kB 00:00 2023-09-13T02:10:26.336 INFO:teuthology.orchestra.run.smithi104.stdout:(101/145): gperftools-libs-2.9.1-2.el9.x86_64.r 1.1 MB/s | 309 kB 00:00 2023-09-13T02:10:26.395 INFO:teuthology.orchestra.run.smithi104.stdout:(102/145): libarrow-doc-9.0.0-9.el9.noarch.rpm 416 kB/s | 24 kB 00:00 2023-09-13T02:10:26.454 INFO:teuthology.orchestra.run.smithi104.stdout:(103/145): liboath-2.6.7-2.el9.x86_64.rpm 836 kB/s | 49 kB 00:00 2023-09-13T02:10:26.513 INFO:teuthology.orchestra.run.smithi104.stdout:(104/145): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2023-09-13T02:10:26.657 INFO:teuthology.orchestra.run.smithi104.stdout:(105/145): parquet-libs-9.0.0-9.el9.x86_64.rpm 5.8 MB/s | 837 kB 00:00 2023-09-13T02:10:26.722 INFO:teuthology.orchestra.run.smithi104.stdout:(106/145): libarrow-9.0.0-9.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2023-09-13T02:10:26.780 INFO:teuthology.orchestra.run.smithi104.stdout:(107/145): python3-asyncssh-2.13.2-3.el9.noarch 4.3 MB/s | 548 kB 00:00 2023-09-13T02:10:26.814 INFO:teuthology.orchestra.run.smithi104.stdout:(108/145): python3-bcrypt-3.2.2-1.el9.x86_64.rp 474 kB/s | 43 kB 00:00 2023-09-13T02:10:26.839 INFO:teuthology.orchestra.run.smithi104.stdout:(109/145): python3-cachetools-4.2.4-1.el9.noarc 552 kB/s | 32 kB 00:00 2023-09-13T02:10:26.872 INFO:teuthology.orchestra.run.smithi104.stdout:(110/145): python3-certifi-2021.10.8-2.el9.noar 256 kB/s | 15 kB 00:00 2023-09-13T02:10:26.898 INFO:teuthology.orchestra.run.smithi104.stdout:(111/145): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2023-09-13T02:10:26.931 INFO:teuthology.orchestra.run.smithi104.stdout:(112/145): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2023-09-13T02:10:26.965 INFO:teuthology.orchestra.run.smithi104.stdout:(113/145): python3-google-auth-2.22.0-1.el9.noa 2.9 MB/s | 197 kB 00:00 2023-09-13T02:10:26.990 INFO:teuthology.orchestra.run.smithi104.stdout:(114/145): python3-jaraco-8.2.1-3.el9.noarch.rp 182 kB/s | 11 kB 00:00 2023-09-13T02:10:27.016 INFO:teuthology.orchestra.run.smithi104.stdout:(115/145): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2023-09-13T02:10:27.041 INFO:teuthology.orchestra.run.smithi104.stdout:(116/145): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2023-09-13T02:10:27.066 INFO:teuthology.orchestra.run.smithi104.stdout:(117/145): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2023-09-13T02:10:27.100 INFO:teuthology.orchestra.run.smithi104.stdout:(118/145): python3-jaraco-text-3.2.0-6.el9.noar 334 kB/s | 20 kB 00:00 2023-09-13T02:10:27.125 INFO:teuthology.orchestra.run.smithi104.stdout:(119/145): python3-jwt+crypto-2.4.0-1.el9.noarc 155 kB/s | 9.0 kB 00:00 2023-09-13T02:10:27.150 INFO:teuthology.orchestra.run.smithi104.stdout:(120/145): python3-jwt-2.4.0-1.el9.noarch.rpm 814 kB/s | 41 kB 00:00 2023-09-13T02:10:27.217 INFO:teuthology.orchestra.run.smithi104.stdout:(121/145): python3-logutils-0.3.5-21.el9.noarch 693 kB/s | 46 kB 00:00 2023-09-13T02:10:27.251 INFO:teuthology.orchestra.run.smithi104.stdout:(122/145): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2023-09-13T02:10:27.318 INFO:teuthology.orchestra.run.smithi104.stdout:(123/145): openssl-devel-3.0.7-24.el9.x86_64.rp 2.9 MB/s | 4.1 MB 00:01 2023-09-13T02:10:27.343 INFO:teuthology.orchestra.run.smithi104.stdout:(124/145): python3-more-itertools-8.12.0-2.el9. 629 kB/s | 79 kB 00:00 2023-09-13T02:10:27.389 INFO:teuthology.orchestra.run.smithi104.stdout:(125/145): python3-natsort-7.1.1-5.el9.noarch.r 419 kB/s | 58 kB 00:00 2023-09-13T02:10:27.444 INFO:teuthology.orchestra.run.smithi104.stdout:(126/145): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2023-09-13T02:10:27.469 INFO:teuthology.orchestra.run.smithi104.stdout:(127/145): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.6 MB/s | 90 kB 00:00 2023-09-13T02:10:27.494 INFO:teuthology.orchestra.run.smithi104.stdout:(128/145): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2023-09-13T02:10:27.527 INFO:teuthology.orchestra.run.smithi104.stdout:(129/145): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2023-09-13T02:10:27.553 INFO:teuthology.orchestra.run.smithi104.stdout:(130/145): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2023-09-13T02:10:27.578 INFO:teuthology.orchestra.run.smithi104.stdout:(131/145): python3-portend-3.1.0-2.el9.noarch.r 70 kB/s | 16 kB 00:00 2023-09-13T02:10:27.612 INFO:teuthology.orchestra.run.smithi104.stdout:(132/145): python3-tempora-5.0.0-2.el9.noarch.r 427 kB/s | 36 kB 00:00 2023-09-13T02:10:27.654 INFO:teuthology.orchestra.run.smithi104.stdout:(133/145): python3-typing-extensions-4.4.0-2.el 507 kB/s | 51 kB 00:00 2023-09-13T02:10:27.681 INFO:teuthology.orchestra.run.smithi104.stdout:(134/145): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2023-09-13T02:10:27.721 INFO:teuthology.orchestra.run.smithi104.stdout:(135/145): python3-werkzeug-2.0.3-3.el9.1.noarc 6.2 MB/s | 427 kB 00:00 2023-09-13T02:10:27.746 INFO:teuthology.orchestra.run.smithi104.stdout:(136/145): python3-zc-lockfile-2.0-10.el9.noarc 297 kB/s | 20 kB 00:00 2023-09-13T02:10:27.772 INFO:teuthology.orchestra.run.smithi104.stdout:(137/145): python3-webob-1.8.7-6.el9.noarch.rpm 1.2 MB/s | 230 kB 00:00 2023-09-13T02:10:27.797 INFO:teuthology.orchestra.run.smithi104.stdout:(138/145): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2023-09-13T02:10:27.914 INFO:teuthology.orchestra.run.smithi104.stdout:(139/145): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2023-09-13T02:10:27.945 INFO:teuthology.orchestra.run.smithi104.stdout:[MIRROR] NetworkManager-1.45.2-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-1.45.2-1.el9.x86_64.rpm (IP: 216.31.0.2) 2023-09-13T02:10:27.975 INFO:teuthology.orchestra.run.smithi104.stdout:[MIRROR] NetworkManager-1.45.2-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-1.45.2-1.el9.x86_64.rpm (IP: 216.31.0.2) 2023-09-13T02:10:28.131 INFO:teuthology.orchestra.run.smithi104.stdout:(140/145): librados2-18.0.0-6088.g2110e007.el9. 9.2 MB/s | 3.3 MB 00:00 2023-09-13T02:10:28.181 INFO:teuthology.orchestra.run.smithi104.stdout:(141/145): NetworkManager-1.45.2-1.el9.x86_64.r 8.4 MB/s | 2.2 MB 00:00 2023-09-13T02:10:28.182 INFO:teuthology.orchestra.run.smithi104.stdout:[MIRROR] NetworkManager-libnm-1.45.2-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-libnm-1.45.2-1.el9.x86_64.rpm (IP: 216.31.0.2) 2023-09-13T02:10:28.256 INFO:teuthology.orchestra.run.smithi104.stdout:(142/145): librbd1-18.0.0-6088.g2110e007.el9.x8 6.6 MB/s | 3.0 MB 00:00 2023-09-13T02:10:28.257 INFO:teuthology.orchestra.run.smithi104.stdout:[MIRROR] NetworkManager-team-1.45.2-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-team-1.45.2-1.el9.x86_64.rpm (IP: 216.31.0.2) 2023-09-13T02:10:28.257 INFO:teuthology.orchestra.run.smithi104.stdout:[MIRROR] NetworkManager-libnm-1.45.2-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-libnm-1.45.2-1.el9.x86_64.rpm (IP: 216.31.0.2) 2023-09-13T02:10:28.288 INFO:teuthology.orchestra.run.smithi104.stdout:[MIRROR] NetworkManager-tui-1.45.2-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-tui-1.45.2-1.el9.x86_64.rpm (IP: 216.31.0.2) 2023-09-13T02:10:28.288 INFO:teuthology.orchestra.run.smithi104.stdout:[MIRROR] NetworkManager-team-1.45.2-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-team-1.45.2-1.el9.x86_64.rpm (IP: 216.31.0.2) 2023-09-13T02:10:28.313 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:18.0.0-6088.g2110e007.el9.x86_64 107/151 2023-09-13T02:10:28.348 INFO:teuthology.orchestra.run.smithi104.stdout:(143/145): NetworkManager-team-1.45.2-1.el9.x86 252 kB/s | 42 kB 00:00 2023-09-13T02:10:28.357 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-common-2:18.0.0-6088.g2110e007.el9.x86_64 107/151 2023-09-13T02:10:28.382 INFO:teuthology.orchestra.run.smithi104.stdout:(144/145): NetworkManager-tui-1.45.2-1.el9.x86_ 1.9 MB/s | 247 kB 00:00 2023-09-13T02:10:28.432 INFO:teuthology.orchestra.run.smithi104.stdout:(145/145): NetworkManager-libnm-1.45.2-1.el9.x8 6.0 MB/s | 1.8 MB 00:00 2023-09-13T02:10:28.437 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2023-09-13T02:10:28.437 INFO:teuthology.orchestra.run.smithi104.stdout:Total 19 MB/s | 199 MB 00:10 2023-09-13T02:10:28.666 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2023-09-13T02:10:28.789 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2023-09-13T02:10:28.790 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2023-09-13T02:10:28.903 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:18.0.0-6088.g2110e007.el9.x86_64 107/151 2023-09-13T02:10:28.944 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-base-2:18.0.0-6088.g2110e007.el9.x86_64 108/151 2023-09-13T02:10:29.035 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-base-2:18.0.0-6088.g2110e007.el9.x86_64 108/151 2023-09-13T02:10:29.036 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-09-13T02:10:29.036 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-09-13T02:10:29.036 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:10:29.070 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-selinux-2:18.0.0-6088.g2110e007.el9.x86_64 109/151 2023-09-13T02:10:30.600 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2023-09-13T02:10:30.600 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2023-09-13T02:10:36.232 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2023-09-13T02:10:36.325 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/151 2023-09-13T02:10:36.351 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/151 2023-09-13T02:10:36.377 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/151 2023-09-13T02:10:36.434 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/151 2023-09-13T02:10:36.762 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/151 2023-09-13T02:10:36.827 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librados2-2:18.0.0-6088.g2110e007.el9.x86_64 6/151 2023-09-13T02:10:36.925 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:18.0.0-6088.g2110e007.el9.x86_64 6/151 2023-09-13T02:10:36.962 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs2-2:18.0.0-6088.g2110e007.el9.x86_64 7/151 2023-09-13T02:10:37.052 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephfs2-2:18.0.0-6088.g2110e007.el9.x86_64 7/151 2023-09-13T02:10:37.095 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rados-2:18.0.0-6088.g2110e007.el9.x86_64 8/151 2023-09-13T02:10:37.167 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/151 2023-09-13T02:10:37.221 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 10/151 2023-09-13T02:10:37.257 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 11/151 2023-09-13T02:10:37.432 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/151 2023-09-13T02:10:37.485 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/151 2023-09-13T02:10:37.513 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephsqlite-2:18.0.0-6088.g2110e007.el9.x86_64 14/151 2023-09-13T02:10:37.597 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6088.g2110e007.el9.x86_64 14/151 2023-09-13T02:10:37.622 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libradosstriper1-2:18.0.0-6088.g2110e007.el9.x86 15/151 2023-09-13T02:10:37.841 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6088.g2110e007.el9.x86 15/151 2023-09-13T02:10:37.959 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-libnm-1:1.45.2-1.el9.x86_64 16/151 2023-09-13T02:10:38.019 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.2-1.el9.x86_64 16/151 2023-09-13T02:10:38.136 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.45.2-1.el9.x86_64 17/151 2023-09-13T02:10:38.179 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-1:1.45.2-1.el9.x86_64 17/151 2023-09-13T02:10:38.442 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.45.2-1.el9.x86_64 17/151 2023-09-13T02:10:38.475 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/151 2023-09-13T02:10:38.508 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/151 2023-09-13T02:10:38.537 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/151 2023-09-13T02:10:38.579 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libquadmath-11.4.1-2.1.el9.x86_64 21/151 2023-09-13T02:10:38.616 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libgfortran-11.4.1-2.1.el9.x86_64 22/151 2023-09-13T02:10:38.646 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 23/151 2023-09-13T02:10:38.709 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 24/151 2023-09-13T02:10:38.744 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/151 2023-09-13T02:10:38.780 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/151 2023-09-13T02:10:38.849 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/151 2023-09-13T02:10:38.885 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-common-2:18.0.0-6088.g2110e007.el9. 28/151 2023-09-13T02:10:38.928 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-argparse-2:18.0.0-6088.g2110e007.el 29/151 2023-09-13T02:10:39.003 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cephfs-2:18.0.0-6088.g2110e007.el9.x86_6 30/151 2023-09-13T02:10:39.138 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/151 2023-09-13T02:10:39.189 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/151 2023-09-13T02:10:39.220 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/151 2023-09-13T02:10:39.261 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 34/151 2023-09-13T02:10:39.296 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 35/151 2023-09-13T02:10:39.832 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 36/151 2023-09-13T02:10:39.913 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 37/151 2023-09-13T02:10:39.949 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 38/151 2023-09-13T02:10:39.986 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librados-devel-2:18.0.0-6088.g2110e007.el9.x86_6 39/151 2023-09-13T02:10:40.017 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/151 2023-09-13T02:10:40.051 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 41/151 2023-09-13T02:10:40.150 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/151 2023-09-13T02:10:40.188 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 43/151 2023-09-13T02:10:40.243 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/151 2023-09-13T02:10:40.318 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/151 2023-09-13T02:10:40.355 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/151 2023-09-13T02:10:40.391 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/151 2023-09-13T02:10:40.447 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/151 2023-09-13T02:10:40.452 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6088.g2110e007.el9.x86_64 109/151 2023-09-13T02:10:40.452 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /sys 2023-09-13T02:10:40.453 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /proc 2023-09-13T02:10:40.453 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /mnt 2023-09-13T02:10:40.453 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /var/tmp 2023-09-13T02:10:40.453 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /home 2023-09-13T02:10:40.454 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /root 2023-09-13T02:10:40.454 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /tmp 2023-09-13T02:10:40.454 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:10:40.492 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/151 2023-09-13T02:10:40.534 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/151 2023-09-13T02:10:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-volume-2:18.0.0-6088.g2110e007.el9.noarch 110/151 2023-09-13T02:10:40.638 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-volume-2:18.0.0-6088.g2110e007.el9.noarch 110/151 2023-09-13T02:10:40.638 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:10:40.638 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-09-13T02:10:40.639 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:10:40.669 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/151 2023-09-13T02:10:40.711 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/151 2023-09-13T02:10:40.752 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/151 2023-09-13T02:10:40.845 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/151 2023-09-13T02:10:40.886 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-google-auth-1:2.22.0-1.el9.noarch 55/151 2023-09-13T02:10:40.927 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/151 2023-09-13T02:10:40.959 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/151 2023-09-13T02:10:40.986 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 58/151 2023-09-13T02:10:41.020 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : fmt-8.1.1-5.el9.x86_64 59/151 2023-09-13T02:10:41.048 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 60/151 2023-09-13T02:10:41.138 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 61/151 2023-09-13T02:10:41.189 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : automake-1.16.2-8.el9.noarch 62/151 2023-09-13T02:10:41.239 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/151 2023-09-13T02:10:41.294 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/151 2023-09-13T02:10:41.496 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/151 2023-09-13T02:10:41.543 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/151 2023-09-13T02:10:41.622 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/151 2023-09-13T02:10:41.719 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 68/151 2023-09-13T02:10:41.884 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 69/151 2023-09-13T02:10:41.931 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 70/151 2023-09-13T02:10:41.960 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 71/151 2023-09-13T02:10:41.994 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 72/151 2023-09-13T02:10:42.026 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 73/151 2023-09-13T02:10:42.059 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : fuse-2.9.9-15.el9.x86_64 74/151 2023-09-13T02:10:42.104 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 75/151 2023-09-13T02:10:42.146 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : uuid-1.6.2-55.el9.x86_64 76/151 2023-09-13T02:10:42.184 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-osd-2:18.0.0-6088.g2110e007.el9.x86_64 111/151 2023-09-13T02:10:42.209 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-osd-2:18.0.0-6088.g2110e007.el9.x86_64 111/151 2023-09-13T02:10:42.210 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:10:42.210 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-09-13T02:10:42.210 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-09-13T02:10:42.210 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-09-13T02:10:42.210 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:10:42.269 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 77/151 2023-09-13T02:10:42.304 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-py-1.10.0-6.el9.noarch 78/151 2023-09-13T02:10:42.343 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/151 2023-09-13T02:10:42.385 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pluggy-0.13.1-7.el9.noarch 80/151 2023-09-13T02:10:42.418 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mds-2:18.0.0-6088.g2110e007.el9.x86_64 112/151 2023-09-13T02:10:42.440 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mds-2:18.0.0-6088.g2110e007.el9.x86_64 112/151 2023-09-13T02:10:42.441 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:10:42.441 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-09-13T02:10:42.441 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-09-13T02:10:42.441 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-09-13T02:10:42.441 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:10:42.485 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-packaging-20.9-5.el9.noarch 81/151 2023-09-13T02:10:42.542 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/151 2023-09-13T02:10:42.894 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mon-2:18.0.0-6088.g2110e007.el9.x86_64 113/151 2023-09-13T02:10:42.916 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mon-2:18.0.0-6088.g2110e007.el9.x86_64 113/151 2023-09-13T02:10:42.916 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:10:42.917 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-09-13T02:10:42.917 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-09-13T02:10:42.917 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-09-13T02:10:42.917 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:10:43.249 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:18.0.0-6088.g2110e007.el9.noarch 114/151 2023-09-13T02:10:43.274 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/151 2023-09-13T02:10:43.275 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephadm-2:18.0.0-6088.g2110e007.el9.noarch 114/151 2023-09-13T02:10:43.304 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6088.g2110e007.e 115/151 2023-09-13T02:10:43.330 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/151 2023-09-13T02:10:43.363 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/151 2023-09-13T02:10:43.367 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6088.g2110e007. 116/151 2023-09-13T02:10:43.391 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6088.g2110e007.el9.noa 117/151 2023-09-13T02:10:43.397 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/151 2023-09-13T02:10:43.498 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-iniconfig-1.1.1-7.el9.noarch 87/151 2023-09-13T02:10:43.546 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 88/151 2023-09-13T02:10:43.581 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/151 2023-09-13T02:10:43.612 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6088.g2110e007.el9.noa 117/151 2023-09-13T02:10:43.642 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6088.g2110e007.el9.n 118/151 2023-09-13T02:10:43.757 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-0.3.21-2.el9.x86_64 90/151 2023-09-13T02:10:43.805 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 91/151 2023-09-13T02:10:43.882 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 92/151 2023-09-13T02:10:44.551 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 93/151 2023-09-13T02:10:44.600 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6088.g2110e007.el9.n 118/151 2023-09-13T02:10:44.634 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6088.g211 119/151 2023-09-13T02:10:44.669 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 94/151 2023-09-13T02:10:44.733 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6088.g211 119/151 2023-09-13T02:10:44.890 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6088.g2110e007.el 120/151 2023-09-13T02:10:44.927 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-2:18.0.0-6088.g2110e007.el9.x86_64 121/151 2023-09-13T02:10:44.950 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6088.g2110e007.el9.x86_64 121/151 2023-09-13T02:10:44.950 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:10:44.950 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-09-13T02:10:44.951 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-09-13T02:10:44.951 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-09-13T02:10:44.951 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:10:44.994 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-rook-2:18.0.0-6088.g2110e007.el9.noarch 122/151 2023-09-13T02:10:45.005 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6088.g2110e007.el9.noarch 122/151 2023-09-13T02:10:45.759 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-2:18.0.0-6088.g2110e007.el9.x86_64 123/151 2023-09-13T02:10:45.788 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-radosgw-2:18.0.0-6088.g2110e007.el9.x86_64 124/151 2023-09-13T02:10:45.810 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6088.g2110e007.el9.x86_64 124/151 2023-09-13T02:10:45.810 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:10:45.810 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-09-13T02:10:45.810 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-09-13T02:10:45.811 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-09-13T02:10:45.811 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:10:45.863 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6088.g2110e 125/151 2023-09-13T02:10:45.885 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6088.g2110e 125/151 2023-09-13T02:10:45.885 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:10:45.885 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-09-13T02:10:45.885 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:10:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-mirror-2:18.0.0-6088.g2110e007.el9.x86_64 126/151 2023-09-13T02:10:45.942 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/151 2023-09-13T02:10:45.961 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6088.g2110e007.el9.x86_64 126/151 2023-09-13T02:10:45.961 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:10:45.961 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-09-13T02:10:45.961 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-09-13T02:10:45.962 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-09-13T02:10:45.962 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:10:46.029 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 96/151 2023-09-13T02:10:46.060 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 97/151 2023-09-13T02:10:46.090 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : jq-1.6-15.el9.x86_64 98/151 2023-09-13T02:10:46.118 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/151 2023-09-13T02:10:46.256 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-mirror-2:18.0.0-6088.g2110e007.el9.x86_64 127/151 2023-09-13T02:10:46.279 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6088.g2110e007.el9.x86_64 127/151 2023-09-13T02:10:46.279 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:10:46.279 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-09-13T02:10:46.280 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-09-13T02:10:46.280 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-09-13T02:10:46.280 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:10:46.419 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/151 2023-09-13T02:10:46.448 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librbd1-2:18.0.0-6088.g2110e007.el9.x86_64 101/151 2023-09-13T02:10:46.537 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:18.0.0-6088.g2110e007.el9.x86_64 101/151 2023-09-13T02:10:46.568 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rbd-2:18.0.0-6088.g2110e007.el9.x86_64 102/151 2023-09-13T02:10:46.604 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/151 2023-09-13T02:10:47.044 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 104/151 2023-09-13T02:10:47.347 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librgw2-2:18.0.0-6088.g2110e007.el9.x86_64 105/151 2023-09-13T02:10:47.605 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librgw2-2:18.0.0-6088.g2110e007.el9.x86_64 105/151 2023-09-13T02:10:47.627 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rgw-2:18.0.0-6088.g2110e007.el9.x86_64 106/151 2023-09-13T02:10:49.843 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:18.0.0-6088.g2110e007.el9.x86_64 107/151 2023-09-13T02:10:49.874 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-common-2:18.0.0-6088.g2110e007.el9.x86_64 107/151 2023-09-13T02:10:50.084 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-test-2:18.0.0-6088.g2110e007.el9.x86_64 128/151 2023-09-13T02:10:50.125 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-fuse-2:18.0.0-6088.g2110e007.el9.x86_64 129/151 2023-09-13T02:10:50.156 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-nbd-2:18.0.0-6088.g2110e007.el9.x86_64 130/151 2023-09-13T02:10:50.277 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 131/151 2023-09-13T02:10:50.415 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:18.0.0-6088.g2110e007.el9.x86_64 107/151 2023-09-13T02:10:50.459 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-base-2:18.0.0-6088.g2110e007.el9.x86_64 108/151 2023-09-13T02:10:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytest-6.2.2-6.el9.noarch 132/151 2023-09-13T02:10:50.547 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-base-2:18.0.0-6088.g2110e007.el9.x86_64 108/151 2023-09-13T02:10:50.547 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-09-13T02:10:50.547 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-09-13T02:10:50.548 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:10:50.577 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-selinux-2:18.0.0-6088.g2110e007.el9.x86_64 109/151 2023-09-13T02:10:50.580 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/151 2023-09-13T02:10:50.628 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-fuse-2:18.0.0-6088.g2110e007.el9.x86_64 134/151 2023-09-13T02:10:50.673 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libtool-2.4.6-45.el9.x86_64 135/151 2023-09-13T02:10:50.707 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 136/151 2023-09-13T02:10:50.729 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs-devel-2:18.0.0-6088.g2110e007.el9.x86_ 137/151 2023-09-13T02:10:50.759 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-team-1:1.45.2-1.el9.x86_64 138/151 2023-09-13T02:10:50.813 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-tui-1:1.45.2-1.el9.x86_64 139/151 2023-09-13T02:10:51.370 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 140/151 2023-09-13T02:10:51.403 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 140/151 2023-09-13T02:10:51.427 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 140/151 2023-09-13T02:10:52.247 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-top-2:18.0.0-6088.g2110e007.el9.noarch 141/151 2023-09-13T02:10:52.340 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 142/151 2023-09-13T02:10:52.401 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 143/151 2023-09-13T02:10:52.497 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flex-2.6.4-9.el9.x86_64 144/151 2023-09-13T02:10:52.527 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : bison-3.7.4-5.el9.x86_64 145/151 2023-09-13T02:10:52.553 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/151 2023-09-13T02:10:52.553 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 147/151 2023-09-13T02:10:52.628 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 147/151 2023-09-13T02:10:52.653 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 148/151 2023-09-13T02:10:52.666 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/151 2023-09-13T02:10:52.666 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 149/151 2023-09-13T02:10:52.856 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/151 2023-09-13T02:10:52.856 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/151 2023-09-13T02:10:52.939 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/151 2023-09-13T02:10:52.939 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 151/151 2023-09-13T02:10:57.507 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 151/151 2023-09-13T02:10:57.507 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-2:18.0.0-6088.g2110e007.el9.x86_64 1/151 2023-09-13T02:10:57.507 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-base-2:18.0.0-6088.g2110e007.el9.x86_64 2/151 2023-09-13T02:10:57.508 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-common-2:18.0.0-6088.g2110e007.el9.x86_64 3/151 2023-09-13T02:10:57.508 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-fuse-2:18.0.0-6088.g2110e007.el9.x86_64 4/151 2023-09-13T02:10:57.508 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6088.g2110e 5/151 2023-09-13T02:10:57.508 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mds-2:18.0.0-6088.g2110e007.el9.x86_64 6/151 2023-09-13T02:10:57.509 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-2:18.0.0-6088.g2110e007.el9.x86_64 7/151 2023-09-13T02:10:57.509 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mon-2:18.0.0-6088.g2110e007.el9.x86_64 8/151 2023-09-13T02:10:57.509 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-osd-2:18.0.0-6088.g2110e007.el9.x86_64 9/151 2023-09-13T02:10:57.509 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-radosgw-2:18.0.0-6088.g2110e007.el9.x86_64 10/151 2023-09-13T02:10:57.509 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-selinux-2:18.0.0-6088.g2110e007.el9.x86_64 11/151 2023-09-13T02:10:57.510 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-test-2:18.0.0-6088.g2110e007.el9.x86_64 12/151 2023-09-13T02:10:57.510 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-mirror-2:18.0.0-6088.g2110e007.el9.x86_64 13/151 2023-09-13T02:10:57.510 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs-devel-2:18.0.0-6088.g2110e007.el9.x86_ 14/151 2023-09-13T02:10:57.510 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs2-2:18.0.0-6088.g2110e007.el9.x86_64 15/151 2023-09-13T02:10:57.510 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephsqlite-2:18.0.0-6088.g2110e007.el9.x86_64 16/151 2023-09-13T02:10:57.511 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados-devel-2:18.0.0-6088.g2110e007.el9.x86_6 17/151 2023-09-13T02:10:57.511 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libradosstriper1-2:18.0.0-6088.g2110e007.el9.x86 18/151 2023-09-13T02:10:57.511 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librgw2-2:18.0.0-6088.g2110e007.el9.x86_64 19/151 2023-09-13T02:10:57.511 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6088.g2110e007.el 20/151 2023-09-13T02:10:57.511 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-common-2:18.0.0-6088.g2110e007.el9. 21/151 2023-09-13T02:10:57.512 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cephfs-2:18.0.0-6088.g2110e007.el9.x86_6 22/151 2023-09-13T02:10:57.512 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rados-2:18.0.0-6088.g2110e007.el9.x86_64 23/151 2023-09-13T02:10:57.512 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rbd-2:18.0.0-6088.g2110e007.el9.x86_64 24/151 2023-09-13T02:10:57.512 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rgw-2:18.0.0-6088.g2110e007.el9.x86_64 25/151 2023-09-13T02:10:57.512 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-fuse-2:18.0.0-6088.g2110e007.el9.x86_64 26/151 2023-09-13T02:10:57.513 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-mirror-2:18.0.0-6088.g2110e007.el9.x86_64 27/151 2023-09-13T02:10:57.513 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-nbd-2:18.0.0-6088.g2110e007.el9.x86_64 28/151 2023-09-13T02:10:57.524 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6088.g2110e007. 29/151 2023-09-13T02:10:57.524 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6088.g2110e007.el9.noa 30/151 2023-09-13T02:10:57.524 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6088.g2110e007.el9.n 31/151 2023-09-13T02:10:57.524 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6088.g211 32/151 2023-09-13T02:10:57.525 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6088.g2110e007.el 33/151 2023-09-13T02:10:57.525 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6088.g2110e007.el9.noarch 34/151 2023-09-13T02:10:57.525 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6088.g2110e007.e 35/151 2023-09-13T02:10:57.525 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-volume-2:18.0.0-6088.g2110e007.el9.noarch 36/151 2023-09-13T02:10:57.526 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephadm-2:18.0.0-6088.g2110e007.el9.noarch 37/151 2023-09-13T02:10:57.526 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-top-2:18.0.0-6088.g2110e007.el9.noarch 38/151 2023-09-13T02:10:57.526 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/151 2023-09-13T02:10:57.526 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/151 2023-09-13T02:10:57.526 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/151 2023-09-13T02:10:57.527 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/151 2023-09-13T02:10:57.527 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/151 2023-09-13T02:10:57.527 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/151 2023-09-13T02:10:57.527 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/151 2023-09-13T02:10:57.527 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/151 2023-09-13T02:10:57.528 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/151 2023-09-13T02:10:57.528 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/151 2023-09-13T02:10:57.528 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/151 2023-09-13T02:10:57.528 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/151 2023-09-13T02:10:57.529 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/151 2023-09-13T02:10:57.529 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/151 2023-09-13T02:10:57.529 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/151 2023-09-13T02:10:57.529 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/151 2023-09-13T02:10:57.529 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/151 2023-09-13T02:10:57.530 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/151 2023-09-13T02:10:57.530 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/151 2023-09-13T02:10:57.530 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 58/151 2023-09-13T02:10:57.530 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 59/151 2023-09-13T02:10:57.531 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 60/151 2023-09-13T02:10:57.531 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-iniconfig-1.1.1-7.el9.noarch 61/151 2023-09-13T02:10:57.531 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 62/151 2023-09-13T02:10:57.531 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 63/151 2023-09-13T02:10:57.532 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 64/151 2023-09-13T02:10:57.532 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 65/151 2023-09-13T02:10:57.532 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 66/151 2023-09-13T02:10:57.532 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 67/151 2023-09-13T02:10:57.532 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 68/151 2023-09-13T02:10:57.533 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 69/151 2023-09-13T02:10:57.533 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 70/151 2023-09-13T02:10:57.533 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pluggy-0.13.1-7.el9.noarch 71/151 2023-09-13T02:10:57.533 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/151 2023-09-13T02:10:57.534 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-py-1.10.0-6.el9.noarch 73/151 2023-09-13T02:10:57.534 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/151 2023-09-13T02:10:57.534 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/151 2023-09-13T02:10:57.534 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytest-6.2.2-6.el9.noarch 76/151 2023-09-13T02:10:57.534 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/151 2023-09-13T02:10:57.535 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/151 2023-09-13T02:10:57.535 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/151 2023-09-13T02:10:57.535 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/151 2023-09-13T02:10:57.535 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/151 2023-09-13T02:10:57.535 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/151 2023-09-13T02:10:57.536 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 83/151 2023-09-13T02:10:57.536 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 84/151 2023-09-13T02:10:57.536 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ply-3.11-14.el9.noarch 85/151 2023-09-13T02:10:57.536 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 86/151 2023-09-13T02:10:57.537 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 87/151 2023-09-13T02:10:57.537 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 88/151 2023-09-13T02:10:57.537 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libgfortran-11.4.1-2.1.el9.x86_64 89/151 2023-09-13T02:10:57.537 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libquadmath-11.4.1-2.1.el9.x86_64 90/151 2023-09-13T02:10:57.537 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/151 2023-09-13T02:10:57.538 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : automake-1.16.2-8.el9.noarch 92/151 2023-09-13T02:10:57.538 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 93/151 2023-09-13T02:10:57.538 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : jq-1.6-15.el9.x86_64 94/151 2023-09-13T02:10:57.538 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 95/151 2023-09-13T02:10:57.538 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 96/151 2023-09-13T02:10:57.539 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 97/151 2023-09-13T02:10:57.539 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 98/151 2023-09-13T02:10:57.539 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 99/151 2023-09-13T02:10:57.539 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 100/151 2023-09-13T02:10:57.539 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 101/151 2023-09-13T02:10:57.540 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 102/151 2023-09-13T02:10:57.540 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 103/151 2023-09-13T02:10:57.540 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 104/151 2023-09-13T02:10:57.540 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 105/151 2023-09-13T02:10:57.540 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 106/151 2023-09-13T02:10:57.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 107/151 2023-09-13T02:10:57.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 108/151 2023-09-13T02:10:57.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 109/151 2023-09-13T02:10:57.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 110/151 2023-09-13T02:10:57.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 111/151 2023-09-13T02:10:57.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 112/151 2023-09-13T02:10:57.542 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 113/151 2023-09-13T02:10:57.542 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-google-auth-1:2.22.0-1.el9.noarch 114/151 2023-09-13T02:10:57.542 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 115/151 2023-09-13T02:10:57.542 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 116/151 2023-09-13T02:10:57.542 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 117/151 2023-09-13T02:10:57.543 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 118/151 2023-09-13T02:10:57.543 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 119/151 2023-09-13T02:10:57.543 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 120/151 2023-09-13T02:10:57.543 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 121/151 2023-09-13T02:10:57.543 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 122/151 2023-09-13T02:10:57.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 123/151 2023-09-13T02:10:57.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 124/151 2023-09-13T02:10:57.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 125/151 2023-09-13T02:10:57.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 126/151 2023-09-13T02:10:57.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 127/151 2023-09-13T02:10:57.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 128/151 2023-09-13T02:10:57.545 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/151 2023-09-13T02:10:57.545 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/151 2023-09-13T02:10:57.545 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/151 2023-09-13T02:10:57.545 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/151 2023-09-13T02:10:57.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/151 2023-09-13T02:10:57.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/151 2023-09-13T02:10:57.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/151 2023-09-13T02:10:57.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/151 2023-09-13T02:10:57.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/151 2023-09-13T02:10:57.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/151 2023-09-13T02:10:57.547 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/151 2023-09-13T02:10:57.547 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:18.0.0-6088.g2110e007.el9.x86_64 140/151 2023-09-13T02:10:57.547 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/151 2023-09-13T02:10:57.547 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:18.0.0-6088.g2110e007.el9.x86_64 142/151 2023-09-13T02:10:57.547 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/151 2023-09-13T02:10:57.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-1:1.45.2-1.el9.x86_64 144/151 2023-09-13T02:10:57.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 145/151 2023-09-13T02:10:57.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-libnm-1:1.45.2-1.el9.x86_64 146/151 2023-09-13T02:10:57.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 147/151 2023-09-13T02:10:57.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-team-1:1.45.2-1.el9.x86_64 148/151 2023-09-13T02:10:57.549 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 149/151 2023-09-13T02:10:57.549 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-tui-1:1.45.2-1.el9.x86_64 150/151 2023-09-13T02:11:00.269 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 151/151 2023-09-13T02:11:00.270 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:00.270 INFO:teuthology.orchestra.run.smithi119.stdout:Upgraded: 2023-09-13T02:11:00.270 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-1:1.45.2-1.el9.x86_64 2023-09-13T02:11:00.270 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-libnm-1:1.45.2-1.el9.x86_64 2023-09-13T02:11:00.271 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-team-1:1.45.2-1.el9.x86_64 2023-09-13T02:11:00.271 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-tui-1:1.45.2-1.el9.x86_64 2023-09-13T02:11:00.271 INFO:teuthology.orchestra.run.smithi119.stdout: librados2-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.271 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.271 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-09-13T02:11:00.272 INFO:teuthology.orchestra.run.smithi119.stdout: automake-1.16.2-8.el9.noarch 2023-09-13T02:11:00.272 INFO:teuthology.orchestra.run.smithi119.stdout: bison-3.7.4-5.el9.x86_64 2023-09-13T02:11:00.272 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-09-13T02:11:00.272 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.272 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.273 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.273 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.273 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:00.273 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.273 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.274 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.274 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:00.274 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:00.274 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:00.275 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:00.275 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:00.275 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.275 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.275 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:00.276 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.276 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.276 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.276 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:00.277 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:00.277 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.277 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:00.277 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-09-13T02:11:00.278 INFO:teuthology.orchestra.run.smithi119.stdout: flex-2.6.4-9.el9.x86_64 2023-09-13T02:11:00.278 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-09-13T02:11:00.278 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-09-13T02:11:00.279 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-09-13T02:11:00.279 INFO:teuthology.orchestra.run.smithi119.stdout: fmt-8.1.1-5.el9.x86_64 2023-09-13T02:11:00.279 INFO:teuthology.orchestra.run.smithi119.stdout: fuse-2.9.9-15.el9.x86_64 2023-09-13T02:11:00.279 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-09-13T02:11:00.280 INFO:teuthology.orchestra.run.smithi119.stdout: jq-1.6-15.el9.x86_64 2023-09-13T02:11:00.280 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-09-13T02:11:00.280 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-9.0.0-9.el9.x86_64 2023-09-13T02:11:00.280 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-09-13T02:11:00.281 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.281 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.281 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.281 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran-11.4.1-2.1.el9.x86_64 2023-09-13T02:11:00.281 INFO:teuthology.orchestra.run.smithi119.stdout: liboath-2.6.7-2.el9.x86_64 2023-09-13T02:11:00.282 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-09-13T02:11:00.282 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath-11.4.1-2.1.el9.x86_64 2023-09-13T02:11:00.282 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-09-13T02:11:00.282 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.283 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.283 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-09-13T02:11:00.283 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.283 INFO:teuthology.orchestra.run.smithi119.stdout: libtool-2.4.6-45.el9.x86_64 2023-09-13T02:11:00.284 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind-1.6.2-1.el9.x86_64 2023-09-13T02:11:00.284 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-09-13T02:11:00.284 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-09-13T02:11:00.284 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-09-13T02:11:00.284 INFO:teuthology.orchestra.run.smithi119.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-09-13T02:11:00.285 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-0.3.21-2.el9.x86_64 2023-09-13T02:11:00.285 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-09-13T02:11:00.285 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-09-13T02:11:00.286 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-09-13T02:11:00.286 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-13.11-1.el9.x86_64 2023-09-13T02:11:00.286 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-09-13T02:11:00.286 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-09-13T02:11:00.287 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server-13.11-1.el9.x86_64 2023-09-13T02:11:00.287 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-09-13T02:11:00.287 INFO:teuthology.orchestra.run.smithi119.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-09-13T02:11:00.287 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel-2.9.1-2.el9.noarch 2023-09-13T02:11:00.287 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-09-13T02:11:00.288 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-09-13T02:11:00.288 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.288 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.288 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.288 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-09-13T02:11:00.289 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-09-13T02:11:00.289 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-09-13T02:11:00.289 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-09-13T02:11:00.290 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-09-13T02:11:00.290 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-09-13T02:11:00.290 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth-1:2.22.0-1.el9.noarch 2023-09-13T02:11:00.290 INFO:teuthology.orchestra.run.smithi119.stdout: python3-iniconfig-1.1.1-7.el9.noarch 2023-09-13T02:11:00.291 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-09-13T02:11:00.291 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-09-13T02:11:00.291 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-09-13T02:11:00.291 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-09-13T02:11:00.291 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-09-13T02:11:00.292 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-09-13T02:11:00.292 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-09-13T02:11:00.292 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-09-13T02:11:00.292 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-09-13T02:11:00.292 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-09-13T02:11:00.293 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-09-13T02:11:00.293 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-09-13T02:11:00.293 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako-1.1.4-6.el9.noarch 2023-09-13T02:11:00.293 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-09-13T02:11:00.293 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-09-13T02:11:00.294 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-09-13T02:11:00.294 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-09-13T02:11:00.294 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-09-13T02:11:00.294 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-09-13T02:11:00.294 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging-20.9-5.el9.noarch 2023-09-13T02:11:00.295 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-09-13T02:11:00.295 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pluggy-0.13.1-7.el9.noarch 2023-09-13T02:11:00.295 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply-3.11-14.el9.noarch 2023-09-13T02:11:00.295 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend-3.1.0-2.el9.noarch 2023-09-13T02:11:00.295 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-09-13T02:11:00.296 INFO:teuthology.orchestra.run.smithi119.stdout: python3-py-1.10.0-6.el9.noarch 2023-09-13T02:11:00.296 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-09-13T02:11:00.296 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-09-13T02:11:00.296 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-09-13T02:11:00.296 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser-2.20-6.el9.noarch 2023-09-13T02:11:00.297 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytest-6.2.2-6.el9.noarch 2023-09-13T02:11:00.297 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz-2021.1-5.el9.noarch 2023-09-13T02:11:00.297 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.297 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.297 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-09-13T02:11:00.298 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-2.25.1-7.el9.noarch 2023-09-13T02:11:00.298 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-09-13T02:11:00.298 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.298 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes-2.5.1-5.el9.noarch 2023-09-13T02:11:00.298 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa-4.9-2.el9.noarch 2023-09-13T02:11:00.299 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-09-13T02:11:00.299 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-09-13T02:11:00.299 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml-0.10.2-6.el9.noarch 2023-09-13T02:11:00.299 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-09-13T02:11:00.299 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-09-13T02:11:00.299 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob-1.8.7-6.el9.noarch 2023-09-13T02:11:00.300 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-09-13T02:11:00.300 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-09-13T02:11:00.300 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-09-13T02:11:00.300 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.300 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.301 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:00.301 INFO:teuthology.orchestra.run.smithi119.stdout: re2-1:20211101-3.el9.x86_64 2023-09-13T02:11:00.301 INFO:teuthology.orchestra.run.smithi119.stdout: socat-1.7.4.1-5.el9.x86_64 2023-09-13T02:11:00.301 INFO:teuthology.orchestra.run.smithi119.stdout: thrift-0.15.0-2.el9.x86_64 2023-09-13T02:11:00.301 INFO:teuthology.orchestra.run.smithi119.stdout: uuid-1.6.2-55.el9.x86_64 2023-09-13T02:11:00.302 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-09-13T02:11:00.302 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-09-13T02:11:00.302 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-09-13T02:11:00.302 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:00.302 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-09-13T02:11:00.623 DEBUG:teuthology.parallel:result is None 2023-09-13T02:11:02.034 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6088.g2110e007.el9.x86_64 109/151 2023-09-13T02:11:02.035 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /sys 2023-09-13T02:11:02.035 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /proc 2023-09-13T02:11:02.035 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /mnt 2023-09-13T02:11:02.035 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /var/tmp 2023-09-13T02:11:02.035 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /home 2023-09-13T02:11:02.036 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /root 2023-09-13T02:11:02.036 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /tmp 2023-09-13T02:11:02.036 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:02.194 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-volume-2:18.0.0-6088.g2110e007.el9.noarch 110/151 2023-09-13T02:11:02.209 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-volume-2:18.0.0-6088.g2110e007.el9.noarch 110/151 2023-09-13T02:11:02.209 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:11:02.210 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-09-13T02:11:02.210 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:03.756 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-osd-2:18.0.0-6088.g2110e007.el9.x86_64 111/151 2023-09-13T02:11:03.781 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-osd-2:18.0.0-6088.g2110e007.el9.x86_64 111/151 2023-09-13T02:11:03.781 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:11:03.781 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-09-13T02:11:03.781 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-09-13T02:11:03.781 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-09-13T02:11:03.782 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:03.989 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mds-2:18.0.0-6088.g2110e007.el9.x86_64 112/151 2023-09-13T02:11:04.011 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mds-2:18.0.0-6088.g2110e007.el9.x86_64 112/151 2023-09-13T02:11:04.011 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:11:04.012 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-09-13T02:11:04.012 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-09-13T02:11:04.012 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-09-13T02:11:04.012 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:04.456 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mon-2:18.0.0-6088.g2110e007.el9.x86_64 113/151 2023-09-13T02:11:04.479 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mon-2:18.0.0-6088.g2110e007.el9.x86_64 113/151 2023-09-13T02:11:04.479 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:11:04.479 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-09-13T02:11:04.479 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-09-13T02:11:04.480 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-09-13T02:11:04.480 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:04.887 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephadm-2:18.0.0-6088.g2110e007.el9.noarch 114/151 2023-09-13T02:11:04.914 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephadm-2:18.0.0-6088.g2110e007.el9.noarch 114/151 2023-09-13T02:11:04.942 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6088.g2110e007.e 115/151 2023-09-13T02:11:05.004 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6088.g2110e007. 116/151 2023-09-13T02:11:05.029 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6088.g2110e007.el9.noa 117/151 2023-09-13T02:11:05.248 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6088.g2110e007.el9.noa 117/151 2023-09-13T02:11:05.279 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6088.g2110e007.el9.n 118/151 2023-09-13T02:11:06.233 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6088.g2110e007.el9.n 118/151 2023-09-13T02:11:06.263 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6088.g211 119/151 2023-09-13T02:11:06.362 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6088.g211 119/151 2023-09-13T02:11:06.518 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6088.g2110e007.el 120/151 2023-09-13T02:11:06.548 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-2:18.0.0-6088.g2110e007.el9.x86_64 121/151 2023-09-13T02:11:06.571 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6088.g2110e007.el9.x86_64 121/151 2023-09-13T02:11:06.571 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:11:06.571 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-09-13T02:11:06.572 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-09-13T02:11:06.572 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-09-13T02:11:06.572 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:06.615 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-rook-2:18.0.0-6088.g2110e007.el9.noarch 122/151 2023-09-13T02:11:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6088.g2110e007.el9.noarch 122/151 2023-09-13T02:11:07.375 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-2:18.0.0-6088.g2110e007.el9.x86_64 123/151 2023-09-13T02:11:07.400 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-radosgw-2:18.0.0-6088.g2110e007.el9.x86_64 124/151 2023-09-13T02:11:07.422 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6088.g2110e007.el9.x86_64 124/151 2023-09-13T02:11:07.422 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:11:07.422 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-09-13T02:11:07.423 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-09-13T02:11:07.423 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-09-13T02:11:07.423 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:07.467 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6088.g2110e 125/151 2023-09-13T02:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6088.g2110e 125/151 2023-09-13T02:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-09-13T02:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:07.534 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-mirror-2:18.0.0-6088.g2110e007.el9.x86_64 126/151 2023-09-13T02:11:07.556 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6088.g2110e007.el9.x86_64 126/151 2023-09-13T02:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-09-13T02:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-09-13T02:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-09-13T02:11:07.558 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:07.860 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-mirror-2:18.0.0-6088.g2110e007.el9.x86_64 127/151 2023-09-13T02:11:07.882 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6088.g2110e007.el9.x86_64 127/151 2023-09-13T02:11:07.882 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-13T02:11:07.882 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-09-13T02:11:07.882 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-09-13T02:11:07.883 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-09-13T02:11:07.883 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:11.646 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-test-2:18.0.0-6088.g2110e007.el9.x86_64 128/151 2023-09-13T02:11:11.686 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-fuse-2:18.0.0-6088.g2110e007.el9.x86_64 129/151 2023-09-13T02:11:11.717 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-nbd-2:18.0.0-6088.g2110e007.el9.x86_64 130/151 2023-09-13T02:11:11.837 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 131/151 2023-09-13T02:11:12.034 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pytest-6.2.2-6.el9.noarch 132/151 2023-09-13T02:11:12.149 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/151 2023-09-13T02:11:12.202 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-fuse-2:18.0.0-6088.g2110e007.el9.x86_64 134/151 2023-09-13T02:11:12.243 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libtool-2.4.6-45.el9.x86_64 135/151 2023-09-13T02:11:12.276 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 136/151 2023-09-13T02:11:12.299 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs-devel-2:18.0.0-6088.g2110e007.el9.x86_ 137/151 2023-09-13T02:11:12.328 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-team-1:1.45.2-1.el9.x86_64 138/151 2023-09-13T02:11:12.366 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-tui-1:1.45.2-1.el9.x86_64 139/151 2023-09-13T02:11:13.008 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 140/151 2023-09-13T02:11:13.048 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 140/151 2023-09-13T02:11:13.067 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 140/151 2023-09-13T02:11:13.883 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-top-2:18.0.0-6088.g2110e007.el9.noarch 141/151 2023-09-13T02:11:13.959 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 142/151 2023-09-13T02:11:14.006 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 143/151 2023-09-13T02:11:14.096 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flex-2.6.4-9.el9.x86_64 144/151 2023-09-13T02:11:14.129 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : bison-3.7.4-5.el9.x86_64 145/151 2023-09-13T02:11:14.155 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/151 2023-09-13T02:11:14.155 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 147/151 2023-09-13T02:11:14.239 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 147/151 2023-09-13T02:11:14.264 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 148/151 2023-09-13T02:11:14.274 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/151 2023-09-13T02:11:14.274 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 149/151 2023-09-13T02:11:14.458 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/151 2023-09-13T02:11:14.458 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/151 2023-09-13T02:11:14.533 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/151 2023-09-13T02:11:14.533 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 151/151 2023-09-13T02:11:19.055 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 151/151 2023-09-13T02:11:19.055 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-2:18.0.0-6088.g2110e007.el9.x86_64 1/151 2023-09-13T02:11:19.056 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-base-2:18.0.0-6088.g2110e007.el9.x86_64 2/151 2023-09-13T02:11:19.056 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-common-2:18.0.0-6088.g2110e007.el9.x86_64 3/151 2023-09-13T02:11:19.056 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-fuse-2:18.0.0-6088.g2110e007.el9.x86_64 4/151 2023-09-13T02:11:19.056 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6088.g2110e 5/151 2023-09-13T02:11:19.056 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mds-2:18.0.0-6088.g2110e007.el9.x86_64 6/151 2023-09-13T02:11:19.057 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-2:18.0.0-6088.g2110e007.el9.x86_64 7/151 2023-09-13T02:11:19.057 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mon-2:18.0.0-6088.g2110e007.el9.x86_64 8/151 2023-09-13T02:11:19.057 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-osd-2:18.0.0-6088.g2110e007.el9.x86_64 9/151 2023-09-13T02:11:19.057 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-radosgw-2:18.0.0-6088.g2110e007.el9.x86_64 10/151 2023-09-13T02:11:19.057 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-selinux-2:18.0.0-6088.g2110e007.el9.x86_64 11/151 2023-09-13T02:11:19.058 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-test-2:18.0.0-6088.g2110e007.el9.x86_64 12/151 2023-09-13T02:11:19.058 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-mirror-2:18.0.0-6088.g2110e007.el9.x86_64 13/151 2023-09-13T02:11:19.058 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs-devel-2:18.0.0-6088.g2110e007.el9.x86_ 14/151 2023-09-13T02:11:19.058 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs2-2:18.0.0-6088.g2110e007.el9.x86_64 15/151 2023-09-13T02:11:19.058 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephsqlite-2:18.0.0-6088.g2110e007.el9.x86_64 16/151 2023-09-13T02:11:19.059 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados-devel-2:18.0.0-6088.g2110e007.el9.x86_6 17/151 2023-09-13T02:11:19.059 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libradosstriper1-2:18.0.0-6088.g2110e007.el9.x86 18/151 2023-09-13T02:11:19.059 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librgw2-2:18.0.0-6088.g2110e007.el9.x86_64 19/151 2023-09-13T02:11:19.059 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6088.g2110e007.el 20/151 2023-09-13T02:11:19.059 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-common-2:18.0.0-6088.g2110e007.el9. 21/151 2023-09-13T02:11:19.060 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cephfs-2:18.0.0-6088.g2110e007.el9.x86_6 22/151 2023-09-13T02:11:19.060 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rados-2:18.0.0-6088.g2110e007.el9.x86_64 23/151 2023-09-13T02:11:19.060 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rbd-2:18.0.0-6088.g2110e007.el9.x86_64 24/151 2023-09-13T02:11:19.060 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rgw-2:18.0.0-6088.g2110e007.el9.x86_64 25/151 2023-09-13T02:11:19.071 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-fuse-2:18.0.0-6088.g2110e007.el9.x86_64 26/151 2023-09-13T02:11:19.071 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-mirror-2:18.0.0-6088.g2110e007.el9.x86_64 27/151 2023-09-13T02:11:19.071 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-nbd-2:18.0.0-6088.g2110e007.el9.x86_64 28/151 2023-09-13T02:11:19.072 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6088.g2110e007. 29/151 2023-09-13T02:11:19.072 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6088.g2110e007.el9.noa 30/151 2023-09-13T02:11:19.072 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6088.g2110e007.el9.n 31/151 2023-09-13T02:11:19.072 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6088.g211 32/151 2023-09-13T02:11:19.072 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6088.g2110e007.el 33/151 2023-09-13T02:11:19.072 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6088.g2110e007.el9.noarch 34/151 2023-09-13T02:11:19.073 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6088.g2110e007.e 35/151 2023-09-13T02:11:19.073 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-volume-2:18.0.0-6088.g2110e007.el9.noarch 36/151 2023-09-13T02:11:19.073 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephadm-2:18.0.0-6088.g2110e007.el9.noarch 37/151 2023-09-13T02:11:19.073 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-top-2:18.0.0-6088.g2110e007.el9.noarch 38/151 2023-09-13T02:11:19.073 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/151 2023-09-13T02:11:19.074 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/151 2023-09-13T02:11:19.074 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/151 2023-09-13T02:11:19.074 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/151 2023-09-13T02:11:19.074 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/151 2023-09-13T02:11:19.074 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/151 2023-09-13T02:11:19.075 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/151 2023-09-13T02:11:19.075 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/151 2023-09-13T02:11:19.075 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/151 2023-09-13T02:11:19.075 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/151 2023-09-13T02:11:19.075 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/151 2023-09-13T02:11:19.076 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/151 2023-09-13T02:11:19.076 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/151 2023-09-13T02:11:19.076 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/151 2023-09-13T02:11:19.076 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/151 2023-09-13T02:11:19.076 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/151 2023-09-13T02:11:19.077 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/151 2023-09-13T02:11:19.077 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/151 2023-09-13T02:11:19.077 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/151 2023-09-13T02:11:19.077 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 58/151 2023-09-13T02:11:19.077 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 59/151 2023-09-13T02:11:19.078 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 60/151 2023-09-13T02:11:19.078 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-iniconfig-1.1.1-7.el9.noarch 61/151 2023-09-13T02:11:19.078 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 62/151 2023-09-13T02:11:19.078 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 63/151 2023-09-13T02:11:19.078 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 64/151 2023-09-13T02:11:19.079 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 65/151 2023-09-13T02:11:19.079 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 66/151 2023-09-13T02:11:19.079 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 67/151 2023-09-13T02:11:19.079 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 68/151 2023-09-13T02:11:19.079 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 69/151 2023-09-13T02:11:19.080 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 70/151 2023-09-13T02:11:19.080 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pluggy-0.13.1-7.el9.noarch 71/151 2023-09-13T02:11:19.080 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/151 2023-09-13T02:11:19.080 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-py-1.10.0-6.el9.noarch 73/151 2023-09-13T02:11:19.080 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/151 2023-09-13T02:11:19.081 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/151 2023-09-13T02:11:19.081 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pytest-6.2.2-6.el9.noarch 76/151 2023-09-13T02:11:19.081 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/151 2023-09-13T02:11:19.081 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/151 2023-09-13T02:11:19.081 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/151 2023-09-13T02:11:19.082 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/151 2023-09-13T02:11:19.082 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/151 2023-09-13T02:11:19.082 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/151 2023-09-13T02:11:19.082 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 83/151 2023-09-13T02:11:19.082 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 84/151 2023-09-13T02:11:19.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ply-3.11-14.el9.noarch 85/151 2023-09-13T02:11:19.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 86/151 2023-09-13T02:11:19.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 87/151 2023-09-13T02:11:19.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 88/151 2023-09-13T02:11:19.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libgfortran-11.4.1-2.1.el9.x86_64 89/151 2023-09-13T02:11:19.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libquadmath-11.4.1-2.1.el9.x86_64 90/151 2023-09-13T02:11:19.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/151 2023-09-13T02:11:19.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : automake-1.16.2-8.el9.noarch 92/151 2023-09-13T02:11:19.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 93/151 2023-09-13T02:11:19.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : jq-1.6-15.el9.x86_64 94/151 2023-09-13T02:11:19.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 95/151 2023-09-13T02:11:19.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 96/151 2023-09-13T02:11:19.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 97/151 2023-09-13T02:11:19.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 98/151 2023-09-13T02:11:19.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 99/151 2023-09-13T02:11:19.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 100/151 2023-09-13T02:11:19.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 101/151 2023-09-13T02:11:19.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 102/151 2023-09-13T02:11:19.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 103/151 2023-09-13T02:11:19.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 104/151 2023-09-13T02:11:19.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 105/151 2023-09-13T02:11:19.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 106/151 2023-09-13T02:11:19.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 107/151 2023-09-13T02:11:19.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 108/151 2023-09-13T02:11:19.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 109/151 2023-09-13T02:11:19.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 110/151 2023-09-13T02:11:19.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 111/151 2023-09-13T02:11:19.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 112/151 2023-09-13T02:11:19.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 113/151 2023-09-13T02:11:19.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-google-auth-1:2.22.0-1.el9.noarch 114/151 2023-09-13T02:11:19.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 115/151 2023-09-13T02:11:19.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 116/151 2023-09-13T02:11:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 117/151 2023-09-13T02:11:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 118/151 2023-09-13T02:11:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 119/151 2023-09-13T02:11:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 120/151 2023-09-13T02:11:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 121/151 2023-09-13T02:11:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 122/151 2023-09-13T02:11:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 123/151 2023-09-13T02:11:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 124/151 2023-09-13T02:11:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 125/151 2023-09-13T02:11:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 126/151 2023-09-13T02:11:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 127/151 2023-09-13T02:11:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 128/151 2023-09-13T02:11:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/151 2023-09-13T02:11:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/151 2023-09-13T02:11:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/151 2023-09-13T02:11:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/151 2023-09-13T02:11:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/151 2023-09-13T02:11:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/151 2023-09-13T02:11:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/151 2023-09-13T02:11:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/151 2023-09-13T02:11:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/151 2023-09-13T02:11:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/151 2023-09-13T02:11:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/151 2023-09-13T02:11:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:18.0.0-6088.g2110e007.el9.x86_64 140/151 2023-09-13T02:11:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/151 2023-09-13T02:11:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:18.0.0-6088.g2110e007.el9.x86_64 142/151 2023-09-13T02:11:19.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/151 2023-09-13T02:11:19.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-1:1.45.2-1.el9.x86_64 144/151 2023-09-13T02:11:19.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 145/151 2023-09-13T02:11:19.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-libnm-1:1.45.2-1.el9.x86_64 146/151 2023-09-13T02:11:19.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 147/151 2023-09-13T02:11:19.095 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-team-1:1.45.2-1.el9.x86_64 148/151 2023-09-13T02:11:19.095 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 149/151 2023-09-13T02:11:19.095 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-tui-1:1.45.2-1.el9.x86_64 150/151 2023-09-13T02:11:21.733 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 151/151 2023-09-13T02:11:21.734 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:21.734 INFO:teuthology.orchestra.run.smithi104.stdout:Upgraded: 2023-09-13T02:11:21.734 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-1:1.45.2-1.el9.x86_64 2023-09-13T02:11:21.734 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-libnm-1:1.45.2-1.el9.x86_64 2023-09-13T02:11:21.735 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-team-1:1.45.2-1.el9.x86_64 2023-09-13T02:11:21.735 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-tui-1:1.45.2-1.el9.x86_64 2023-09-13T02:11:21.735 INFO:teuthology.orchestra.run.smithi104.stdout: librados2-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.735 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.735 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2023-09-13T02:11:21.736 INFO:teuthology.orchestra.run.smithi104.stdout: automake-1.16.2-8.el9.noarch 2023-09-13T02:11:21.736 INFO:teuthology.orchestra.run.smithi104.stdout: bison-3.7.4-5.el9.x86_64 2023-09-13T02:11:21.736 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-09-13T02:11:21.736 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.736 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.737 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.737 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.737 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:21.737 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.738 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.738 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.738 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:21.738 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:21.738 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:21.739 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:21.739 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:21.739 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.739 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.739 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:21.740 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.740 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.740 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.740 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:21.740 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:21.741 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-mirror-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.741 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-top-2:18.0.0-6088.g2110e007.el9.noarch 2023-09-13T02:11:21.741 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-09-13T02:11:21.741 INFO:teuthology.orchestra.run.smithi104.stdout: flex-2.6.4-9.el9.x86_64 2023-09-13T02:11:21.741 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-09-13T02:11:21.742 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-09-13T02:11:21.742 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-09-13T02:11:21.742 INFO:teuthology.orchestra.run.smithi104.stdout: fmt-8.1.1-5.el9.x86_64 2023-09-13T02:11:21.742 INFO:teuthology.orchestra.run.smithi104.stdout: fuse-2.9.9-15.el9.x86_64 2023-09-13T02:11:21.742 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-09-13T02:11:21.743 INFO:teuthology.orchestra.run.smithi104.stdout: jq-1.6-15.el9.x86_64 2023-09-13T02:11:21.743 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-09-13T02:11:21.743 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-9.0.0-9.el9.x86_64 2023-09-13T02:11:21.743 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-09-13T02:11:21.743 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.744 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.744 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.744 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran-11.4.1-2.1.el9.x86_64 2023-09-13T02:11:21.744 INFO:teuthology.orchestra.run.smithi104.stdout: liboath-2.6.7-2.el9.x86_64 2023-09-13T02:11:21.744 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-09-13T02:11:21.745 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath-11.4.1-2.1.el9.x86_64 2023-09-13T02:11:21.745 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-09-13T02:11:21.745 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.745 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.745 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-09-13T02:11:21.746 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.746 INFO:teuthology.orchestra.run.smithi104.stdout: libtool-2.4.6-45.el9.x86_64 2023-09-13T02:11:21.746 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind-1.6.2-1.el9.x86_64 2023-09-13T02:11:21.746 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-09-13T02:11:21.747 INFO:teuthology.orchestra.run.smithi104.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-09-13T02:11:21.747 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-09-13T02:11:21.747 INFO:teuthology.orchestra.run.smithi104.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-09-13T02:11:21.747 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-0.3.21-2.el9.x86_64 2023-09-13T02:11:21.747 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-09-13T02:11:21.747 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-09-13T02:11:21.748 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-09-13T02:11:21.748 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-13.11-1.el9.x86_64 2023-09-13T02:11:21.748 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-09-13T02:11:21.748 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-09-13T02:11:21.748 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-server-13.11-1.el9.x86_64 2023-09-13T02:11:21.749 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-09-13T02:11:21.749 INFO:teuthology.orchestra.run.smithi104.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-09-13T02:11:21.749 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel-2.9.1-2.el9.noarch 2023-09-13T02:11:21.749 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-09-13T02:11:21.749 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-09-13T02:11:21.750 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.750 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.750 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.750 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-09-13T02:11:21.750 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-09-13T02:11:21.751 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-09-13T02:11:21.751 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-09-13T02:11:21.751 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-09-13T02:11:21.751 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-09-13T02:11:21.751 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth-1:2.22.0-1.el9.noarch 2023-09-13T02:11:21.752 INFO:teuthology.orchestra.run.smithi104.stdout: python3-iniconfig-1.1.1-7.el9.noarch 2023-09-13T02:11:21.752 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-09-13T02:11:21.752 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-09-13T02:11:21.752 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-09-13T02:11:21.752 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-09-13T02:11:21.753 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-09-13T02:11:21.753 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-09-13T02:11:21.753 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-09-13T02:11:21.753 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-09-13T02:11:21.753 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-09-13T02:11:21.754 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-09-13T02:11:21.754 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-09-13T02:11:21.754 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-09-13T02:11:21.754 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako-1.1.4-6.el9.noarch 2023-09-13T02:11:21.754 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-09-13T02:11:21.755 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-09-13T02:11:21.755 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-09-13T02:11:21.755 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-09-13T02:11:21.755 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-09-13T02:11:21.755 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-09-13T02:11:21.756 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging-20.9-5.el9.noarch 2023-09-13T02:11:21.756 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-09-13T02:11:21.756 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pluggy-0.13.1-7.el9.noarch 2023-09-13T02:11:21.756 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply-3.11-14.el9.noarch 2023-09-13T02:11:21.756 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend-3.1.0-2.el9.noarch 2023-09-13T02:11:21.756 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-09-13T02:11:21.757 INFO:teuthology.orchestra.run.smithi104.stdout: python3-py-1.10.0-6.el9.noarch 2023-09-13T02:11:21.757 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-09-13T02:11:21.757 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-09-13T02:11:21.757 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-09-13T02:11:21.757 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser-2.20-6.el9.noarch 2023-09-13T02:11:21.758 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytest-6.2.2-6.el9.noarch 2023-09-13T02:11:21.758 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz-2021.1-5.el9.noarch 2023-09-13T02:11:21.758 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.758 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.758 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-09-13T02:11:21.759 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-2.25.1-7.el9.noarch 2023-09-13T02:11:21.759 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-09-13T02:11:21.759 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.759 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes-2.5.1-5.el9.noarch 2023-09-13T02:11:21.759 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa-4.9-2.el9.noarch 2023-09-13T02:11:21.760 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-09-13T02:11:21.760 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-09-13T02:11:21.760 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml-0.10.2-6.el9.noarch 2023-09-13T02:11:21.760 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-09-13T02:11:21.760 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-09-13T02:11:21.761 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob-1.8.7-6.el9.noarch 2023-09-13T02:11:21.761 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-09-13T02:11:21.761 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-09-13T02:11:21.761 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-09-13T02:11:21.761 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.762 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.762 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd-2:18.0.0-6088.g2110e007.el9.x86_64 2023-09-13T02:11:21.762 INFO:teuthology.orchestra.run.smithi104.stdout: re2-1:20211101-3.el9.x86_64 2023-09-13T02:11:21.762 INFO:teuthology.orchestra.run.smithi104.stdout: socat-1.7.4.1-5.el9.x86_64 2023-09-13T02:11:21.762 INFO:teuthology.orchestra.run.smithi104.stdout: thrift-0.15.0-2.el9.x86_64 2023-09-13T02:11:21.762 INFO:teuthology.orchestra.run.smithi104.stdout: uuid-1.6.2-55.el9.x86_64 2023-09-13T02:11:21.763 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-09-13T02:11:21.763 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-09-13T02:11:21.763 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-09-13T02:11:21.764 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:21.764 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2023-09-13T02:11:22.083 DEBUG:teuthology.parallel:result is None 2023-09-13T02:11:22.084 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2110e00747b31a0d73768c9e5229da18b26b8aa0 2023-09-13T02:11:22.228 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-13T02:11:22.249 INFO:teuthology.orchestra.run.smithi104.stdout:18.0.0-6088.g2110e007.el9 2023-09-13T02:11:22.250 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6088.g2110e007.el9 2023-09-13T02:11:22.250 INFO:teuthology.task.install:The correct ceph version 18.0.0-6088.g2110e007 is installed. 2023-09-13T02:11:22.251 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2110e00747b31a0d73768c9e5229da18b26b8aa0 2023-09-13T02:11:22.391 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-13T02:11:22.416 INFO:teuthology.orchestra.run.smithi119.stdout:18.0.0-6088.g2110e007.el9 2023-09-13T02:11:22.417 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6088.g2110e007.el9 2023-09-13T02:11:22.417 INFO:teuthology.task.install:The correct ceph version 18.0.0-6088.g2110e007 is installed. 2023-09-13T02:11:22.418 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-13T02:11:22.418 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:22.418 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-13T02:11:22.449 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:11:22.450 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-13T02:11:22.491 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-13T02:11:22.491 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:22.492 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/daemon-helper 2023-09-13T02:11:22.518 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-13T02:11:22.585 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:11:22.586 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2023-09-13T02:11:22.616 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-13T02:11:22.685 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-13T02:11:22.686 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:22.686 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-13T02:11:22.713 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-13T02:11:22.780 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:11:22.781 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-13T02:11:22.810 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-13T02:11:22.878 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-13T02:11:22.878 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:22.878 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/stdin-killer 2023-09-13T02:11:22.905 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-13T02:11:22.970 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:11:22.971 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2023-09-13T02:11:22.999 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-13T02:11:23.067 INFO:teuthology.run_tasks:Running task ceph... 2023-09-13T02:11:23.133 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-13T02:11:23.134 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 777 /var/log/ceph 2023-09-13T02:11:23.136 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /var/log/ceph 2023-09-13T02:11:23.163 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-13T02:11:23.164 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-13T02:11:23.203 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-13T02:11:23.230 INFO:tasks.ceph:Creating extra log directories... 2023-09-13T02:11:23.230 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-13T02:11:23.269 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-13T02:11:23.304 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-09-13T02:11:23.305 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-09-13T02:11:23.305 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-09-13T02:11:23.305 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:23.306 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-13T02:11:23.348 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-13T02:11:23.465 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-13T02:11:23.491 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:11:23.492 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-13T02:11:23.507 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-13T02:11:23.625 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-13T02:11:23.663 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-13T02:11:23.663 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-13T02:11:23.664 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395228', 'branch': 'wip-batrick-testing-20230912.122437', 'description': 'fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7395228', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20230912.122437'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'disabled': True}, 'install': {'ceph': {'extra_system_packages': {'deb': ['python3-pytest'], 'rpm': ['python3-pytest']}, 'flavor': 'default', 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0'}}, 'kclient': {'disabled': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20230912.122437', 'sha1': '3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 9684, 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0', 'sleep_before_teardown': 0, 'subset': '236/256', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20230912.122437', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': '3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi104.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKuQ/0LipsdT8eZcYRT8/ja79YLlkHp0ISoVAfz0fiD4/ik40V9DG7dDEPYltC0Axq4hXPXvvKyzcnXfGoLn/qI=', 'smithi119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLvm45jl5lLd1bnFw9AbofDjpFQ7TaYZ7PxHiJUzszOYx89jnE/xvpxFdpFkvcr0pAUFeoMQTK+RR2ZqG4+au38='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'python3-pytest'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'python3-pytest']}, 'flavor': 'default', 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['fs/test_python.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-12_14:07:50', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1394'} 2023-09-13T02:11:23.666 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-13T02:11:23.669 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-13T02:11:23.706 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/run/ceph 2023-09-13T02:11:23.723 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/run/ceph 2023-09-13T02:11:23.772 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:23.773 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/scratch_devs of=/dev/stdout 2023-09-13T02:11:23.801 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-13T02:11:23.802 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_1 2023-09-13T02:11:23.856 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-13T02:11:23.857 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T02:11:23.857 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-09-13T02:11:23.857 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T02:11:23.857 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T02:11:23.858 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2023-09-13 02:11:14.982771930 +0000 2023-09-13T02:11:23.858 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2023-09-13 02:08:51.345327870 +0000 2023-09-13T02:11:23.858 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2023-09-13 02:08:51.345327870 +0000 2023-09-13T02:11:23.858 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2023-09-13 02:08:51.345327870 +0000 2023-09-13T02:11:23.859 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-13T02:11:23.922 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2023-09-13T02:11:23.922 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2023-09-13T02:11:23.922 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000184448 s, 2.8 MB/s 2023-09-13T02:11:23.923 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-13T02:11:23.979 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_2 2023-09-13T02:11:24.033 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-13T02:11:24.033 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T02:11:24.033 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-09-13T02:11:24.033 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T02:11:24.034 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T02:11:24.034 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2023-09-13 02:11:14.982771930 +0000 2023-09-13T02:11:24.034 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2023-09-13 02:08:51.850322315 +0000 2023-09-13T02:11:24.034 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2023-09-13 02:08:51.850322315 +0000 2023-09-13T02:11:24.035 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2023-09-13 02:08:51.850322315 +0000 2023-09-13T02:11:24.035 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-13T02:11:24.098 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2023-09-13T02:11:24.099 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2023-09-13T02:11:24.099 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.00020301 s, 2.5 MB/s 2023-09-13T02:11:24.100 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-13T02:11:24.155 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_3 2023-09-13T02:11:24.209 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-13T02:11:24.209 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T02:11:24.209 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 701 Links: 1 2023-09-13T02:11:24.210 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T02:11:24.210 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T02:11:24.210 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2023-09-13 02:11:14.983771919 +0000 2023-09-13T02:11:24.210 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2023-09-13 02:08:52.345316870 +0000 2023-09-13T02:11:24.210 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2023-09-13 02:08:52.345316870 +0000 2023-09-13T02:11:24.211 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2023-09-13 02:08:52.345316870 +0000 2023-09-13T02:11:24.211 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-13T02:11:24.275 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2023-09-13T02:11:24.275 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2023-09-13T02:11:24.275 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000183216 s, 2.8 MB/s 2023-09-13T02:11:24.276 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-13T02:11:24.332 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_4 2023-09-13T02:11:24.386 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-13T02:11:24.386 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T02:11:24.386 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-09-13T02:11:24.387 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T02:11:24.387 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T02:11:24.387 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2023-09-13 02:11:14.983771919 +0000 2023-09-13T02:11:24.387 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2023-09-13 02:08:52.845311370 +0000 2023-09-13T02:11:24.387 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2023-09-13 02:08:52.845311370 +0000 2023-09-13T02:11:24.388 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2023-09-13 02:08:52.845311370 +0000 2023-09-13T02:11:24.388 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-13T02:11:24.450 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2023-09-13T02:11:24.451 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2023-09-13T02:11:24.451 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000190479 s, 2.7 MB/s 2023-09-13T02:11:24.452 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-13T02:11:24.508 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-13T02:11:24.508 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:11:24.509 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2023-09-13T02:11:24.525 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-13T02:11:24.525 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2023-09-13T02:11:24.580 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-13T02:11:24.580 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T02:11:24.581 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-09-13T02:11:24.581 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T02:11:24.581 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T02:11:24.581 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-09-13 02:10:53.386954177 +0000 2023-09-13T02:11:24.582 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-09-13 02:08:51.350282887 +0000 2023-09-13T02:11:24.582 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-09-13 02:08:51.350282887 +0000 2023-09-13T02:11:24.582 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2023-09-13 02:08:51.350282887 +0000 2023-09-13T02:11:24.582 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-13T02:11:24.646 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-09-13T02:11:24.646 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-09-13T02:11:24.646 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000199599 s, 2.6 MB/s 2023-09-13T02:11:24.647 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-13T02:11:24.703 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2023-09-13T02:11:24.758 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-13T02:11:24.758 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T02:11:24.758 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 684 Links: 1 2023-09-13T02:11:24.759 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T02:11:24.759 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T02:11:24.759 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-09-13 02:10:53.386954177 +0000 2023-09-13T02:11:24.759 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-09-13 02:08:51.877270842 +0000 2023-09-13T02:11:24.759 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-09-13 02:08:51.877270842 +0000 2023-09-13T02:11:24.760 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2023-09-13 02:08:51.877270842 +0000 2023-09-13T02:11:24.760 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-13T02:11:24.824 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-09-13T02:11:24.824 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-09-13T02:11:24.825 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000233753 s, 2.2 MB/s 2023-09-13T02:11:24.826 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-13T02:11:24.882 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2023-09-13T02:11:24.937 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-13T02:11:24.937 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T02:11:24.937 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 701 Links: 1 2023-09-13T02:11:24.938 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T02:11:24.938 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T02:11:24.938 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-09-13 02:10:53.386954177 +0000 2023-09-13T02:11:24.938 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-09-13 02:08:52.366259667 +0000 2023-09-13T02:11:24.938 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-09-13 02:08:52.366259667 +0000 2023-09-13T02:11:24.939 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2023-09-13 02:08:52.366259667 +0000 2023-09-13T02:11:24.939 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-13T02:11:25.003 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-09-13T02:11:25.003 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-09-13T02:11:25.003 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000203469 s, 2.5 MB/s 2023-09-13T02:11:25.004 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-13T02:11:25.059 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2023-09-13T02:11:25.113 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-13T02:11:25.114 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T02:11:25.114 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-09-13T02:11:25.114 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T02:11:25.114 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T02:11:25.114 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-09-13 02:10:53.387954155 +0000 2023-09-13T02:11:25.115 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-09-13 02:08:52.838248880 +0000 2023-09-13T02:11:25.115 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-09-13 02:08:52.838248880 +0000 2023-09-13T02:11:25.115 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2023-09-13 02:08:52.838248880 +0000 2023-09-13T02:11:25.115 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-13T02:11:25.178 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-09-13T02:11:25.179 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-09-13T02:11:25.179 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000163 s, 3.1 MB/s 2023-09-13T02:11:25.180 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-13T02:11:25.235 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-13T02:11:25.236 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-13T02:11:25.236 INFO:tasks.ceph:Generating config... 2023-09-13T02:11:25.237 INFO:tasks.ceph:[client] pid file = 2023-09-13T02:11:25.237 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-13T02:11:25.238 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-13T02:11:25.238 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-13T02:11:25.238 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-13T02:11:25.238 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-13T02:11:25.239 INFO:tasks.ceph:[osd] bdev async discard = True 2023-09-13T02:11:25.239 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-09-13T02:11:25.239 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-09-13T02:11:25.239 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-13T02:11:25.240 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-13T02:11:25.240 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-09-13T02:11:25.240 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-09-13T02:11:25.240 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-13T02:11:25.241 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-13T02:11:25.241 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-09-13T02:11:25.241 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-13T02:11:25.242 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-13T02:11:25.242 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-13T02:11:25.243 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-13T02:11:25.243 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-13T02:11:25.243 INFO:tasks.ceph:Setting up mon.a... 2023-09-13T02:11:25.244 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-13T02:11:25.291 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.keyring 2023-09-13T02:11:25.293 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-13T02:11:25.337 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-13T02:11:25.404 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.104'), ('mon.b', '172.21.15.119'), ('mon.c', '[v2:172.21.15.119:3301,v1:172.21.15.119:6790]')] 2023-09-13T02:11:25.405 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.104,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}} 2023-09-13T02:11:25.406 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:25.406 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-13T02:11:25.459 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.104 --add b 172.21.15.119 --addv c '[v2:172.21.15.119:3301,v1:172.21.15.119:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-09-13T02:11:25.543 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-13T02:11:25.543 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: generated fsid ac1f5a95-0d3a-406e-b4ca-c8ea43282cab 2023-09-13T02:11:25.543 INFO:teuthology.orchestra.run.smithi104.stdout:setting min_mon_release = pacific 2023-09-13T02:11:25.543 INFO:teuthology.orchestra.run.smithi104.stdout:epoch 0 2023-09-13T02:11:25.544 INFO:teuthology.orchestra.run.smithi104.stdout:fsid ac1f5a95-0d3a-406e-b4ca-c8ea43282cab 2023-09-13T02:11:25.544 INFO:teuthology.orchestra.run.smithi104.stdout:last_changed 2023-09-13T02:11:25.543562+0000 2023-09-13T02:11:25.544 INFO:teuthology.orchestra.run.smithi104.stdout:created 2023-09-13T02:11:25.543562+0000 2023-09-13T02:11:25.544 INFO:teuthology.orchestra.run.smithi104.stdout:min_mon_release 16 (pacific) 2023-09-13T02:11:25.544 INFO:teuthology.orchestra.run.smithi104.stdout:election_strategy: 1 2023-09-13T02:11:25.545 INFO:teuthology.orchestra.run.smithi104.stdout:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2023-09-13T02:11:25.545 INFO:teuthology.orchestra.run.smithi104.stdout:1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.b 2023-09-13T02:11:25.545 INFO:teuthology.orchestra.run.smithi104.stdout:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2023-09-13T02:11:25.545 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-13T02:11:25.547 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-13T02:11:25.561 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ac1f5a95-0d3a-406e-b4ca-c8ea43282cab... 2023-09-13T02:11:25.562 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-13T02:11:25.604 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-13T02:11:25.651 INFO:teuthology.orchestra.run.smithi104.stdout:[global] 2023-09-13T02:11:25.651 INFO:teuthology.orchestra.run.smithi104.stdout: chdir = "" 2023-09-13T02:11:25.651 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-13T02:11:25.652 INFO:teuthology.orchestra.run.smithi104.stdout: auth supported = cephx 2023-09-13T02:11:25.652 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.652 INFO:teuthology.orchestra.run.smithi104.stdout: filestore xattr use omap = true 2023-09-13T02:11:25.652 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.652 INFO:teuthology.orchestra.run.smithi104.stdout: mon clock drift allowed = 1.000 2023-09-13T02:11:25.653 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.653 INFO:teuthology.orchestra.run.smithi104.stdout: osd crush chooseleaf type = 0 2023-09-13T02:11:25.653 INFO:teuthology.orchestra.run.smithi104.stdout: auth debug = true 2023-09-13T02:11:25.653 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.653 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on old message = true 2023-09-13T02:11:25.654 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on bug = true 2023-09-13T02:11:25.654 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.654 INFO:teuthology.orchestra.run.smithi104.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-13T02:11:25.654 INFO:teuthology.orchestra.run.smithi104.stdout: mon pg warn max object skew = 0 2023-09-13T02:11:25.654 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.655 INFO:teuthology.orchestra.run.smithi104.stdout: # disable pg_autoscaler by default for new pools 2023-09-13T02:11:25.655 INFO:teuthology.orchestra.run.smithi104.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-13T02:11:25.655 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.655 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default size = 2 2023-09-13T02:11:25.655 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.656 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow primary affinity = true 2023-09-13T02:11:25.656 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow pg remap = true 2023-09-13T02:11:25.656 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on legacy crush tunables = false 2023-09-13T02:11:25.656 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on crush straw calc version zero = false 2023-09-13T02:11:25.656 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on no sortbitwise = false 2023-09-13T02:11:25.657 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on osd down out interval zero = false 2023-09-13T02:11:25.657 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on too few osds = false 2023-09-13T02:11:25.657 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-13T02:11:25.657 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-13T02:11:25.657 INFO:teuthology.orchestra.run.smithi104.stdout: mon_allow_pool_size_one = true 2023-09-13T02:11:25.658 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.658 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-13T02:11:25.658 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.658 INFO:teuthology.orchestra.run.smithi104.stdout: osd default data pool replay window = 5 2023-09-13T02:11:25.659 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.659 INFO:teuthology.orchestra.run.smithi104.stdout: mon allow pool delete = true 2023-09-13T02:11:25.660 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.661 INFO:teuthology.orchestra.run.smithi104.stdout: mon cluster log file level = debug 2023-09-13T02:11:25.661 INFO:teuthology.orchestra.run.smithi104.stdout: debug asserts on shutdown = true 2023-09-13T02:11:25.661 INFO:teuthology.orchestra.run.smithi104.stdout: mon health detail to clog = false 2023-09-13T02:11:25.661 INFO:teuthology.orchestra.run.smithi104.stdout: mon host = "172.21.15.104,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2023-09-13T02:11:25.662 INFO:teuthology.orchestra.run.smithi104.stdout: fsid = ac1f5a95-0d3a-406e-b4ca-c8ea43282cab 2023-09-13T02:11:25.662 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.662 INFO:teuthology.orchestra.run.smithi104.stdout:[osd] 2023-09-13T02:11:25.662 INFO:teuthology.orchestra.run.smithi104.stdout: osd journal size = 100 2023-09-13T02:11:25.662 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.663 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub load threshold = 5.0 2023-09-13T02:11:25.663 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub max interval = 600 2023-09-13T02:11:25.663 INFO:teuthology.orchestra.run.smithi104.stdout: osd mclock profile = high_recovery_ops 2023-09-13T02:11:25.663 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.663 INFO:teuthology.orchestra.run.smithi104.stdout: osd recover clone overlap = true 2023-09-13T02:11:25.664 INFO:teuthology.orchestra.run.smithi104.stdout: osd recovery max chunk = 1048576 2023-09-13T02:11:25.664 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.664 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug shutdown = true 2023-09-13T02:11:25.664 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug op order = true 2023-09-13T02:11:25.664 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug verify stray on activate = true 2023-09-13T02:11:25.664 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.665 INFO:teuthology.orchestra.run.smithi104.stdout: osd open classes on start = true 2023-09-13T02:11:25.665 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug pg log writeout = true 2023-09-13T02:11:25.665 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.665 INFO:teuthology.orchestra.run.smithi104.stdout: osd deep scrub update digest min age = 30 2023-09-13T02:11:25.665 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.666 INFO:teuthology.orchestra.run.smithi104.stdout: osd map max advance = 10 2023-09-13T02:11:25.666 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.666 INFO:teuthology.orchestra.run.smithi104.stdout: journal zero on create = true 2023-09-13T02:11:25.666 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.666 INFO:teuthology.orchestra.run.smithi104.stdout: filestore ondisk finisher threads = 3 2023-09-13T02:11:25.667 INFO:teuthology.orchestra.run.smithi104.stdout: filestore apply finisher threads = 3 2023-09-13T02:11:25.667 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.667 INFO:teuthology.orchestra.run.smithi104.stdout: bdev debug aio = true 2023-09-13T02:11:25.667 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug misdirected ops = true 2023-09-13T02:11:25.667 INFO:teuthology.orchestra.run.smithi104.stdout: bdev async discard = True 2023-09-13T02:11:25.667 INFO:teuthology.orchestra.run.smithi104.stdout: bdev enable discard = True 2023-09-13T02:11:25.668 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore allocator = bitmap 2023-09-13T02:11:25.668 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore block size = 96636764160 2023-09-13T02:11:25.668 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore fsck on mount = True 2023-09-13T02:11:25.668 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluefs = 1/20 2023-09-13T02:11:25.668 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluestore = 1/20 2023-09-13T02:11:25.669 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2023-09-13T02:11:25.669 INFO:teuthology.orchestra.run.smithi104.stdout: debug osd = 20 2023-09-13T02:11:25.669 INFO:teuthology.orchestra.run.smithi104.stdout: debug rocksdb = 4/10 2023-09-13T02:11:25.669 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd backfillfull_ratio = 0.85 2023-09-13T02:11:25.669 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd full ratio = 0.9 2023-09-13T02:11:25.670 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd nearfull ratio = 0.8 2023-09-13T02:11:25.670 INFO:teuthology.orchestra.run.smithi104.stdout: osd failsafe full ratio = 0.95 2023-09-13T02:11:25.670 INFO:teuthology.orchestra.run.smithi104.stdout: osd objectstore = bluestore 2023-09-13T02:11:25.670 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.670 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr] 2023-09-13T02:11:25.671 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2023-09-13T02:11:25.671 INFO:teuthology.orchestra.run.smithi104.stdout: debug mgr = 20 2023-09-13T02:11:25.671 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2023-09-13T02:11:25.671 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2023-09-13T02:11:25.671 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2023-09-13T02:11:25.671 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2023-09-13T02:11:25.672 INFO:teuthology.orchestra.run.smithi104.stdout: mgr/telemetry/nag = false 2023-09-13T02:11:25.672 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.672 INFO:teuthology.orchestra.run.smithi104.stdout:[mon] 2023-09-13T02:11:25.672 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2023-09-13T02:11:25.672 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2023-09-13T02:11:25.673 INFO:teuthology.orchestra.run.smithi104.stdout: debug paxos = 20 2023-09-13T02:11:25.673 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2023-09-13T02:11:25.673 INFO:teuthology.orchestra.run.smithi104.stdout: mon data avail warn = 5 2023-09-13T02:11:25.673 INFO:teuthology.orchestra.run.smithi104.stdout: mon mgr mkfs grace = 240 2023-09-13T02:11:25.673 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2023-09-13T02:11:25.673 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd reporter subtree level = osd 2023-09-13T02:11:25.674 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd prime pg temp = true 2023-09-13T02:11:25.674 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2023-09-13T02:11:25.674 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.674 INFO:teuthology.orchestra.run.smithi104.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-13T02:11:25.674 INFO:teuthology.orchestra.run.smithi104.stdout: auth mon ticket ttl = 660 # 11m 2023-09-13T02:11:25.675 INFO:teuthology.orchestra.run.smithi104.stdout: auth service ticket ttl = 240 # 4m 2023-09-13T02:11:25.675 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.675 INFO:teuthology.orchestra.run.smithi104.stdout: # don't complain about insecure global_id in the test suite 2023-09-13T02:11:25.675 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-13T02:11:25.675 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-13T02:11:25.676 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.676 INFO:teuthology.orchestra.run.smithi104.stdout: # 1m isn't quite enough 2023-09-13T02:11:25.676 INFO:teuthology.orchestra.run.smithi104.stdout: mon_down_mkfs_grace = 2m 2023-09-13T02:11:25.676 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.676 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_filestore_osds = false 2023-09-13T02:11:25.676 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:11:25.677 INFO:teuthology.orchestra.run.smithi104.stdout:[client] 2023-09-13T02:11:25.677 INFO:teuthology.orchestra.run.smithi104.stdout: rgw cache enabled = true 2023-09-13T02:11:25.677 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable ops log = true 2023-09-13T02:11:25.677 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable usage log = true 2023-09-13T02:11:25.677 INFO:teuthology.orchestra.run.smithi104.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-13T02:11:25.677 INFO:teuthology.orchestra.run.smithi104.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-13T02:11:25.678 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = "" 2023-09-13T02:11:25.678 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.a] 2023-09-13T02:11:25.678 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.b] 2023-09-13T02:11:25.678 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.c] 2023-09-13T02:11:25.678 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.a] 2023-09-13T02:11:25.678 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.b] 2023-09-13T02:11:25.682 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2023-09-13T02:11:25.682 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2023-09-13T02:11:25.682 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-13T02:11:25.682 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2023-09-13T02:11:25.683 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.683 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2023-09-13T02:11:25.683 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.683 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2023-09-13T02:11:25.684 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.684 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2023-09-13T02:11:25.685 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2023-09-13T02:11:25.685 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.685 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2023-09-13T02:11:25.685 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2023-09-13T02:11:25.685 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.685 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-13T02:11:25.686 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2023-09-13T02:11:25.686 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.686 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2023-09-13T02:11:25.686 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-13T02:11:25.686 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.687 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2023-09-13T02:11:25.687 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.687 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2023-09-13T02:11:25.687 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2023-09-13T02:11:25.687 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2023-09-13T02:11:25.688 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2023-09-13T02:11:25.688 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2023-09-13T02:11:25.688 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2023-09-13T02:11:25.688 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2023-09-13T02:11:25.688 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-13T02:11:25.688 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-13T02:11:25.689 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2023-09-13T02:11:25.689 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.689 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-13T02:11:25.689 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.689 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2023-09-13T02:11:25.690 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.690 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2023-09-13T02:11:25.690 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.690 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2023-09-13T02:11:25.690 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2023-09-13T02:11:25.691 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2023-09-13T02:11:25.691 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.104,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2023-09-13T02:11:25.691 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = ac1f5a95-0d3a-406e-b4ca-c8ea43282cab 2023-09-13T02:11:25.691 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.691 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2023-09-13T02:11:25.692 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2023-09-13T02:11:25.692 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.692 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2023-09-13T02:11:25.692 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2023-09-13T02:11:25.692 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2023-09-13T02:11:25.692 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.693 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2023-09-13T02:11:25.693 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2023-09-13T02:11:25.693 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.693 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2023-09-13T02:11:25.693 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2023-09-13T02:11:25.694 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2023-09-13T02:11:25.694 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.694 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2023-09-13T02:11:25.694 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2023-09-13T02:11:25.694 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.695 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2023-09-13T02:11:25.695 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.695 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2023-09-13T02:11:25.695 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.695 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2023-09-13T02:11:25.695 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.696 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2023-09-13T02:11:25.696 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2023-09-13T02:11:25.696 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.696 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2023-09-13T02:11:25.696 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2023-09-13T02:11:25.697 INFO:teuthology.orchestra.run.smithi119.stdout: bdev async discard = True 2023-09-13T02:11:25.697 INFO:teuthology.orchestra.run.smithi119.stdout: bdev enable discard = True 2023-09-13T02:11:25.697 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore allocator = bitmap 2023-09-13T02:11:25.697 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2023-09-13T02:11:25.697 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2023-09-13T02:11:25.697 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 1/20 2023-09-13T02:11:25.698 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 1/20 2023-09-13T02:11:25.698 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-09-13T02:11:25.698 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2023-09-13T02:11:25.698 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 4/10 2023-09-13T02:11:25.698 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2023-09-13T02:11:25.699 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2023-09-13T02:11:25.699 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2023-09-13T02:11:25.699 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2023-09-13T02:11:25.699 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2023-09-13T02:11:25.699 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.699 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2023-09-13T02:11:25.700 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-09-13T02:11:25.700 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2023-09-13T02:11:25.700 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2023-09-13T02:11:25.700 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2023-09-13T02:11:25.700 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2023-09-13T02:11:25.701 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2023-09-13T02:11:25.701 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2023-09-13T02:11:25.701 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.701 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2023-09-13T02:11:25.701 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-09-13T02:11:25.702 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2023-09-13T02:11:25.702 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2023-09-13T02:11:25.702 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2023-09-13T02:11:25.702 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2023-09-13T02:11:25.702 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2023-09-13T02:11:25.702 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2023-09-13T02:11:25.703 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2023-09-13T02:11:25.703 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2023-09-13T02:11:25.703 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2023-09-13T02:11:25.703 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.703 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-13T02:11:25.704 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2023-09-13T02:11:25.704 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2023-09-13T02:11:25.704 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.704 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2023-09-13T02:11:25.704 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-13T02:11:25.705 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-13T02:11:25.705 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.705 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2023-09-13T02:11:25.705 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2023-09-13T02:11:25.705 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.705 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2023-09-13T02:11:25.706 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-09-13T02:11:25.706 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2023-09-13T02:11:25.706 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2023-09-13T02:11:25.706 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2023-09-13T02:11:25.706 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2023-09-13T02:11:25.707 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-13T02:11:25.707 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-13T02:11:25.707 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = "" 2023-09-13T02:11:25.707 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2023-09-13T02:11:25.707 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2023-09-13T02:11:25.707 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2023-09-13T02:11:25.708 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2023-09-13T02:11:25.708 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2023-09-13T02:11:25.708 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-13T02:11:25.708 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-13T02:11:25.776 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-13T02:11:25.776 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:25.777 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-13T02:11:25.791 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:25.791 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-13T02:11:25.846 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi104.front.sepia.ceph.com 2023-09-13T02:11:25.846 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:25.847 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-13T02:11:25.848 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-13T02:11:25.927 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:25.927 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-13T02:11:25.981 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi119.front.sepia.ceph.com 2023-09-13T02:11:25.982 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:11:25.982 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-13T02:11:25.982 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-13T02:11:26.021 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:11:26.021 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-13T02:11:26.076 INFO:tasks.ceph:Setting up mon nodes... 2023-09-13T02:11:26.076 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-13T02:11:26.077 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-09-13T02:11:26.131 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-09-13T02:11:26.133 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-13T02:11:26.193 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-13T02:11:26.197 INFO:tasks.ceph:Setting up mds nodes... 2023-09-13T02:11:26.197 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-13T02:11:26.251 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-13T02:11:26.254 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-13T02:11:26.280 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-09-13T02:11:26.334 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-09-13T02:11:26.336 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-09-13T02:11:26.362 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-13T02:11:26.363 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-13T02:11:26.404 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-13T02:11:26.419 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-13T02:11:26.419 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-13T02:11:26.420 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-13T02:11:26.485 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-13T02:11:26.486 INFO:tasks.ceph:role: osd.0 2023-09-13T02:11:26.486 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com 2023-09-13T02:11:26.487 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-13T02:11:26.560 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T02:11:26.560 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T02:11:26.560 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T02:11:26.560 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-09-13T02:11:26.561 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T02:11:26.561 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2023-09-13T02:11:26.561 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T02:11:26.561 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-09-13T02:11:26.561 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T02:11:26.562 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T02:11:27.052 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2023-09-13T02:11:27.054 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2023-09-13T02:11:27.055 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-13T02:11:27.214 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-13T02:11:27.249 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-13T02:11:27.317 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-13T02:11:27.317 INFO:tasks.ceph:role: osd.1 2023-09-13T02:11:27.317 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com 2023-09-13T02:11:27.318 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-13T02:11:27.391 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T02:11:27.391 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T02:11:27.391 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T02:11:27.392 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-09-13T02:11:27.392 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T02:11:27.392 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2023-09-13T02:11:27.392 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T02:11:27.392 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-09-13T02:11:27.393 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T02:11:27.393 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T02:11:27.847 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2023-09-13T02:11:27.849 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2023-09-13T02:11:27.849 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-13T02:11:27.943 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-13T02:11:27.975 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-13T02:11:28.041 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-13T02:11:28.042 INFO:tasks.ceph:role: osd.2 2023-09-13T02:11:28.042 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi104.front.sepia.ceph.com 2023-09-13T02:11:28.042 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-13T02:11:28.116 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T02:11:28.116 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T02:11:28.116 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T02:11:28.116 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-09-13T02:11:28.117 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T02:11:28.117 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2023-09-13T02:11:28.117 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T02:11:28.117 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-09-13T02:11:28.117 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T02:11:28.118 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T02:11:28.599 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2023-09-13T02:11:28.601 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2023-09-13T02:11:28.601 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-13T02:11:28.750 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-13T02:11:28.782 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-13T02:11:28.850 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-13T02:11:28.850 INFO:tasks.ceph:role: osd.3 2023-09-13T02:11:28.851 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi104.front.sepia.ceph.com 2023-09-13T02:11:28.851 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-13T02:11:28.924 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T02:11:28.924 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T02:11:28.924 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T02:11:28.925 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-09-13T02:11:28.925 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T02:11:28.925 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2023-09-13T02:11:28.925 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T02:11:28.925 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-09-13T02:11:28.926 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T02:11:28.926 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T02:11:29.433 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2023-09-13T02:11:29.435 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2023-09-13T02:11:29.436 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-09-13T02:11:29.590 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-13T02:11:29.626 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T02:11:29.731 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:29.730+0000 7f1554d07500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-13T02:11:29.732 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:29.730+0000 7f1554d07500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-13T02:11:29.732 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:29.730+0000 7f1554d07500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-13T02:11:29.732 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:29.730+0000 7f1554d07500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-13T02:11:29.732 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:29.730+0000 7f1554d07500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-13T02:11:29.732 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:29.731+0000 7f1554d07500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-13T02:11:32.580 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-13T02:11:32.612 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T02:11:32.702 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:32.700+0000 7fd25c88c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-13T02:11:32.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:32.700+0000 7fd25c88c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-13T02:11:32.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:32.700+0000 7fd25c88c500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-13T02:11:32.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:32.700+0000 7fd25c88c500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-13T02:11:32.704 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:32.700+0000 7fd25c88c500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-13T02:11:32.704 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:32.701+0000 7fd25c88c500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-13T02:11:35.550 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-13T02:11:35.579 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T02:11:35.668 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:35.667+0000 7f361f81c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-13T02:11:35.669 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:35.667+0000 7f361f81c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-13T02:11:35.669 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:35.667+0000 7f361f81c500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-13T02:11:35.669 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:35.667+0000 7f361f81c500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-13T02:11:35.669 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:35.667+0000 7f361f81c500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-13T02:11:35.670 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:35.668+0000 7f361f81c500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-13T02:11:38.520 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-13T02:11:38.552 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T02:11:38.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:38.642+0000 7f608ab17500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-13T02:11:38.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:38.643+0000 7f608ab17500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-13T02:11:38.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:38.643+0000 7f608ab17500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-13T02:11:38.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:38.643+0000 7f608ab17500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-13T02:11:38.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:38.643+0000 7f608ab17500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-13T02:11:38.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:38.643+0000 7f608ab17500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-09-13T02:11:41.503 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-13T02:11:41.533 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-09-13T02:11:41.565 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-13T02:11:41.566 INFO:tasks.ceph:role: osd.4 2023-09-13T02:11:41.566 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com 2023-09-13T02:11:41.566 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-13T02:11:41.644 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T02:11:41.644 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T02:11:41.645 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T02:11:41.645 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-09-13T02:11:41.645 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T02:11:41.646 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2023-09-13T02:11:41.646 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T02:11:41.646 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-09-13T02:11:41.647 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T02:11:41.647 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T02:11:42.143 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2023-09-13T02:11:42.145 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2023-09-13T02:11:42.145 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-09-13T02:11:42.269 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-09-13T02:11:42.305 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-09-13T02:11:42.374 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-13T02:11:42.374 INFO:tasks.ceph:role: osd.5 2023-09-13T02:11:42.375 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com 2023-09-13T02:11:42.375 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-13T02:11:42.449 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T02:11:42.450 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T02:11:42.450 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T02:11:42.450 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-09-13T02:11:42.450 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T02:11:42.450 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2023-09-13T02:11:42.451 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T02:11:42.451 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-09-13T02:11:42.451 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T02:11:42.451 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T02:11:42.901 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2023-09-13T02:11:42.903 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2023-09-13T02:11:42.903 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-09-13T02:11:42.988 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-09-13T02:11:43.019 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-09-13T02:11:43.086 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-13T02:11:43.086 INFO:tasks.ceph:role: osd.6 2023-09-13T02:11:43.087 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com 2023-09-13T02:11:43.087 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-13T02:11:43.160 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T02:11:43.160 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T02:11:43.160 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T02:11:43.161 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-09-13T02:11:43.161 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T02:11:43.161 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2023-09-13T02:11:43.161 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T02:11:43.161 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-09-13T02:11:43.162 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T02:11:43.162 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T02:11:43.644 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2023-09-13T02:11:43.646 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2023-09-13T02:11:43.646 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-09-13T02:11:43.793 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-09-13T02:11:43.826 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-09-13T02:11:43.892 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-13T02:11:43.892 INFO:tasks.ceph:role: osd.7 2023-09-13T02:11:43.893 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com 2023-09-13T02:11:43.893 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-13T02:11:43.966 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T02:11:43.966 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T02:11:43.967 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T02:11:43.967 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-09-13T02:11:43.967 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T02:11:43.967 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2023-09-13T02:11:43.967 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T02:11:43.968 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-09-13T02:11:43.968 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T02:11:43.968 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T02:11:44.487 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2023-09-13T02:11:44.488 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2023-09-13T02:11:44.489 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-09-13T02:11:44.639 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-09-13T02:11:44.671 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T02:11:44.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:44.776+0000 7fb5fda0e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-09-13T02:11:44.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:44.776+0000 7fb5fda0e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-09-13T02:11:44.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:44.776+0000 7fb5fda0e500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-13T02:11:44.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:44.776+0000 7fb5fda0e500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-13T02:11:44.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:44.776+0000 7fb5fda0e500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-13T02:11:44.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:44.776+0000 7fb5fda0e500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-09-13T02:11:47.622 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-09-13T02:11:47.653 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T02:11:47.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:47.743+0000 7fcc3fb9f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-09-13T02:11:47.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:47.743+0000 7fcc3fb9f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-09-13T02:11:47.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:47.743+0000 7fcc3fb9f500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-13T02:11:47.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:47.743+0000 7fcc3fb9f500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-13T02:11:47.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:47.743+0000 7fcc3fb9f500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-13T02:11:47.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:47.744+0000 7fcc3fb9f500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-09-13T02:11:50.591 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-09-13T02:11:50.623 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T02:11:50.713 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:50.712+0000 7f4169a0c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-09-13T02:11:50.713 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:50.712+0000 7f4169a0c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-09-13T02:11:50.713 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:50.712+0000 7f4169a0c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-13T02:11:50.714 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:50.712+0000 7f4169a0c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-13T02:11:50.714 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:50.712+0000 7f4169a0c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-13T02:11:50.714 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:50.712+0000 7f4169a0c500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-09-13T02:11:53.564 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-09-13T02:11:53.594 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T02:11:53.667 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:11:53.670 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:11:53.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:53.685+0000 7fb10a614500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-09-13T02:11:53.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:53.685+0000 7fb10a614500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-09-13T02:11:53.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:53.685+0000 7fb10a614500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-13T02:11:53.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:53.685+0000 7fb10a614500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-13T02:11:53.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:53.685+0000 7fb10a614500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-13T02:11:53.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:11:53.686+0000 7fb10a614500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-09-13T02:11:56.546 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-09-13T02:11:56.578 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-13T02:11:56.578 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:56.579 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-09-13T02:11:56.611 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:56.611 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-13T02:11:56.683 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:56.683 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-13T02:11:56.753 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:56.754 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-13T02:11:56.823 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:56.824 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-13T02:11:56.893 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:56.893 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-13T02:11:56.961 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:11:56.961 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-13T02:11:56.993 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:11:56.993 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-09-13T02:11:57.063 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:11:57.063 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-09-13T02:11:57.133 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:11:57.134 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-09-13T02:11:57.202 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:11:57.203 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-09-13T02:11:57.271 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:11:57.271 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-09-13T02:11:57.338 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:11:57.339 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-13T02:11:57.356 INFO:tasks.ceph:Adding keys to all mons... 2023-09-13T02:11:57.357 DEBUG:teuthology.orchestra.run.smithi104:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-13T02:11:57.399 DEBUG:teuthology.orchestra.run.smithi119:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-13T02:11:57.425 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.y] 2023-09-13T02:11:57.425 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBOGgFlWYnYBxAAArWRxQGYuoKax/nfYF45jA== 2023-09-13T02:11:57.426 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2023-09-13T02:11:57.426 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBOGgFldMsIDxAAoZs+Xv0eYtb4JujarFIGOA== 2023-09-13T02:11:57.426 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.0] 2023-09-13T02:11:57.426 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBRGgFlZJ+bKxAAW1RaDtwDGZLYD3oASLS6gw== 2023-09-13T02:11:57.426 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.1] 2023-09-13T02:11:57.427 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBUGgFlwbHYKRAAkN26Ey9OoIukXWoCVBr+Kg== 2023-09-13T02:11:57.427 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.2] 2023-09-13T02:11:57.427 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBXGgFlIAPgJxAAJj3ZonVO1fiu39exGNuYDQ== 2023-09-13T02:11:57.427 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.3] 2023-09-13T02:11:57.428 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBaGgFldk9mJhAAqC0vYmGmneMKBIWNRQdL+g== 2023-09-13T02:11:57.428 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.x] 2023-09-13T02:11:57.428 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBOGgFl7jGUCxAAHE/eyolyrSEvxHsDjPItAw== 2023-09-13T02:11:57.428 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2023-09-13T02:11:57.428 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBOGgFlSjz3ExAASTH15N8D6HMYf7H1x0iptQ== 2023-09-13T02:11:57.429 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.4] 2023-09-13T02:11:57.429 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBgGgFlyjZRLhAAmIXRovOdokz9ZUCj3JF04A== 2023-09-13T02:11:57.429 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.5] 2023-09-13T02:11:57.429 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBjGgFlBlNcLBAA4GlkaVSF44Z99limN19c0w== 2023-09-13T02:11:57.430 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.6] 2023-09-13T02:11:57.430 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBmGgFlGemCKhAAr96HrDDccwEt54+N+hkgpw== 2023-09-13T02:11:57.430 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.7] 2023-09-13T02:11:57.430 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBpGgFl5lroKBAAvaD9mG/WmA5Qnc7+FfxCyw== 2023-09-13T02:11:57.430 INFO:teuthology.orchestra.run.smithi119.stdout:[client.0] 2023-09-13T02:11:57.431 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBOGgFlJNQnGBAAcsQLniOGEpIq5iM9W0qS+w== 2023-09-13T02:11:57.432 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.y] 2023-09-13T02:11:57.432 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBOGgFlWYnYBxAAArWRxQGYuoKax/nfYF45jA== 2023-09-13T02:11:57.433 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.a] 2023-09-13T02:11:57.433 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBOGgFldMsIDxAAoZs+Xv0eYtb4JujarFIGOA== 2023-09-13T02:11:57.433 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.0] 2023-09-13T02:11:57.433 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBRGgFlZJ+bKxAAW1RaDtwDGZLYD3oASLS6gw== 2023-09-13T02:11:57.433 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.1] 2023-09-13T02:11:57.434 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBUGgFlwbHYKRAAkN26Ey9OoIukXWoCVBr+Kg== 2023-09-13T02:11:57.434 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.2] 2023-09-13T02:11:57.434 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBXGgFlIAPgJxAAJj3ZonVO1fiu39exGNuYDQ== 2023-09-13T02:11:57.434 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.3] 2023-09-13T02:11:57.434 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBaGgFldk9mJhAAqC0vYmGmneMKBIWNRQdL+g== 2023-09-13T02:11:57.435 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.x] 2023-09-13T02:11:57.435 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBOGgFl7jGUCxAAHE/eyolyrSEvxHsDjPItAw== 2023-09-13T02:11:57.435 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.b] 2023-09-13T02:11:57.435 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBOGgFlSjz3ExAASTH15N8D6HMYf7H1x0iptQ== 2023-09-13T02:11:57.435 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.4] 2023-09-13T02:11:57.436 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBgGgFlyjZRLhAAmIXRovOdokz9ZUCj3JF04A== 2023-09-13T02:11:57.436 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.5] 2023-09-13T02:11:57.436 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBjGgFlBlNcLBAA4GlkaVSF44Z99limN19c0w== 2023-09-13T02:11:57.436 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.6] 2023-09-13T02:11:57.436 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBmGgFlGemCKhAAr96HrDDccwEt54+N+hkgpw== 2023-09-13T02:11:57.436 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.7] 2023-09-13T02:11:57.437 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBpGgFl5lroKBAAvaD9mG/WmA5Qnc7+FfxCyw== 2023-09-13T02:11:57.437 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2023-09-13T02:11:57.437 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBOGgFlJNQnGBAAcsQLniOGEpIq5iM9W0qS+w== 2023-09-13T02:11:57.437 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-13T02:11:57.475 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-13T02:11:57.529 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T02:11:57.532 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T02:11:57.586 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T02:11:57.589 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T02:11:57.639 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T02:11:57.641 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T02:11:57.693 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T02:11:57.696 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T02:11:57.747 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T02:11:57.749 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T02:11:57.800 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-13T02:11:57.803 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-13T02:11:57.853 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T02:11:57.855 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T02:11:57.909 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T02:11:57.911 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T02:11:57.962 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T02:11:57.965 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T02:11:58.015 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T02:11:58.018 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T02:11:58.070 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T02:11:58.072 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T02:11:58.123 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T02:11:58.125 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T02:11:58.178 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-13T02:11:58.179 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-13T02:11:58.205 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-13T02:11:58.302 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-13T02:11:58.328 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-13T02:11:58.356 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-13T02:11:58.451 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-13T02:11:58.478 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-13T02:11:58.545 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-13T02:11:58.641 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-13T02:11:58.667 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-13T02:11:58.670 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-13T02:11:58.721 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-13T02:11:58.722 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-13T02:11:58.723 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-13T02:11:58.725 INFO:tasks.ceph.mon.a:Started 2023-09-13T02:11:58.725 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-13T02:11:58.725 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-13T02:11:58.763 INFO:tasks.ceph.mon.b:Started 2023-09-13T02:11:58.764 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-13T02:11:58.764 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-13T02:11:58.766 INFO:tasks.ceph.mon.c:Started 2023-09-13T02:11:58.767 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2023-09-13T02:11:58.767 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2023-09-13T02:11:58.769 INFO:tasks.ceph:setting config [client] debug_client = 20 2023-09-13T02:11:58.770 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set client debug_client 20 2023-09-13T02:11:58.813 INFO:tasks.ceph:setting config [client] debug_ms = 1 2023-09-13T02:11:58.813 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set client debug_ms 1 2023-09-13T02:11:58.857 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2023-09-13T02:11:58.857 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2023-09-13T02:11:58.899 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2023-09-13T02:11:58.900 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2023-09-13T02:11:58.943 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2023-09-13T02:11:58.943 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds debug_mds 20 2023-09-13T02:11:58.987 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2023-09-13T02:11:58.988 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2023-09-13T02:11:59.031 INFO:tasks.ceph:setting config [mds] debug_ms = 1 2023-09-13T02:11:59.031 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds debug_ms 1 2023-09-13T02:11:59.075 INFO:tasks.ceph:setting config [mds] mds_bal_fragment_size_max = 10000 2023-09-13T02:11:59.076 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds mds_bal_fragment_size_max 10000 2023-09-13T02:11:59.119 INFO:tasks.ceph:setting config [mds] mds_bal_merge_size = 5 2023-09-13T02:11:59.119 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds mds_bal_merge_size 5 2023-09-13T02:11:59.163 INFO:tasks.ceph:setting config [mds] mds_bal_split_bits = 3 2023-09-13T02:11:59.163 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds mds_bal_split_bits 3 2023-09-13T02:11:59.207 INFO:tasks.ceph:setting config [mds] mds_bal_split_size = 100 2023-09-13T02:11:59.207 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds mds_bal_split_size 100 2023-09-13T02:11:59.250 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2023-09-13T02:11:59.251 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2023-09-13T02:11:59.271 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.269+0000 7f96937fe640 1 -- 172.21.15.104:0/1842244301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f969c0052a0 msgr2=0x7f96b0136c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.271 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.269+0000 7f96937fe640 1 --2- 172.21.15.104:0/1842244301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f969c0052a0 0x7f96b0136c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f96ac00f7a0 tx=0x7f96ac00fc60 comp rx=0 tx=0).stop 2023-09-13T02:11:59.272 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2023-09-13T02:11:59.273 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2023-09-13T02:11:59.275 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.271+0000 7f96937fe640 1 -- 172.21.15.104:0/1842244301 shutdown_connections 2023-09-13T02:11:59.275 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.271+0000 7f96937fe640 1 --2- 172.21.15.104:0/1842244301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96b01da8b0 0x7f96b01d6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.275 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.271+0000 7f96937fe640 1 --2- 172.21.15.104:0/1842244301 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96b01371d0 0x7f96b01da370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.276 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.271+0000 7f96937fe640 1 --2- 172.21.15.104:0/1842244301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f969c0052a0 0x7f96b0136c90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.276 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.272+0000 7f96937fe640 1 -- 172.21.15.104:0/1842244301 >> 172.21.15.104:0/1842244301 conn(0x7f96b0069a30 msgr2=0x7f96b0138d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.276 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.272+0000 7f96937fe640 1 -- 172.21.15.104:0/1842244301 shutdown_connections 2023-09-13T02:11:59.277 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.272+0000 7f96937fe640 1 -- 172.21.15.104:0/1842244301 wait complete. 2023-09-13T02:11:59.277 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.273+0000 7f594b2d7640 1 -- 172.21.15.104:0/3290733209 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59440b2e60 msgr2=0x7f5944069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.278 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.273+0000 7f594b2d7640 1 --2- 172.21.15.104:0/3290733209 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59440b2e60 0x7f5944069560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f593c005fd0 tx=0x7f593c02c310 comp rx=0 tx=0).stop 2023-09-13T02:11:59.278 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.273+0000 7fd1e0bf5640 1 -- 172.21.15.104:0/1460639934 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) v1 -- 0x7fd1b40052d0 con 0x7fd1dc0afaf0 2023-09-13T02:11:59.279 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.278+0000 7f50e67fc640 1 -- 172.21.15.104:0/3099376358 <== mon.1 v2:172.21.15.119:3300/0 9 ==== config(3 keys) v1 ==== 85+0+0 (secure 0 0 0) 0x7f50e8005400 con 0x7f50f0139090 2023-09-13T02:11:59.280 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.277+0000 7f5c29ffb640 1 -- 172.21.15.104:0/2595490048 <== mon.0 v2:172.21.15.104:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v4)=0 v4) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5c24042030 con 0x7f5c340adff0 2023-09-13T02:11:59.280 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.277+0000 7f5c29ffb640 1 -- 172.21.15.104:0/2595490048 <== mon.0 v2:172.21.15.104:3300/0 10 ==== config(3 keys) v1 ==== 85+0+0 (secure 0 0 0) 0x7f5c24003ab0 con 0x7f5c340adff0 2023-09-13T02:11:59.281 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.277+0000 7f770e7fc640 1 -- 172.21.15.104:0/5493358 <== mon.1 v2:172.21.15.119:3300/0 9 ==== config(3 keys) v1 ==== 85+0+0 (secure 0 0 0) 0x7f77180c0870 con 0x7f7710035bf0 2023-09-13T02:11:59.281 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.274+0000 7f594b2d7640 1 -- 172.21.15.104:0/3290733209 shutdown_connections 2023-09-13T02:11:59.282 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.274+0000 7f594b2d7640 1 --2- 172.21.15.104:0/3290733209 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59440b2e60 0x7f5944069560 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.282 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.274+0000 7f594b2d7640 1 --2- 172.21.15.104:0/3290733209 >> v2:172.21.15.104:3300/0 conn(0x7f5944071650 0x7f59440acc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.283 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.274+0000 7f594b2d7640 1 -- 172.21.15.104:0/3290733209 >> 172.21.15.104:0/3290733209 conn(0x7f594406aa50 msgr2=0x7f59440b6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.283 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.274+0000 7f594b2d7640 1 -- 172.21.15.104:0/3290733209 shutdown_connections 2023-09-13T02:11:59.283 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.274+0000 7f594b2d7640 1 -- 172.21.15.104:0/3290733209 wait complete. 2023-09-13T02:11:59.283 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.276+0000 7f594b2d7640 1 Processor -- start 2023-09-13T02:11:59.284 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.276+0000 7f594b2d7640 1 -- start start 2023-09-13T02:11:59.284 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.276+0000 7f594b2d7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5944071650 0x7f594412ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.284 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.276+0000 7f594b2d7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59440b23c0 0x7f59440b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.285 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.277+0000 7f594b2d7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59440b2e60 0x7f59441fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.285 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.277+0000 7f594b2d7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59441362e0 con 0x7f59440b23c0 2023-09-13T02:11:59.286 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.277+0000 7f594b2d7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5944136830 con 0x7f59440b2e60 2023-09-13T02:11:59.286 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.277+0000 7f594b2d7640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59440b4ff0 con 0x7f5944071650 2023-09-13T02:11:59.287 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.279+0000 7fd1caffd640 1 -- 172.21.15.104:0/1460639934 <== mon.1 v2:172.21.15.119:3300/0 9 ==== config(3 keys) v1 ==== 85+0+0 (secure 0 0 0) 0x7fd1d0023ab0 con 0x7fd1dc0afaf0 2023-09-13T02:11:59.287 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.279+0000 7f5c3b75e640 1 -- 172.21.15.104:0/2595490048 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c340adff0 msgr2=0x7f5c3413a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.288 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.279+0000 7f5c3b75e640 1 --2- 172.21.15.104:0/2595490048 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c340adff0 0x7f5c3413a090 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400bbe0 tx=0x7f5c24004730 comp rx=0 tx=0).stop 2023-09-13T02:11:59.288 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.280+0000 7f5c3b75e640 1 -- 172.21.15.104:0/2595490048 shutdown_connections 2023-09-13T02:11:59.288 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.280+0000 7f5c3b75e640 1 --2- 172.21.15.104:0/2595490048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c341d4e20 0x7f5c34133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.289 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.280+0000 7f5c3b75e640 1 --2- 172.21.15.104:0/2595490048 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c340adff0 0x7f5c3413a090 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.289 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.280+0000 7f5c3b75e640 1 --2- 172.21.15.104:0/2595490048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c200047c0 0x7f5c341d8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.289 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.280+0000 7f5c3b75e640 1 -- 172.21.15.104:0/2595490048 >> 172.21.15.104:0/2595490048 conn(0x7f5c3406aa50 msgr2=0x7f5c340698d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.290 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.278+0000 7f9467fff640 1 -- 172.21.15.104:0/1428885151 <== mon.0 v2:172.21.15.104:3300/0 9 ==== config(3 keys) v1 ==== 85+0+0 (secure 0 0 0) 0x7f9474010d70 con 0x7f94800721b0 2023-09-13T02:11:59.291 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.278+0000 7f5948872640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59440b23c0 0x7f59440b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.291 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.278+0000 7f5948872640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59440b23c0 0x7f59440b4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38052/0 (socket says 172.21.15.104:38052) 2023-09-13T02:11:59.292 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.278+0000 7f5948872640 1 -- 172.21.15.104:0/3338597189 learned_addr learned my addr 172.21.15.104:0/3338597189 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:11:59.292 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.279+0000 7f5949874640 1 --2- 172.21.15.104:0/3338597189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59440b2e60 0x7f59441fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.292 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.279+0000 7f5949073640 1 --2- 172.21.15.104:0/3338597189 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5944071650 0x7f594412ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.292 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.280+0000 7f5949874640 1 -- 172.21.15.104:0/3338597189 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5944071650 msgr2=0x7f594412ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.293 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.280+0000 7f5949874640 1 --2- 172.21.15.104:0/3338597189 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5944071650 0x7f594412ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.293 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.280+0000 7f5949874640 1 -- 172.21.15.104:0/3338597189 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59440b23c0 msgr2=0x7f59440b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.293 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.280+0000 7f5949874640 1 --2- 172.21.15.104:0/3338597189 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59440b23c0 0x7f59440b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.294 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.280+0000 7f5949874640 1 -- 172.21.15.104:0/3338597189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c009900 con 0x7f59440b2e60 2023-09-13T02:11:59.295 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2023-09-13T02:11:59.295 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2023-09-13T02:11:59.297 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.280+0000 7f5949874640 1 --2- 172.21.15.104:0/3338597189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59440b2e60 0x7f59441fb2c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f594000c3f0 tx=0x7f594000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:11:59.297 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.280+0000 7f5939ffb640 1 -- 172.21.15.104:0/3338597189 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59400052d0 con 0x7f59440b2e60 2023-09-13T02:11:59.298 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.281+0000 7f5c3b75e640 1 -- 172.21.15.104:0/2595490048 shutdown_connections 2023-09-13T02:11:59.298 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.283+0000 7f5c3b75e640 1 -- 172.21.15.104:0/2595490048 wait complete. 2023-09-13T02:11:59.300 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.280+0000 7f5939ffb640 1 -- 172.21.15.104:0/3338597189 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(3 keys) v1 ==== 85+0+0 (secure 0 0 0) 0x7f5940005430 con 0x7f59440b2e60 2023-09-13T02:11:59.301 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.280+0000 7f5939ffb640 1 -- 172.21.15.104:0/3338597189 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5940007280 con 0x7f59440b2e60 2023-09-13T02:11:59.301 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.280+0000 7f594b2d7640 1 -- 172.21.15.104:0/3338597189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59441fb800 con 0x7f59440b2e60 2023-09-13T02:11:59.301 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.281+0000 7f594b2d7640 1 -- 172.21.15.104:0/3338597189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59440b5f90 con 0x7f59440b2e60 2023-09-13T02:11:59.302 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.282+0000 7f5939ffb640 1 -- 172.21.15.104:0/3338597189 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f59400067d0 con 0x7f59440b2e60 2023-09-13T02:11:59.302 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.282+0000 7f5939ffb640 1 -- 172.21.15.104:0/3338597189 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f59400038f0 con 0x7f59440b2e60 2023-09-13T02:11:59.302 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.282+0000 7f594b2d7640 1 -- 172.21.15.104:0/3338597189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59441369e0 con 0x7f59440b2e60 2023-09-13T02:11:59.303 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.286+0000 7f50f7d7d640 1 -- 172.21.15.104:0/3099376358 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) v1 -- 0x7f50cc0052b0 con 0x7f50f0139090 2023-09-13T02:11:59.304 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.291+0000 7fd1caffd640 1 -- 172.21.15.104:0/1460639934 <== mon.1 v2:172.21.15.119:3300/0 10 ==== config(4 keys) v1 ==== 116+0+0 (secure 0 0 0) 0x7fd1d0023ce0 con 0x7fd1dc0afaf0 2023-09-13T02:11:59.304 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.291+0000 7f50e67fc640 1 -- 172.21.15.104:0/3099376358 <== mon.1 v2:172.21.15.119:3300/0 10 ==== config(4 keys) v1 ==== 116+0+0 (secure 0 0 0) 0x7f50e8005570 con 0x7f50f0139090 2023-09-13T02:11:59.304 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.292+0000 7fd1caffd640 1 -- 172.21.15.104:0/1460639934 <== mon.1 v2:172.21.15.119:3300/0 11 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v5)=0 v5) v1 ==== 123+0+0 (secure 0 0 0) 0x7fd1d001a560 con 0x7fd1dc0afaf0 2023-09-13T02:11:59.305 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.292+0000 7f9467fff640 1 -- 172.21.15.104:0/1428885151 <== mon.0 v2:172.21.15.104:3300/0 10 ==== config(4 keys) v1 ==== 116+0+0 (secure 0 0 0) 0x7f9474010d70 con 0x7f94800721b0 2023-09-13T02:11:59.306 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.292+0000 7f770e7fc640 1 -- 172.21.15.104:0/5493358 <== mon.1 v2:172.21.15.119:3300/0 10 ==== config(4 keys) v1 ==== 116+0+0 (secure 0 0 0) 0x7f77180c09e0 con 0x7f7710035bf0 2023-09-13T02:11:59.306 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.295+0000 7fd1e0bf5640 1 -- 172.21.15.104:0/1460639934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1dc0afaf0 msgr2=0x7fd1dc06fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.307 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.295+0000 7fd1e0bf5640 1 --2- 172.21.15.104:0/1460639934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1dc0afaf0 0x7fd1dc06fbf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000df80 tx=0x7fd1d00039c0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.307 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.295+0000 7f5939ffb640 1 -- 172.21.15.104:0/3338597189 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f59441369e0 con 0x7f59440b2e60 2023-09-13T02:11:59.307 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.295+0000 7f5939ffb640 1 -- 172.21.15.104:0/3338597189 <== mon.1 v2:172.21.15.119:3300/0 7 ==== config(4 keys) v1 ==== 116+0+0 (secure 0 0 0) 0x7f5940006bc0 con 0x7f59440b2e60 2023-09-13T02:11:59.309 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.296+0000 7fd1e0bf5640 1 -- 172.21.15.104:0/1460639934 shutdown_connections 2023-09-13T02:11:59.310 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.296+0000 7fd1e0bf5640 1 --2- 172.21.15.104:0/1460639934 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1dc070130 0x7fd1dc138660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.310 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.296+0000 7fd1e0bf5640 1 --2- 172.21.15.104:0/1460639934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1dc0afaf0 0x7fd1dc06fbf0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.310 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.296+0000 7fd1e0bf5640 1 --2- 172.21.15.104:0/1460639934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd1c40051f0 0x7fd1dc0b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.311 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.296+0000 7fd1e0bf5640 1 -- 172.21.15.104:0/1460639934 >> 172.21.15.104:0/1460639934 conn(0x7fd1dc0b3380 msgr2=0x7fd1dc0b6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.311 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.299+0000 7fd1e0bf5640 1 -- 172.21.15.104:0/1460639934 shutdown_connections 2023-09-13T02:11:59.311 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.299+0000 7fd1e0bf5640 1 -- 172.21.15.104:0/1460639934 wait complete. 2023-09-13T02:11:59.312 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.301+0000 7f50e67fc640 1 -- 172.21.15.104:0/3099376358 <== mon.1 v2:172.21.15.119:3300/0 11 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f50e8049670 con 0x7f50f0139090 2023-09-13T02:11:59.312 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.302+0000 7f50e67fc640 1 -- 172.21.15.104:0/3099376358 <== mon.1 v2:172.21.15.119:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v6)=0 v6) v1 ==== 114+0+0 (secure 0 0 0) 0x7f50e8009a00 con 0x7f50f0139090 2023-09-13T02:11:59.314 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.303+0000 7f5939ffb640 1 -- 172.21.15.104:0/3338597189 <== mon.1 v2:172.21.15.119:3300/0 8 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5940006d30 con 0x7f59440b2e60 2023-09-13T02:11:59.314 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.304+0000 7f770e7fc640 1 -- 172.21.15.104:0/5493358 <== mon.1 v2:172.21.15.119:3300/0 11 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f77180b6970 con 0x7f7710035bf0 2023-09-13T02:11:59.315 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.303+0000 7f9467fff640 1 -- 172.21.15.104:0/1428885151 <== mon.0 v2:172.21.15.104:3300/0 11 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f947401b4f0 con 0x7f94800721b0 2023-09-13T02:11:59.318 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.308+0000 7f50f7d7d640 1 -- 172.21.15.104:0/3099376358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f0139090 msgr2=0x7f50f0139510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.318 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.308+0000 7f50f7d7d640 1 --2- 172.21.15.104:0/3099376358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f0139090 0x7f50f0139510 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f50f00b0a40 tx=0x7f50e8004ab0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.318 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.309+0000 7f50f7d7d640 1 -- 172.21.15.104:0/3099376358 shutdown_connections 2023-09-13T02:11:59.318 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.309+0000 7f50f7d7d640 1 --2- 172.21.15.104:0/3099376358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f0139090 0x7f50f0139510 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.319 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.309+0000 7f50f7d7d640 1 --2- 172.21.15.104:0/3099376358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50f013f120 0x7f50f013f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.319 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.309+0000 7f50f7d7d640 1 --2- 172.21.15.104:0/3099376358 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50dc0052a0 0x7f50f0144b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.319 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.309+0000 7f50f7d7d640 1 -- 172.21.15.104:0/3099376358 >> 172.21.15.104:0/3099376358 conn(0x7f50f00708b0 msgr2=0x7f50f013cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.319 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.309+0000 7f50f7d7d640 1 -- 172.21.15.104:0/3099376358 shutdown_connections 2023-09-13T02:11:59.319 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.309+0000 7f50f7d7d640 1 -- 172.21.15.104:0/3099376358 wait complete. 2023-09-13T02:11:59.320 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2023-09-13T02:11:59.320 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2023-09-13T02:11:59.328 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.328+0000 7f8630a02640 1 -- 172.21.15.104:0/536116700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86240d0030 msgr2=0x7f8624035be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.328 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.328+0000 7f8630a02640 1 --2- 172.21.15.104:0/536116700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86240d0030 0x7f8624035be0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f862c0772b0 tx=0x7f862c0686b0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.330 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2023-09-13T02:11:59.330 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2023-09-13T02:11:59.332 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.332+0000 7f9465ffb640 1 -- 172.21.15.104:0/1428885151 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) v1 -- 0x7f94580052b0 con 0x7f94800721b0 2023-09-13T02:11:59.335 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2023-09-13T02:11:59.336 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2023-09-13T02:11:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.333+0000 7f8630a02640 1 -- 172.21.15.104:0/536116700 shutdown_connections 2023-09-13T02:11:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.333+0000 7f8630a02640 1 --2- 172.21.15.104:0/536116700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86240d0030 0x7f8624035be0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.333+0000 7f8630a02640 1 --2- 172.21.15.104:0/536116700 >> v2:172.21.15.119:3300/0 conn(0x7f8624033b80 0x7f8624035120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.338 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.333+0000 7f8630a02640 1 -- 172.21.15.104:0/536116700 >> 172.21.15.104:0/536116700 conn(0x7f862403a8d0 msgr2=0x7f862403ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.338 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.335+0000 7f8630a02640 1 -- 172.21.15.104:0/536116700 shutdown_connections 2023-09-13T02:11:59.339 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.338+0000 7f9467fff640 1 -- 172.21.15.104:0/1428885151 <== mon.0 v2:172.21.15.104:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) v1 ==== 108+0+0 (secure 0 0 0) 0x7f94800b4280 con 0x7f94800721b0 2023-09-13T02:11:59.339 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.335+0000 7f8630a02640 1 -- 172.21.15.104:0/536116700 wait complete. 2023-09-13T02:11:59.340 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.337+0000 7f8630a02640 1 Processor -- start 2023-09-13T02:11:59.340 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.337+0000 7f8630a02640 1 -- start start 2023-09-13T02:11:59.340 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.338+0000 7f8630a02640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8624033b80 0x7f86240c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.340 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.338+0000 7f8630a02640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86240cfbd0 0x7f86240ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.341 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.338+0000 7f8630a02640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86240d0030 0x7f86240ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.341 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.338+0000 7f8630a02640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86240cd370 con 0x7f8624033b80 2023-09-13T02:11:59.341 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.338+0000 7f8630a02640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86240cdcb0 con 0x7f86240cfbd0 2023-09-13T02:11:59.341 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.338+0000 7f8630a02640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86240ca770 con 0x7f86240d0030 2023-09-13T02:11:59.342 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.339+0000 7f862ad9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86240d0030 0x7f86240ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.342 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.339+0000 7f862ad9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86240d0030 0x7f86240ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.104:37210/0 (socket says 172.21.15.104:37210) 2023-09-13T02:11:59.343 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.339+0000 7f862ad9d640 1 -- 172.21.15.104:0/176163780 learned_addr learned my addr 172.21.15.104:0/176163780 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:11:59.343 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.339+0000 7f862a59c640 1 --2- 172.21.15.104:0/176163780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8624033b80 0x7f86240c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.343 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.339+0000 7f862ad9d640 1 -- 172.21.15.104:0/176163780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86240cfbd0 msgr2=0x7f86240ce140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T02:11:59.343 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.339+0000 7f862ad9d640 1 --2- 172.21.15.104:0/176163780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86240cfbd0 0x7f86240ce140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.344 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.339+0000 7f862ad9d640 1 -- 172.21.15.104:0/176163780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8624033b80 msgr2=0x7f86240c4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.344 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.339+0000 7f862ad9d640 1 --2- 172.21.15.104:0/176163780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8624033b80 0x7f86240c4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.344 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.339+0000 7f862ad9d640 1 -- 172.21.15.104:0/176163780 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86240cd940 con 0x7f86240d0030 2023-09-13T02:11:59.344 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.340+0000 7f862a59c640 1 --2- 172.21.15.104:0/176163780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8624033b80 0x7f86240c4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:11:59.346 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2023-09-13T02:11:59.347 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2023-09-13T02:11:59.348 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.342+0000 7f9485b49640 1 -- 172.21.15.104:0/1428885151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94800721b0 msgr2=0x7f94801e1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.348 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.342+0000 7f9485b49640 1 --2- 172.21.15.104:0/1428885151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94800721b0 0x7f94801e1040 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f947400d950 tx=0x7f947400de10 comp rx=0 tx=0).stop 2023-09-13T02:11:59.348 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.342+0000 7f9485b49640 1 -- 172.21.15.104:0/1428885151 shutdown_connections 2023-09-13T02:11:59.348 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.342+0000 7f9485b49640 1 --2- 172.21.15.104:0/1428885151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9480144380 0x7f9480088080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.348 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.342+0000 7f9485b49640 1 --2- 172.21.15.104:0/1428885151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9480072590 0x7f9480137f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.342+0000 7f9485b49640 1 --2- 172.21.15.104:0/1428885151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94800721b0 0x7f94801e1040 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.342+0000 7f9485b49640 1 -- 172.21.15.104:0/1428885151 >> 172.21.15.104:0/1428885151 conn(0x7f9480069570 msgr2=0x7f948013e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.343+0000 7f9485b49640 1 -- 172.21.15.104:0/1428885151 shutdown_connections 2023-09-13T02:11:59.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.343+0000 7f9485b49640 1 -- 172.21.15.104:0/1428885151 wait complete. 2023-09-13T02:11:59.350 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.340+0000 7f862ad9d640 1 --2- 172.21.15.104:0/176163780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86240d0030 0x7f86240ce680 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f862c04f1b0 tx=0x7f862c0a4a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:11:59.351 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.343+0000 7f861affd640 1 -- 172.21.15.104:0/176163780 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c0b6870 con 0x7f86240d0030 2023-09-13T02:11:59.351 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.343+0000 7f861affd640 1 -- 172.21.15.104:0/176163780 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f862c0b6ac0 con 0x7f86240d0030 2023-09-13T02:11:59.351 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.343+0000 7f861affd640 1 -- 172.21.15.104:0/176163780 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c0b6e30 con 0x7f86240d0030 2023-09-13T02:11:59.351 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.345+0000 7f8630a02640 1 -- 172.21.15.104:0/176163780 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86240bc8f0 con 0x7f86240d0030 2023-09-13T02:11:59.351 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.345+0000 7f8630a02640 1 -- 172.21.15.104:0/176163780 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86240c5a70 con 0x7f86240d0030 2023-09-13T02:11:59.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.346+0000 7f861affd640 1 -- 172.21.15.104:0/176163780 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f862c0bf750 con 0x7f86240d0030 2023-09-13T02:11:59.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.346+0000 7f861affd640 1 -- 172.21.15.104:0/176163780 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f862c0a4e40 con 0x7f86240d0030 2023-09-13T02:11:59.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.347+0000 7f8618ff9640 1 -- 172.21.15.104:0/176163780 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86240cd520 con 0x7f86240d0030 2023-09-13T02:11:59.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.350+0000 7f861affd640 1 -- 172.21.15.104:0/176163780 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f86240c5a70 con 0x7f86240d0030 2023-09-13T02:11:59.353 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2023-09-13T02:11:59.353 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2023-09-13T02:11:59.381 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2023-09-13T02:11:59.382 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2023-09-13T02:11:59.416 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.415+0000 7feb7ac4b640 1 -- 172.21.15.104:0/2562354951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb740b0a20 msgr2=0x7feb74088080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.417 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.415+0000 7feb7ac4b640 1 --2- 172.21.15.104:0/2562354951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb740b0a20 0x7feb74088080 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7feb6c005fd0 tx=0x7feb6c02c280 comp rx=0 tx=0).stop 2023-09-13T02:11:59.418 DEBUG:tasks.ceph:set 21 configs 2023-09-13T02:11:59.419 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.420 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.421 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.421 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.422 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.422 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.423 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.424 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.416+0000 7feb7ac4b640 1 -- 172.21.15.104:0/2562354951 shutdown_connections 2023-09-13T02:11:59.424 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.416+0000 7feb7ac4b640 1 --2- 172.21.15.104:0/2562354951 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb740885c0 0x7feb74088a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.424 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.416+0000 7feb7ac4b640 1 --2- 172.21.15.104:0/2562354951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb740b0a20 0x7feb74088080 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.425 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.416+0000 7feb7ac4b640 1 -- 172.21.15.104:0/2562354951 >> 172.21.15.104:0/2562354951 conn(0x7feb740699e0 msgr2=0x7feb740b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.433 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.416+0000 7feb7ac4b640 1 -- 172.21.15.104:0/2562354951 shutdown_connections 2023-09-13T02:11:59.433 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.416+0000 7feb7ac4b640 1 -- 172.21.15.104:0/2562354951 wait complete. 2023-09-13T02:11:59.433 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.417+0000 7feb7ac4b640 1 Processor -- start 2023-09-13T02:11:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.417+0000 7feb7ac4b640 1 -- start start 2023-09-13T02:11:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.418+0000 7feb7ac4b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb740885c0 0x7feb74157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.418+0000 7feb7ac4b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb740ae3e0 0x7feb74158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.419+0000 7feb7ac4b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb740a6730 0x7feb741593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.419+0000 7feb7ac4b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7415a610 con 0x7feb740885c0 2023-09-13T02:11:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.419+0000 7feb7ac4b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb740a6bf0 con 0x7feb740ae3e0 2023-09-13T02:11:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.419+0000 7feb7ac4b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7415a2f0 con 0x7feb740a6730 2023-09-13T02:11:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.426+0000 7feb789e7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb740885c0 0x7feb74157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.426+0000 7feb789e7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb740885c0 0x7feb74157170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38084/0 (socket says 172.21.15.104:38084) 2023-09-13T02:11:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.426+0000 7feb789e7640 1 -- 172.21.15.104:0/3854221291 learned_addr learned my addr 172.21.15.104:0/3854221291 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:11:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.427+0000 7feb789e7640 1 -- 172.21.15.104:0/3854221291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb740a6730 msgr2=0x7feb741593a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T02:11:59.436 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.427+0000 7feb789e7640 1 --2- 172.21.15.104:0/3854221291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb740a6730 0x7feb741593a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.436 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.427+0000 7feb789e7640 1 -- 172.21.15.104:0/3854221291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb740ae3e0 msgr2=0x7feb74158e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T02:11:59.436 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.427+0000 7feb789e7640 1 --2- 172.21.15.104:0/3854221291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb740ae3e0 0x7feb74158e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.436 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.427+0000 7feb789e7640 1 -- 172.21.15.104:0/3854221291 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6c009900 con 0x7feb740885c0 2023-09-13T02:11:59.436 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.427+0000 7feb789e7640 1 --2- 172.21.15.104:0/3854221291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb740885c0 0x7feb74157170 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7feb6400c780 tx=0x7feb6400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:11:59.437 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.428+0000 7feb717fa640 1 -- 172.21.15.104:0/3854221291 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb640050d0 con 0x7feb740885c0 2023-09-13T02:11:59.437 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.428+0000 7feb7ac4b640 1 -- 172.21.15.104:0/3854221291 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7415a8f0 con 0x7feb740885c0 2023-09-13T02:11:59.437 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.428+0000 7feb7ac4b640 1 -- 172.21.15.104:0/3854221291 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb74158120 con 0x7feb740885c0 2023-09-13T02:11:59.437 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.430+0000 7feb717fa640 1 -- 172.21.15.104:0/3854221291 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feb64005320 con 0x7feb740885c0 2023-09-13T02:11:59.437 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.430+0000 7feb717fa640 1 -- 172.21.15.104:0/3854221291 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb640054f0 con 0x7feb740885c0 2023-09-13T02:11:59.437 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.431+0000 7feb717fa640 1 -- 172.21.15.104:0/3854221291 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7feb640067d0 con 0x7feb740885c0 2023-09-13T02:11:59.438 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.431+0000 7feb717fa640 1 -- 172.21.15.104:0/3854221291 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7feb640038a0 con 0x7feb740885c0 2023-09-13T02:11:59.438 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.432+0000 7feb7ac4b640 1 -- 172.21.15.104:0/3854221291 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb54005250 con 0x7feb740885c0 2023-09-13T02:11:59.438 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.436+0000 7f771ef47640 1 -- 172.21.15.104:0/5493358 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) v1 -- 0x7f76f40052b0 con 0x7f7710035bf0 2023-09-13T02:11:59.439 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.436+0000 7feb717fa640 1 -- 172.21.15.104:0/3854221291 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7feb74158120 con 0x7feb740885c0 2023-09-13T02:11:59.443 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.443+0000 7f770e7fc640 1 -- 172.21.15.104:0/5493358 <== mon.1 v2:172.21.15.119:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) v1 ==== 117+0+0 (secure 0 0 0) 0x7f77180ce0b0 con 0x7f7710035bf0 2023-09-13T02:11:59.460 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.460+0000 7f76fbfff640 1 -- 172.21.15.104:0/5493358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7710035bf0 msgr2=0x7f77100c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.460 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.460+0000 7f76fbfff640 1 --2- 172.21.15.104:0/5493358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7710035bf0 0x7f77100c87c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f77180687a0 tx=0x7f7718067c40 comp rx=0 tx=0).stop 2023-09-13T02:11:59.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.460+0000 7f76fbfff640 1 -- 172.21.15.104:0/5493358 shutdown_connections 2023-09-13T02:11:59.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.460+0000 7f76fbfff640 1 --2- 172.21.15.104:0/5493358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7710035bf0 0x7f77100c87c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.460+0000 7f76fbfff640 1 --2- 172.21.15.104:0/5493358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7710035130 0x7f77100c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.460+0000 7f76fbfff640 1 --2- 172.21.15.104:0/5493358 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7710033b90 0x7f771016e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.460+0000 7f76fbfff640 1 -- 172.21.15.104:0/5493358 >> 172.21.15.104:0/5493358 conn(0x7f771003a8e0 msgr2=0x7f771003c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.462 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.460+0000 7f76fbfff640 1 -- 172.21.15.104:0/5493358 shutdown_connections 2023-09-13T02:11:59.462 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.460+0000 7f76fbfff640 1 -- 172.21.15.104:0/5493358 wait complete. 2023-09-13T02:11:59.462 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.461+0000 7f6f6989b640 1 -- 172.21.15.104:0/2699309554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f640b0850 msgr2=0x7f6f64088080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.463 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.461+0000 7f6f6989b640 1 --2- 172.21.15.104:0/2699309554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f640b0850 0x7f6f64088080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6f640aca90 tx=0x7f6f5c02d2c0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.463 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.461+0000 7f6f6989b640 1 -- 172.21.15.104:0/2699309554 shutdown_connections 2023-09-13T02:11:59.463 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.461+0000 7f6f6989b640 1 --2- 172.21.15.104:0/2699309554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f640b0850 0x7f6f64088080 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.463 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.461+0000 7f6f6989b640 1 --2- 172.21.15.104:0/2699309554 >> v2:172.21.15.104:3300/0 conn(0x7f6f640ae3e0 0x7f6f640b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.463 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.461+0000 7f6f6989b640 1 -- 172.21.15.104:0/2699309554 >> 172.21.15.104:0/2699309554 conn(0x7f6f640699e0 msgr2=0x7f6f640b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.461+0000 7f6f6989b640 1 -- 172.21.15.104:0/2699309554 shutdown_connections 2023-09-13T02:11:59.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.461+0000 7f6f6989b640 1 -- 172.21.15.104:0/2699309554 wait complete. 2023-09-13T02:11:59.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.462+0000 7f6f6989b640 1 Processor -- start 2023-09-13T02:11:59.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.463+0000 7f6f6989b640 1 -- start start 2023-09-13T02:11:59.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.463+0000 7f6f6989b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f640885c0 0x7f6f641dc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.464+0000 7f6f6989b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f640ae3e0 0x7f6f64087880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.464+0000 7f6f6989b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f640b0850 0x7f6f64087dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.474 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.466+0000 7f6f62ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f640885c0 0x7f6f641dc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.474 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.466+0000 7f6f637fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f640b0850 0x7f6f64087dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.474 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.466+0000 7f6f637fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f640b0850 0x7f6f64087dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38094/0 (socket says 172.21.15.104:38094) 2023-09-13T02:11:59.475 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.466+0000 7f6f6989b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f64152150 con 0x7f6f640b0850 2023-09-13T02:11:59.475 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.466+0000 7f6f6989b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f641dd160 con 0x7f6f640ae3e0 2023-09-13T02:11:59.475 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.466+0000 7f6f6989b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f641523a0 con 0x7f6f640885c0 2023-09-13T02:11:59.475 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.466+0000 7f6f637fe640 1 -- 172.21.15.104:0/1595775344 learned_addr learned my addr 172.21.15.104:0/1595775344 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:11:59.475 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.469+0000 7f6f637fe640 1 -- 172.21.15.104:0/1595775344 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f640885c0 msgr2=0x7f6f641dc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.476 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.469+0000 7f6f637fe640 1 --2- 172.21.15.104:0/1595775344 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f640885c0 0x7f6f641dc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.476 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.469+0000 7f6f637fe640 1 -- 172.21.15.104:0/1595775344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f640ae3e0 msgr2=0x7f6f64087880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T02:11:59.476 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.469+0000 7f6f637fe640 1 --2- 172.21.15.104:0/1595775344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f640ae3e0 0x7f6f64087880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.476 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.469+0000 7f6f637fe640 1 -- 172.21.15.104:0/1595775344 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c009900 con 0x7f6f640b0850 2023-09-13T02:11:59.476 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.472+0000 7f6f637fe640 1 --2- 172.21.15.104:0/1595775344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f640b0850 0x7f6f64087dc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800b780 tx=0x7f6f5800bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:11:59.477 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.472+0000 7f6f4bfff640 1 -- 172.21.15.104:0/1595775344 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5800c720 con 0x7f6f640b0850 2023-09-13T02:11:59.477 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.472+0000 7f6f4bfff640 1 -- 172.21.15.104:0/1595775344 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6f5800c970 con 0x7f6f640b0850 2023-09-13T02:11:59.477 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.473+0000 7f6f4bfff640 1 -- 172.21.15.104:0/1595775344 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5800cdc0 con 0x7f6f640b0850 2023-09-13T02:11:59.477 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.473+0000 7f6f6989b640 1 -- 172.21.15.104:0/1595775344 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f640a7310 con 0x7f6f640b0850 2023-09-13T02:11:59.478 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.473+0000 7f6f6989b640 1 -- 172.21.15.104:0/1595775344 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f64152680 con 0x7f6f640b0850 2023-09-13T02:11:59.478 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.474+0000 7f6f49ffb640 1 -- 172.21.15.104:0/1595775344 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f64066c00 con 0x7f6f640b0850 2023-09-13T02:11:59.485 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.481+0000 7f6f4bfff640 1 -- 172.21.15.104:0/1595775344 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6f58014740 con 0x7f6f640b0850 2023-09-13T02:11:59.486 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.481+0000 7f6f4bfff640 1 -- 172.21.15.104:0/1595775344 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6f5801e9b0 con 0x7f6f640b0850 2023-09-13T02:11:59.486 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.481+0000 7f6f4bfff640 1 -- 172.21.15.104:0/1595775344 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f6f58019070 con 0x7f6f640b0850 2023-09-13T02:11:59.489 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.564+0000 7f594b2d7640 1 -- 172.21.15.104:0/3338597189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) v1 -- 0x7f594404e100 con 0x7f59440b2e60 2023-09-13T02:11:59.566 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.565+0000 7f533c21a640 1 -- 172.21.15.104:0/480175496 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5334154970 msgr2=0x7f533415da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.566 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.565+0000 7f533c21a640 1 --2- 172.21.15.104:0/480175496 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5334154970 0x7f533415da40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5330005fd0 tx=0x7f5330034290 comp rx=0 tx=0).stop 2023-09-13T02:11:59.571 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.571+0000 7f533c21a640 1 -- 172.21.15.104:0/480175496 shutdown_connections 2023-09-13T02:11:59.571 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.571+0000 7f533c21a640 1 --2- 172.21.15.104:0/480175496 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5334154970 0x7f533415da40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.571 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.571+0000 7f533c21a640 1 --2- 172.21.15.104:0/480175496 >> v2:172.21.15.104:3300/0 conn(0x7f53340ae540 0x7f5334154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.572 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.571+0000 7f533c21a640 1 -- 172.21.15.104:0/480175496 >> 172.21.15.104:0/480175496 conn(0x7f53340b56f0 msgr2=0x7f53340b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.572 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.572+0000 7f5939ffb640 1 -- 172.21.15.104:0/3338597189 <== mon.1 v2:172.21.15.119:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) v1 ==== 106+0+0 (secure 0 0 0) 0x7f5940020060 con 0x7f59440b2e60 2023-09-13T02:11:59.573 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.572+0000 7f533c21a640 1 -- 172.21.15.104:0/480175496 shutdown_connections 2023-09-13T02:11:59.582 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.581+0000 7f594b2d7640 1 -- 172.21.15.104:0/3338597189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59440b2e60 msgr2=0x7f59441fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.582 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.581+0000 7f594b2d7640 1 --2- 172.21.15.104:0/3338597189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59440b2e60 0x7f59441fb2c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f594000c3f0 tx=0x7f594000c8b0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.583 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.581+0000 7f594b2d7640 1 -- 172.21.15.104:0/3338597189 shutdown_connections 2023-09-13T02:11:59.583 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.581+0000 7f594b2d7640 1 --2- 172.21.15.104:0/3338597189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59440b2e60 0x7f59441fb2c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.584 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.581+0000 7f594b2d7640 1 --2- 172.21.15.104:0/3338597189 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59440b23c0 0x7f59440b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.584 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.581+0000 7f594b2d7640 1 --2- 172.21.15.104:0/3338597189 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5944071650 0x7f594412ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.584 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.581+0000 7f594b2d7640 1 -- 172.21.15.104:0/3338597189 >> 172.21.15.104:0/3338597189 conn(0x7f594406aa50 msgr2=0x7f594413a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.585 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.581+0000 7f594b2d7640 1 -- 172.21.15.104:0/3338597189 shutdown_connections 2023-09-13T02:11:59.585 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.581+0000 7f594b2d7640 1 -- 172.21.15.104:0/3338597189 wait complete. 2023-09-13T02:11:59.588 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.577+0000 7f533c21a640 1 -- 172.21.15.104:0/480175496 wait complete. 2023-09-13T02:11:59.588 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.578+0000 7f533c21a640 1 Processor -- start 2023-09-13T02:11:59.588 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.581+0000 7f533c21a640 1 -- start start 2023-09-13T02:11:59.589 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.582+0000 7f533c21a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53340ae540 0x7f53341fb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.589 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.582+0000 7f533c21a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5334154500 0x7f53340a7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.589 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.582+0000 7f533c21a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53341db6d0 0x7f53341ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.590 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.582+0000 7f533c21a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53341fbdd0 con 0x7f5334154500 2023-09-13T02:11:59.590 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.582+0000 7f533c21a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53340a9190 con 0x7f53340ae540 2023-09-13T02:11:59.590 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.582+0000 7f533c21a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53341fb090 con 0x7f53341db6d0 2023-09-13T02:11:59.591 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.582+0000 7f53397b5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5334154500 0x7f53340a7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.591 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.582+0000 7f53397b5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5334154500 0x7f53340a7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38114/0 (socket says 172.21.15.104:38114) 2023-09-13T02:11:59.591 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.582+0000 7f53397b5640 1 -- 172.21.15.104:0/1737715144 learned_addr learned my addr 172.21.15.104:0/1737715144 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:11:59.592 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.582+0000 7f009a705640 1 -- 172.21.15.104:0/137941369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f007c00b6e0 msgr2=0x7f007c00db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.593 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.582+0000 7f009a705640 1 --2- 172.21.15.104:0/137941369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f007c00b6e0 0x7f007c00db70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0088006f20 tx=0x7f007c0037b0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.593 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.583+0000 7f0098ca2640 1 -- 172.21.15.104:0/137941369 reap_dead start 2023-09-13T02:11:59.593 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.583+0000 7f009a705640 1 -- 172.21.15.104:0/137941369 shutdown_connections 2023-09-13T02:11:59.593 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.583+0000 7f009a705640 1 -- 172.21.15.104:0/137941369 >> 172.21.15.104:0/137941369 conn(0x7f00940699e0 msgr2=0x7f00940b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.594 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.583+0000 7f009a705640 1 -- 172.21.15.104:0/137941369 shutdown_connections 2023-09-13T02:11:59.595 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.584+0000 7f41c8075640 1 -- 172.21.15.104:0/4045843922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41b80cc5d0 msgr2=0x7f41b80336c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.595 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.584+0000 7f41c8075640 1 --2- 172.21.15.104:0/4045843922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41b80cc5d0 0x7f41b80336c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f41c00772b0 tx=0x7f41c00686b0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.595 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.584+0000 7f41c8075640 1 -- 172.21.15.104:0/4045843922 shutdown_connections 2023-09-13T02:11:59.596 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.584+0000 7f41c8075640 1 --2- 172.21.15.104:0/4045843922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41b80cc5d0 0x7f41b80336c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.596 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.584+0000 7f41c8075640 1 --2- 172.21.15.104:0/4045843922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41b8034890 0x7f41b8036100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.596 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.584+0000 7f41c8075640 1 -- 172.21.15.104:0/4045843922 >> 172.21.15.104:0/4045843922 conn(0x7f41b803a880 msgr2=0x7f41b803ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.596 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.584+0000 7f41c8075640 1 -- 172.21.15.104:0/4045843922 shutdown_connections 2023-09-13T02:11:59.597 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.584+0000 7f41c8075640 1 -- 172.21.15.104:0/4045843922 wait complete. 2023-09-13T02:11:59.597 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.585+0000 7f41c8075640 1 Processor -- start 2023-09-13T02:11:59.597 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.586+0000 7f41c8075640 1 -- start start 2023-09-13T02:11:59.597 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.587+0000 7f41c8075640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41b8033c00 0x7f41b80c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.598 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.587+0000 7f41c8075640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41b8034890 0x7f41b80c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.598 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.587+0000 7f41c8075640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41b80bcad0 0x7f41b80bbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.598 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.587+0000 7f41c8075640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80c1a00 con 0x7f41b8033c00 2023-09-13T02:11:59.599 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.583+0000 7f009a705640 1 -- 172.21.15.104:0/137941369 wait complete. 2023-09-13T02:11:59.599 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.587+0000 7f41c8075640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80c6f40 con 0x7f41b80bcad0 2023-09-13T02:11:59.600 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.584+0000 7f009a705640 1 Processor -- start 2023-09-13T02:11:59.600 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.585+0000 7f009a705640 1 -- start start 2023-09-13T02:11:59.600 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.586+0000 7f009a705640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00941e1b60 0x7f00941d5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.601 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.586+0000 7f009a705640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00941e2c80 0x7f00941d5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.601 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.586+0000 7f009a705640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0094088060 0x7f00941eea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.601 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.586+0000 7f009a705640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00941e3160 con 0x7f00941e2c80 2023-09-13T02:11:59.601 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.586+0000 7f009a705640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00941e3440 con 0x7f00941e1b60 2023-09-13T02:11:59.601 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.586+0000 7f009a705640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00940aae70 con 0x7f0094088060 2023-09-13T02:11:59.602 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.588+0000 7f0098ca2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0094088060 0x7f00941eea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.602 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.588+0000 7f0098ca2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0094088060 0x7f00941eea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.104:37294/0 (socket says 172.21.15.104:37294) 2023-09-13T02:11:59.602 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.588+0000 7f0098ca2640 1 -- 172.21.15.104:0/1694885062 learned_addr learned my addr 172.21.15.104:0/1694885062 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:11:59.602 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.588+0000 7f0098ca2640 1 -- 172.21.15.104:0/1694885062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00941e1b60 msgr2=0x7f00941d5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.603 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.588+0000 7f0098ca2640 1 --2- 172.21.15.104:0/1694885062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00941e1b60 0x7f00941d5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.603 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.588+0000 7f0098ca2640 1 -- 172.21.15.104:0/1694885062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00941e2c80 msgr2=0x7f00941d5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.603 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.588+0000 7f0098ca2640 1 --2- 172.21.15.104:0/1694885062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00941e2c80 0x7f00941d5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.603 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.588+0000 7f0098ca2640 1 -- 172.21.15.104:0/1694885062 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00940ab150 con 0x7f0094088060 2023-09-13T02:11:59.603 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.589+0000 7f0098ca2640 1 --2- 172.21.15.104:0/1694885062 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0094088060 0x7f00941eea10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f008802c8f0 tx=0x7f0088001640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:11:59.604 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.582+0000 7f53397b5640 1 -- 172.21.15.104:0/1737715144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53341db6d0 msgr2=0x7f53341ed9c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-13T02:11:59.604 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.582+0000 7f53397b5640 1 --2- 172.21.15.104:0/1737715144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53341db6d0 0x7f53341ed9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.604 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.582+0000 7f53397b5640 1 -- 172.21.15.104:0/1737715144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53340ae540 msgr2=0x7f53341fb890 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-13T02:11:59.604 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.582+0000 7f53397b5640 1 --2- 172.21.15.104:0/1737715144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53340ae540 0x7f53341fb890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.582+0000 7f53397b5640 1 -- 172.21.15.104:0/1737715144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5330013b70 con 0x7f5334154500 2023-09-13T02:11:59.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.586+0000 7f53397b5640 1 --2- 172.21.15.104:0/1737715144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5334154500 0x7f53340a7ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f532400c410 tx=0x7f532400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:11:59.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.587+0000 7f532a7fc640 1 -- 172.21.15.104:0/1737715144 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53240035f0 con 0x7f5334154500 2023-09-13T02:11:59.606 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.587+0000 7f532a7fc640 1 -- 172.21.15.104:0/1737715144 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5324003750 con 0x7f5334154500 2023-09-13T02:11:59.606 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.587+0000 7f532a7fc640 1 -- 172.21.15.104:0/1737715144 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324003b60 con 0x7f5334154500 2023-09-13T02:11:59.606 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.588+0000 7f533c21a640 1 -- 172.21.15.104:0/1737715144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53341fb370 con 0x7f5334154500 2023-09-13T02:11:59.606 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.588+0000 7f533c21a640 1 -- 172.21.15.104:0/1737715144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53341529c0 con 0x7f5334154500 2023-09-13T02:11:59.608 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.587+0000 7f41c8075640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80c7c10 con 0x7f41b8034890 2023-09-13T02:11:59.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.587+0000 7f41c5e11640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41b8033c00 0x7f41b80c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.587+0000 7f41c5e11640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41b8033c00 0x7f41b80c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38124/0 (socket says 172.21.15.104:38124) 2023-09-13T02:11:59.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.587+0000 7f41c5e11640 1 -- 172.21.15.104:0/2028061288 learned_addr learned my addr 172.21.15.104:0/2028061288 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:11:59.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.588+0000 7f41c5610640 1 --2- 172.21.15.104:0/2028061288 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41b8034890 0x7f41b80c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.611 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.590+0000 7f532a7fc640 1 -- 172.21.15.104:0/1737715144 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f532401c440 con 0x7f5334154500 2023-09-13T02:11:59.611 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.590+0000 7f532a7fc640 1 -- 172.21.15.104:0/1737715144 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5324012830 con 0x7f5334154500 2023-09-13T02:11:59.612 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.588+0000 7f41c6e13640 1 --2- 172.21.15.104:0/2028061288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41b80bcad0 0x7f41b80bbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.613 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.588+0000 7f41c5610640 1 -- 172.21.15.104:0/2028061288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41b80bcad0 msgr2=0x7f41b80bbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.613 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.588+0000 7f41c5610640 1 --2- 172.21.15.104:0/2028061288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41b80bcad0 0x7f41b80bbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.613 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.588+0000 7f41c5610640 1 -- 172.21.15.104:0/2028061288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41b8033c00 msgr2=0x7f41b80c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.614 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.590+0000 7f41c5610640 1 --2- 172.21.15.104:0/2028061288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41b8033c00 0x7f41b80c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.614 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.589+0000 7f0090ff9640 1 -- 172.21.15.104:0/1694885062 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0088039070 con 0x7f0094088060 2023-09-13T02:11:59.615 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.589+0000 7f009a705640 1 -- 172.21.15.104:0/1694885062 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00940ab430 con 0x7f0094088060 2023-09-13T02:11:59.615 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.589+0000 7f009a705640 1 -- 172.21.15.104:0/1694885062 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00940a9f40 con 0x7f0094088060 2023-09-13T02:11:59.616 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.590+0000 7f0090ff9640 1 -- 172.21.15.104:0/1694885062 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f008803a040 con 0x7f0094088060 2023-09-13T02:11:59.616 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.590+0000 7f0090ff9640 1 -- 172.21.15.104:0/1694885062 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0088003910 con 0x7f0094088060 2023-09-13T02:11:59.616 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.590+0000 7f41c5610640 1 -- 172.21.15.104:0/2028061288 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b80c7ee0 con 0x7f41b8034890 2023-09-13T02:11:59.617 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.590+0000 7f41c5e11640 1 --2- 172.21.15.104:0/2028061288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41b8033c00 0x7f41b80c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T02:11:59.617 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.591+0000 7f009a705640 1 -- 172.21.15.104:0/1694885062 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00940aaca0 con 0x7f0094088060 2023-09-13T02:11:59.618 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.591+0000 7f41c5610640 1 --2- 172.21.15.104:0/2028061288 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41b8034890 0x7f41b80c76d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f41c0068280 tx=0x7f41c00ade50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:11:59.618 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.591+0000 7f41b67fc640 1 -- 172.21.15.104:0/2028061288 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c00b6930 con 0x7f41b8034890 2023-09-13T02:11:59.618 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.591+0000 7f41c8075640 1 -- 172.21.15.104:0/2028061288 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b80be0f0 con 0x7f41b8034890 2023-09-13T02:11:59.619 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.591+0000 7f41c8075640 1 -- 172.21.15.104:0/2028061288 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b80bf570 con 0x7f41b8034890 2023-09-13T02:11:59.619 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.592+0000 7efc78dce640 1 -- 172.21.15.104:0/3804552049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc740af900 msgr2=0x7efc741441f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.619 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.592+0000 7efc78dce640 1 --2- 172.21.15.104:0/3804552049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc740af900 0x7efc741441f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efc7406b020 tx=0x7efc6c02c200 comp rx=0 tx=0).stop 2023-09-13T02:11:59.620 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.592+0000 7efc78dce640 1 -- 172.21.15.104:0/3804552049 shutdown_connections 2023-09-13T02:11:59.620 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.592+0000 7efc78dce640 1 --2- 172.21.15.104:0/3804552049 >> v2:172.21.15.104:3300/0 conn(0x7efc740acf10 0x7efc74144a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.620 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.592+0000 7efc78dce640 1 --2- 172.21.15.104:0/3804552049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc740af900 0x7efc741441f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.620 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.592+0000 7efc78dce640 1 --2- 172.21.15.104:0/3804552049 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc740acb30 0x7efc740adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.621 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.592+0000 7efc78dce640 1 -- 172.21.15.104:0/3804552049 >> 172.21.15.104:0/3804552049 conn(0x7efc740b56f0 msgr2=0x7efc740b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.621 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.593+0000 7f41c8075640 1 -- 172.21.15.104:0/2028061288 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b80be2e0 con 0x7f41b8034890 2023-09-13T02:11:59.622 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.593+0000 7f41b67fc640 1 -- 172.21.15.104:0/2028061288 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f41c00b6b80 con 0x7f41b8034890 2023-09-13T02:11:59.622 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.593+0000 7f41b67fc640 1 -- 172.21.15.104:0/2028061288 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c00b53c0 con 0x7f41b8034890 2023-09-13T02:11:59.622 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.593+0000 7f0090ff9640 1 -- 172.21.15.104:0/1694885062 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0088032070 con 0x7f0094088060 2023-09-13T02:11:59.623 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.593+0000 7f0090ff9640 1 -- 172.21.15.104:0/1694885062 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0088035920 con 0x7f0094088060 2023-09-13T02:11:59.623 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.593+0000 7f41b67fc640 1 -- 172.21.15.104:0/2028061288 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f41c00b5520 con 0x7f41b8034890 2023-09-13T02:11:59.623 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.593+0000 7f41b67fc640 1 -- 172.21.15.104:0/2028061288 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f41c00c97c0 con 0x7f41b8034890 2023-09-13T02:11:59.624 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.594+0000 7efc78dce640 1 -- 172.21.15.104:0/3804552049 shutdown_connections 2023-09-13T02:11:59.624 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.594+0000 7efc78dce640 1 -- 172.21.15.104:0/3804552049 wait complete. 2023-09-13T02:11:59.625 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.594+0000 7f08d8c90640 1 -- 172.21.15.104:0/865059247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08d4071340 msgr2=0x7f08d41547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.625 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.594+0000 7f08d8c90640 1 --2- 172.21.15.104:0/865059247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08d4071340 0x7f08d41547c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009830 tx=0x7f08c402dd30 comp rx=0 tx=0).stop 2023-09-13T02:11:59.625 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.595+0000 7f08d8c90640 1 -- 172.21.15.104:0/865059247 shutdown_connections 2023-09-13T02:11:59.625 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.595+0000 7f08d8c90640 1 --2- 172.21.15.104:0/865059247 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08d4154d00 0x7f08d415b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.626 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.595+0000 7f08d8c90640 1 --2- 172.21.15.104:0/865059247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08d4071340 0x7f08d41547c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.626 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.595+0000 7f08d8c90640 1 -- 172.21.15.104:0/865059247 >> 172.21.15.104:0/865059247 conn(0x7f08d4069970 msgr2=0x7f08d40b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.626 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.595+0000 7efc78dce640 1 Processor -- start 2023-09-13T02:11:59.627 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.596+0000 7efc78dce640 1 -- start start 2023-09-13T02:11:59.627 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.596+0000 7efc78dce640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc740acb30 0x7efc74140e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.627 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.597+0000 7f08d8c90640 1 -- 172.21.15.104:0/865059247 shutdown_connections 2023-09-13T02:11:59.628 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.597+0000 7efc7259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc740acb30 0x7efc74140e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.628 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.597+0000 7efc7259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc740acb30 0x7efc74140e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38152/0 (socket says 172.21.15.104:38152) 2023-09-13T02:11:59.628 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.597+0000 7efc7259c640 1 -- 172.21.15.104:0/1080574231 learned_addr learned my addr 172.21.15.104:0/1080574231 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:11:59.629 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.592+0000 7f533c21a640 1 -- 172.21.15.104:0/1737715144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53340af1a0 con 0x7f5334154500 2023-09-13T02:11:59.630 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.597+0000 7efc78dce640 1 --2- 172.21.15.104:0/1080574231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc740acf10 0x7efc741de340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.597+0000 7efc78dce640 1 --2- 172.21.15.104:0/1080574231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc740af900 0x7efc74070220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.597+0000 7efc78dce640 1 -- 172.21.15.104:0/1080574231 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7406e370 con 0x7efc740acb30 2023-09-13T02:11:59.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.597+0000 7efc72d9d640 1 --2- 172.21.15.104:0/1080574231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc740af900 0x7efc74070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.597+0000 7efc71d9b640 1 --2- 172.21.15.104:0/1080574231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc740acf10 0x7efc741de340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.632 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.598+0000 7efc78dce640 1 -- 172.21.15.104:0/1080574231 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7406d4e0 con 0x7efc740acf10 2023-09-13T02:11:59.632 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.598+0000 7efc78dce640 1 -- 172.21.15.104:0/1080574231 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc74141b80 con 0x7efc740af900 2023-09-13T02:11:59.632 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.598+0000 7efc7259c640 1 -- 172.21.15.104:0/1080574231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc740af900 msgr2=0x7efc74070220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.633 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.598+0000 7efc7259c640 1 --2- 172.21.15.104:0/1080574231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc740af900 0x7efc74070220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.633 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.598+0000 7efc7259c640 1 -- 172.21.15.104:0/1080574231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc740acf10 msgr2=0x7efc741de340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.633 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.598+0000 7efc7259c640 1 --2- 172.21.15.104:0/1080574231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc740acf10 0x7efc741de340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.633 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.598+0000 7efc7259c640 1 -- 172.21.15.104:0/1080574231 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c009900 con 0x7efc740acb30 2023-09-13T02:11:59.633 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.599+0000 7efc7259c640 1 --2- 172.21.15.104:0/1080574231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc740acb30 0x7efc74140e30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efc6800b3e0 tx=0x7efc6800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:11:59.634 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.599+0000 7efc72d9d640 1 --2- 172.21.15.104:0/1080574231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc740af900 0x7efc74070220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:11:59.634 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.599+0000 7efc71d9b640 1 --2- 172.21.15.104:0/1080574231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc740acf10 0x7efc741de340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:11:59.634 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.600+0000 7f41b67fc640 1 -- 172.21.15.104:0/2028061288 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f41c00ba070 con 0x7f41b8034890 2023-09-13T02:11:59.635 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.601+0000 7f0090ff9640 1 -- 172.21.15.104:0/1694885062 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f0088044070 con 0x7f0094088060 2023-09-13T02:11:59.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.597+0000 7f08d8c90640 1 -- 172.21.15.104:0/865059247 wait complete. 2023-09-13T02:11:59.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.598+0000 7f08d8c90640 1 Processor -- start 2023-09-13T02:11:59.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.599+0000 7f08d8c90640 1 -- start start 2023-09-13T02:11:59.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.599+0000 7f08d8c90640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08d4071340 0x7f08d4155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.599+0000 7f08d8c90640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08d4071720 0x7f08d40a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.599+0000 7f08d8c90640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08d4154d00 0x7f08d40ab620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.599+0000 7f08d8c90640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d4151660 con 0x7f08d4071720 2023-09-13T02:11:59.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.599+0000 7f08d8c90640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d41eec00 con 0x7f08d4071340 2023-09-13T02:11:59.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.599+0000 7f08d8c90640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d41ee8d0 con 0x7f08d4154d00 2023-09-13T02:11:59.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.604+0000 7f08d2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08d4071720 0x7f08d40a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.604+0000 7f08d2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08d4071720 0x7f08d40a8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38164/0 (socket says 172.21.15.104:38164) 2023-09-13T02:11:59.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.604+0000 7f08d2ffd640 1 -- 172.21.15.104:0/481806524 learned_addr learned my addr 172.21.15.104:0/481806524 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:11:59.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.604+0000 7f08d2ffd640 1 -- 172.21.15.104:0/481806524 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08d4154d00 msgr2=0x7f08d40ab620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T02:11:59.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.604+0000 7f08d2ffd640 1 --2- 172.21.15.104:0/481806524 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08d4154d00 0x7f08d40ab620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.604+0000 7f08d2ffd640 1 -- 172.21.15.104:0/481806524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08d4071340 msgr2=0x7f08d4155700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T02:11:59.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.604+0000 7f08d2ffd640 1 --2- 172.21.15.104:0/481806524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08d4071340 0x7f08d4155700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.604+0000 7f08d2ffd640 1 -- 172.21.15.104:0/481806524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c4009490 con 0x7f08d4071720 2023-09-13T02:11:59.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.605+0000 7f08d2ffd640 1 --2- 172.21.15.104:0/481806524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08d4071720 0x7f08d40a8ad0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00cc40 tx=0x7f08cc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:11:59.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.605+0000 7f08bbfff640 1 -- 172.21.15.104:0/481806524 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00ad40 con 0x7f08d4071720 2023-09-13T02:11:59.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.605+0000 7f08d8c90640 1 -- 172.21.15.104:0/481806524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d40ae820 con 0x7f08d4071720 2023-09-13T02:11:59.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.605+0000 7f08d8c90640 1 -- 172.21.15.104:0/481806524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d4155fd0 con 0x7f08d4071720 2023-09-13T02:11:59.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.607+0000 7f08bbfff640 1 -- 172.21.15.104:0/481806524 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f08cc00ce50 con 0x7f08d4071720 2023-09-13T02:11:59.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.607+0000 7f08bbfff640 1 -- 172.21.15.104:0/481806524 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc003bb0 con 0x7f08d4071720 2023-09-13T02:11:59.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.608+0000 7f08d8c90640 1 -- 172.21.15.104:0/481806524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b4005250 con 0x7f08d4071720 2023-09-13T02:11:59.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.611+0000 7f532a7fc640 1 -- 172.21.15.104:0/1737715144 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f53341529c0 con 0x7f5334154500 2023-09-13T02:11:59.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.610+0000 7efc62ffd640 1 -- 172.21.15.104:0/1080574231 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc68011830 con 0x7efc740acb30 2023-09-13T02:11:59.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.610+0000 7efc78dce640 1 -- 172.21.15.104:0/1080574231 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc741414c0 con 0x7efc740acb30 2023-09-13T02:11:59.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.610+0000 7efc78dce640 1 -- 172.21.15.104:0/1080574231 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc741de880 con 0x7efc740acb30 2023-09-13T02:11:59.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.611+0000 7efc62ffd640 1 -- 172.21.15.104:0/1080574231 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efc68011a80 con 0x7efc740acb30 2023-09-13T02:11:59.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.611+0000 7efc62ffd640 1 -- 172.21.15.104:0/1080574231 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc68011e90 con 0x7efc740acb30 2023-09-13T02:11:59.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.613+0000 7efc62ffd640 1 -- 172.21.15.104:0/1080574231 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efc6801a720 con 0x7efc740acb30 2023-09-13T02:11:59.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.613+0000 7efc62ffd640 1 -- 172.21.15.104:0/1080574231 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efc68019950 con 0x7efc740acb30 2023-09-13T02:11:59.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.613+0000 7f08bbfff640 1 -- 172.21.15.104:0/481806524 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f08cc005370 con 0x7f08d4071720 2023-09-13T02:11:59.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.613+0000 7f08bbfff640 1 -- 172.21.15.104:0/481806524 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f08cc01cbb0 con 0x7f08d4071720 2023-09-13T02:11:59.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.613+0000 7efc78dce640 1 -- 172.21.15.104:0/1080574231 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7404e100 con 0x7efc740acb30 2023-09-13T02:11:59.648 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.613+0000 7f08bbfff640 1 -- 172.21.15.104:0/481806524 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f08cc017070 con 0x7f08d4071720 2023-09-13T02:11:59.648 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.617+0000 7efc62ffd640 1 -- 172.21.15.104:0/1080574231 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7efc68039b20 con 0x7efc740acb30 2023-09-13T02:11:59.649 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.649 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.622+0000 7f8618ff9640 1 -- 172.21.15.104:0/176163780 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) v1 -- 0x7f862403b100 con 0x7f86240d0030 2023-09-13T02:11:59.650 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.633+0000 7f861affd640 1 -- 172.21.15.104:0/176163780 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v10)=0 v10) v1 ==== 127+0+0 (secure 0 0 0) 0x7f862c0c4060 con 0x7f86240d0030 2023-09-13T02:11:59.650 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.635+0000 7f402d7ca640 1 -- 172.21.15.104:0/1566611514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40280b23c0 msgr2=0x7f4028069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.651 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.635+0000 7f402d7ca640 1 --2- 172.21.15.104:0/1566611514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40280b23c0 0x7f4028069560 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4020005fd0 tx=0x7f402002c260 comp rx=0 tx=0).stop 2023-09-13T02:11:59.651 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.637+0000 7f402d7ca640 1 -- 172.21.15.104:0/1566611514 shutdown_connections 2023-09-13T02:11:59.651 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.637+0000 7f402d7ca640 1 --2- 172.21.15.104:0/1566611514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40280b23c0 0x7f4028069560 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.651 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.637+0000 7f402d7ca640 1 --2- 172.21.15.104:0/1566611514 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40280b2e60 0x7f40280acc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.651 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.637+0000 7f402d7ca640 1 -- 172.21.15.104:0/1566611514 >> 172.21.15.104:0/1566611514 conn(0x7f402806aa50 msgr2=0x7f40280b6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.652 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.639+0000 7f8618ff9640 1 -- 172.21.15.104:0/176163780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86240d0030 msgr2=0x7f86240ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.652 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.639+0000 7f8618ff9640 1 --2- 172.21.15.104:0/176163780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86240d0030 0x7f86240ce680 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f862c04f1b0 tx=0x7f862c0a4a70 comp rx=0 tx=0).stop 2023-09-13T02:11:59.652 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.639+0000 7f8618ff9640 1 -- 172.21.15.104:0/176163780 shutdown_connections 2023-09-13T02:11:59.653 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.639+0000 7f8618ff9640 1 --2- 172.21.15.104:0/176163780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86240d0030 0x7f86240ce680 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.653 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.639+0000 7f8618ff9640 1 --2- 172.21.15.104:0/176163780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86240cfbd0 0x7f86240ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.653 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.639+0000 7f8618ff9640 1 --2- 172.21.15.104:0/176163780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8624033b80 0x7f86240c4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.653 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.639+0000 7f8618ff9640 1 -- 172.21.15.104:0/176163780 >> 172.21.15.104:0/176163780 conn(0x7f862403a8d0 msgr2=0x7f86240c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.653 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.639+0000 7f8618ff9640 1 -- 172.21.15.104:0/176163780 shutdown_connections 2023-09-13T02:11:59.654 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.639+0000 7f8618ff9640 1 -- 172.21.15.104:0/176163780 wait complete. 2023-09-13T02:11:59.654 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.640+0000 7f7be359e640 1 -- 172.21.15.104:0/2560384033 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bdc037230 msgr2=0x7f7bdc0d33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.654 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.640+0000 7f7be359e640 1 --2- 172.21.15.104:0/2560384033 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bdc037230 0x7f7bdc0d33a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7be40738a0 tx=0x7f7be40686b0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.640+0000 7f402d7ca640 1 -- 172.21.15.104:0/1566611514 shutdown_connections 2023-09-13T02:11:59.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.640+0000 7f7be359e640 1 -- 172.21.15.104:0/2560384033 shutdown_connections 2023-09-13T02:11:59.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.640+0000 7f7be359e640 1 --2- 172.21.15.104:0/2560384033 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bdc037230 0x7f7bdc0d33a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.640+0000 7f7be359e640 1 --2- 172.21.15.104:0/2560384033 >> v2:172.21.15.119:3300/0 conn(0x7f7bdc038ec0 0x7f7bdc0c2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.656 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.641+0000 7f402d7ca640 1 -- 172.21.15.104:0/1566611514 wait complete. 2023-09-13T02:11:59.656 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.641+0000 7f7be359e640 1 -- 172.21.15.104:0/2560384033 >> 172.21.15.104:0/2560384033 conn(0x7f7bdc03a8e0 msgr2=0x7f7bdc03acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.657 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.642+0000 7f402d7ca640 1 Processor -- start 2023-09-13T02:11:59.657 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.644+0000 7f7be359e640 1 -- 172.21.15.104:0/2560384033 shutdown_connections 2023-09-13T02:11:59.657 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.644+0000 7f7be359e640 1 -- 172.21.15.104:0/2560384033 wait complete. 2023-09-13T02:11:59.658 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.646+0000 7f7be359e640 1 Processor -- start 2023-09-13T02:11:59.658 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.646+0000 7f7be359e640 1 -- start start 2023-09-13T02:11:59.658 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.647+0000 7f7be359e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bdc037230 0x7f7bdc0c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.658 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.645+0000 7f402d7ca640 1 -- start start 2023-09-13T02:11:59.659 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.645+0000 7f402d7ca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4028071650 0x7f40280b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.659 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.645+0000 7f402d7ca640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40280b23c0 0x7f40280b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.659 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.645+0000 7f402d7ca640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40280b2e60 0x7f40281de6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.659 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.645+0000 7f402d7ca640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40280b5560 con 0x7f40280b2e60 2023-09-13T02:11:59.659 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.645+0000 7f402d7ca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40280b5ae0 con 0x7f4028071650 2023-09-13T02:11:59.660 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.645+0000 7f402d7ca640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40280b5770 con 0x7f40280b23c0 2023-09-13T02:11:59.660 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.647+0000 7f40267fc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40280b23c0 0x7f40280b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.660 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.647+0000 7f4026ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4028071650 0x7f40280b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.660 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.647+0000 7f4026ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4028071650 0x7f40280b5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.104:58218/0 (socket says 172.21.15.104:58218) 2023-09-13T02:11:59.660 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.647+0000 7f4026ffd640 1 -- 172.21.15.104:0/599594978 learned_addr learned my addr 172.21.15.104:0/599594978 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:11:59.661 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.647+0000 7f4026ffd640 1 -- 172.21.15.104:0/599594978 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40280b23c0 msgr2=0x7f40280b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.661 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.647+0000 7f4026ffd640 1 --2- 172.21.15.104:0/599594978 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40280b23c0 0x7f40280b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.661 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.647+0000 7f4026ffd640 1 -- 172.21.15.104:0/599594978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40280b2e60 msgr2=0x7f40281de6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T02:11:59.661 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.647+0000 7f4026ffd640 1 --2- 172.21.15.104:0/599594978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40280b2e60 0x7f40281de6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.661 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.647+0000 7f4026ffd640 1 -- 172.21.15.104:0/599594978 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4020009900 con 0x7f4028071650 2023-09-13T02:11:59.663 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.648+0000 7f7be359e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bdc038ec0 0x7f7bdc0c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.663 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.648+0000 7f7be259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bdc037230 0x7f7bdc0c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.663 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.648+0000 7f7be259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bdc037230 0x7f7bdc0c5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.104:58226/0 (socket says 172.21.15.104:58226) 2023-09-13T02:11:59.664 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.648+0000 7f7be259c640 1 -- 172.21.15.104:0/4099001548 learned_addr learned my addr 172.21.15.104:0/4099001548 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:11:59.664 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.648+0000 7f7be359e640 1 --2- 172.21.15.104:0/4099001548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bdc03a020 0x7f7bdc0cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.664 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.648+0000 7f7be1d9b640 1 --2- 172.21.15.104:0/4099001548 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bdc038ec0 0x7f7bdc0c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.664 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.648+0000 7f7be359e640 1 -- 172.21.15.104:0/4099001548 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0062b0 con 0x7f7bdc03a020 2023-09-13T02:11:59.664 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.648+0000 7f7be359e640 1 -- 172.21.15.104:0/4099001548 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0bdc00 con 0x7f7bdc037230 2023-09-13T02:11:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.648+0000 7f7be359e640 1 -- 172.21.15.104:0/4099001548 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0064c0 con 0x7f7bdc038ec0 2023-09-13T02:11:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.648+0000 7f7be2d9d640 1 --2- 172.21.15.104:0/4099001548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bdc03a020 0x7f7bdc0cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.649+0000 7f7be259c640 1 -- 172.21.15.104:0/4099001548 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bdc038ec0 msgr2=0x7f7bdc0c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.649+0000 7f7be259c640 1 --2- 172.21.15.104:0/4099001548 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bdc038ec0 0x7f7bdc0c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.649+0000 7f7be259c640 1 -- 172.21.15.104:0/4099001548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bdc03a020 msgr2=0x7f7bdc0cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.649+0000 7f7be259c640 1 --2- 172.21.15.104:0/4099001548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bdc03a020 0x7f7bdc0cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.666 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.649+0000 7f7be259c640 1 -- 172.21.15.104:0/4099001548 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc0067a0 con 0x7f7bdc037230 2023-09-13T02:11:59.666 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.649+0000 7f4026ffd640 1 --2- 172.21.15.104:0/599594978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4028071650 0x7f40280b5f20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f401800c410 tx=0x7f401800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:11:59.667 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.649+0000 7f7be259c640 1 --2- 172.21.15.104:0/4099001548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bdc037230 0x7f7bdc0c5bc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400b450 tx=0x7f7bd400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:11:59.667 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.649+0000 7f7bd2ffd640 1 -- 172.21.15.104:0/4099001548 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4011890 con 0x7f7bdc037230 2023-09-13T02:11:59.668 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.649+0000 7f7bd2ffd640 1 -- 172.21.15.104:0/4099001548 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7bd4011b00 con 0x7f7bdc037230 2023-09-13T02:11:59.668 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.649+0000 7f7be359e640 1 -- 172.21.15.104:0/4099001548 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bdc0bd920 con 0x7f7bdc037230 2023-09-13T02:11:59.668 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.649+0000 7f7be359e640 1 -- 172.21.15.104:0/4099001548 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bdc0c6220 con 0x7f7bdc037230 2023-09-13T02:11:59.668 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.650+0000 7f7bd2ffd640 1 -- 172.21.15.104:0/4099001548 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd40103e0 con 0x7f7bdc037230 2023-09-13T02:11:59.668 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.650+0000 7f7bd2ffd640 1 -- 172.21.15.104:0/4099001548 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7bd4010900 con 0x7f7bdc037230 2023-09-13T02:11:59.669 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.650+0000 7f7bd2ffd640 1 -- 172.21.15.104:0/4099001548 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7bd401a950 con 0x7f7bdc037230 2023-09-13T02:11:59.669 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.653+0000 7fceba933640 1 -- 172.21.15.104:0/3412604266 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fce9c003970 msgr2=0x7fce9c003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.669 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.653+0000 7fceba933640 1 --2- 172.21.15.104:0/3412604266 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fce9c003970 0x7fce9c003d50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcea4003ae0 tx=0x7fce9c0057f0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.669 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.654+0000 7fceba933640 1 -- 172.21.15.104:0/3412604266 shutdown_connections 2023-09-13T02:11:59.670 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.654+0000 7fceba933640 1 --2- 172.21.15.104:0/3412604266 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fce9c003970 0x7fce9c003d50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.670 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.654+0000 7fceba933640 1 -- 172.21.15.104:0/3412604266 >> 172.21.15.104:0/3412604266 conn(0x7fceb4069570 msgr2=0x7fceb4069980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.671 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.654+0000 7f40177fe640 1 -- 172.21.15.104:0/599594978 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40180052e0 con 0x7f4028071650 2023-09-13T02:11:59.671 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.654+0000 7f402d7ca640 1 -- 172.21.15.104:0/599594978 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4028134cc0 con 0x7f4028071650 2023-09-13T02:11:59.671 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.654+0000 7f402d7ca640 1 -- 172.21.15.104:0/599594978 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40280b6720 con 0x7f4028071650 2023-09-13T02:11:59.671 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.655+0000 7f40177fe640 1 -- 172.21.15.104:0/599594978 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4018005440 con 0x7f4028071650 2023-09-13T02:11:59.672 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.655+0000 7f40177fe640 1 -- 172.21.15.104:0/599594978 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018003830 con 0x7f4028071650 2023-09-13T02:11:59.672 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.655+0000 7f40157fa640 1 -- 172.21.15.104:0/599594978 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402804e100 con 0x7f4028071650 2023-09-13T02:11:59.672 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.659+0000 7f40177fe640 1 -- 172.21.15.104:0/599594978 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4018003d10 con 0x7f4028071650 2023-09-13T02:11:59.672 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.659+0000 7f40177fe640 1 -- 172.21.15.104:0/599594978 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4018034410 con 0x7f4028071650 2023-09-13T02:11:59.673 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.659+0000 7feb7ac4b640 1 -- 172.21.15.104:0/3854221291 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) v1 -- 0x7feb54005870 con 0x7feb740885c0 2023-09-13T02:11:59.673 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.660+0000 7f7be359e640 1 -- 172.21.15.104:0/4099001548 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc8005250 con 0x7f7bdc037230 2023-09-13T02:11:59.673 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.660+0000 7fceba933640 1 -- 172.21.15.104:0/3412604266 shutdown_connections 2023-09-13T02:11:59.674 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.661+0000 7ff6c2f33640 1 -- 172.21.15.104:0/237949699 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6bc0717d0 msgr2=0x7ff6bc1438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.674 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.661+0000 7ff6c2f33640 1 --2- 172.21.15.104:0/237949699 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6bc0717d0 0x7ff6bc1438f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00afd0 tx=0x7ff6ac02cd20 comp rx=0 tx=0).stop 2023-09-13T02:11:59.674 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.661+0000 7ff6c2f33640 1 -- 172.21.15.104:0/237949699 shutdown_connections 2023-09-13T02:11:59.675 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.661+0000 7ff6c2f33640 1 --2- 172.21.15.104:0/237949699 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6bc0717d0 0x7ff6bc1438f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.675 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.661+0000 7ff6c2f33640 1 --2- 172.21.15.104:0/237949699 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6bc0ad0d0 0x7ff6bc070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.675 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.661+0000 7ff6c2f33640 1 -- 172.21.15.104:0/237949699 >> 172.21.15.104:0/237949699 conn(0x7ff6bc0b56f0 msgr2=0x7ff6bc0b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.675 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.661+0000 7fceba933640 1 -- 172.21.15.104:0/3412604266 wait complete. 2023-09-13T02:11:59.676 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.677 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.662+0000 7f40177fe640 1 -- 172.21.15.104:0/599594978 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f4018039070 con 0x7f4028071650 2023-09-13T02:11:59.677 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.664+0000 7ff6c2f33640 1 -- 172.21.15.104:0/237949699 shutdown_connections 2023-09-13T02:11:59.680 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.663+0000 7fceba933640 1 Processor -- start 2023-09-13T02:11:59.680 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.663+0000 7fceba933640 1 -- start start 2023-09-13T02:11:59.680 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.664+0000 7fceba933640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce9c003970 0x7fceb4070190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.680 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.664+0000 7fceba933640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceb413ef70 0x7fceb41de200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.680 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.664+0000 7fceba933640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fceb4140ac0 0x7fceb41371a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.681 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.664+0000 7fceba933640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb4140fd0 con 0x7fce9c003970 2023-09-13T02:11:59.681 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.664+0000 7fceba933640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb41412b0 con 0x7fceb413ef70 2023-09-13T02:11:59.681 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.664+0000 7fceba933640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb413f4a0 con 0x7fceb4140ac0 2023-09-13T02:11:59.681 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.665+0000 7fceb8ed0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fceb4140ac0 0x7fceb41371a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.681 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.665+0000 7fceb8ed0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fceb4140ac0 0x7fceb41371a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.104:37356/0 (socket says 172.21.15.104:37356) 2023-09-13T02:11:59.682 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.665+0000 7fceb8ed0640 1 -- 172.21.15.104:0/1911759303 learned_addr learned my addr 172.21.15.104:0/1911759303 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:11:59.682 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.665+0000 7fceb3fff640 1 --2- 172.21.15.104:0/1911759303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce9c003970 0x7fceb4070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.682 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.665+0000 7fceb3fff640 1 -- 172.21.15.104:0/1911759303 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fceb4140ac0 msgr2=0x7fceb41371a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.682 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.665+0000 7fceb3fff640 1 --2- 172.21.15.104:0/1911759303 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fceb4140ac0 0x7fceb41371a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.682 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.665+0000 7fceb3fff640 1 -- 172.21.15.104:0/1911759303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceb413ef70 msgr2=0x7fceb41de200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T02:11:59.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.665+0000 7fceb3fff640 1 --2- 172.21.15.104:0/1911759303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceb413ef70 0x7fceb41de200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.665+0000 7fceb3fff640 1 -- 172.21.15.104:0/1911759303 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb413f780 con 0x7fce9c003970 2023-09-13T02:11:59.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.666+0000 7fceb3fff640 1 --2- 172.21.15.104:0/1911759303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce9c003970 0x7fceb4070190 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcea4031000 tx=0x7fcea4001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:11:59.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.667+0000 7fceb0ff9640 1 -- 172.21.15.104:0/1911759303 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea403c070 con 0x7fce9c003970 2023-09-13T02:11:59.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.667+0000 7fceba933640 1 -- 172.21.15.104:0/1911759303 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb413fa60 con 0x7fce9c003970 2023-09-13T02:11:59.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.667+0000 7fceba933640 1 -- 172.21.15.104:0/1911759303 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb413ff80 con 0x7fce9c003970 2023-09-13T02:11:59.684 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.667+0000 7fceb0ff9640 1 -- 172.21.15.104:0/1911759303 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcea40018f0 con 0x7fce9c003970 2023-09-13T02:11:59.684 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.667+0000 7fceb0ff9640 1 -- 172.21.15.104:0/1911759303 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40046e0 con 0x7fce9c003970 2023-09-13T02:11:59.684 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.668+0000 7fceb0ff9640 1 -- 172.21.15.104:0/1911759303 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcea403f020 con 0x7fce9c003970 2023-09-13T02:11:59.684 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.668+0000 7fceb0ff9640 1 -- 172.21.15.104:0/1911759303 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcea402d8d0 con 0x7fce9c003970 2023-09-13T02:11:59.685 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.667+0000 7ff6c2f33640 1 -- 172.21.15.104:0/237949699 wait complete. 2023-09-13T02:11:59.685 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.668+0000 7ff6c2f33640 1 Processor -- start 2023-09-13T02:11:59.685 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.669+0000 7fb0c88fc640 1 -- 172.21.15.104:0/2758877053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c40717d0 msgr2=0x7fb0c41438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.686 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.669+0000 7fb0c88fc640 1 --2- 172.21.15.104:0/2758877053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c40717d0 0x7fb0c41438f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40b35a0 tx=0x7fb0b402bd40 comp rx=0 tx=0).stop 2023-09-13T02:11:59.686 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.669+0000 7fb0c88fc640 1 -- 172.21.15.104:0/2758877053 shutdown_connections 2023-09-13T02:11:59.686 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.669+0000 7fb0c88fc640 1 --2- 172.21.15.104:0/2758877053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c40ae330 0x7fb0c4143e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.686 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.669+0000 7fb0c88fc640 1 --2- 172.21.15.104:0/2758877053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c40717d0 0x7fb0c41438f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.686 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.669+0000 7fb0c88fc640 1 --2- 172.21.15.104:0/2758877053 >> v2:172.21.15.104:3300/0 conn(0x7fb0c40ad0d0 0x7fb0c4070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.687 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.669+0000 7fb0c88fc640 1 -- 172.21.15.104:0/2758877053 >> 172.21.15.104:0/2758877053 conn(0x7fb0c40b56f0 msgr2=0x7fb0c40b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.687 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.669+0000 7ff6c2f33640 1 -- start start 2023-09-13T02:11:59.687 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.670+0000 7ff6c2f33640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6bc0717d0 0x7ff6bc140a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.688 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.670+0000 7ff6c2f33640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6bc0ad0d0 0x7ff6bc1ea8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.688 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.670+0000 7ff6c2f33640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6bc0ae330 0x7ff6bc13aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.688 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.670+0000 7ff6c2f33640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc13c510 con 0x7ff6bc0ae330 2023-09-13T02:11:59.688 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.670+0000 7ff6c2f33640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc13c270 con 0x7ff6bc0ad0d0 2023-09-13T02:11:59.688 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.670+0000 7ff6c2f33640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc06e990 con 0x7ff6bc0717d0 2023-09-13T02:11:59.689 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.670+0000 7ff6bbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6bc0ad0d0 0x7ff6bc1ea8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.689 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.670+0000 7ff6bbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6bc0ad0d0 0x7ff6bc1ea8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.104:58242/0 (socket says 172.21.15.104:58242) 2023-09-13T02:11:59.689 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.671+0000 7ff6bbfff640 1 -- 172.21.15.104:0/3007833611 learned_addr learned my addr 172.21.15.104:0/3007833611 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:11:59.689 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.671+0000 7ff6bbfff640 1 -- 172.21.15.104:0/3007833611 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6bc0717d0 msgr2=0x7ff6bc140a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T02:11:59.689 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.671+0000 7ff6bbfff640 1 --2- 172.21.15.104:0/3007833611 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6bc0717d0 0x7ff6bc140a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.690 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.671+0000 7ff6bbfff640 1 -- 172.21.15.104:0/3007833611 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6bc0ae330 msgr2=0x7ff6bc13aaa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T02:11:59.690 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.671+0000 7ff6bbfff640 1 --2- 172.21.15.104:0/3007833611 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6bc0ae330 0x7ff6bc13aaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.690 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.671+0000 7ff6bbfff640 1 -- 172.21.15.104:0/3007833611 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac007490 con 0x7ff6bc0ad0d0 2023-09-13T02:11:59.690 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.671+0000 7feb717fa640 1 -- 172.21.15.104:0/3854221291 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v11)=0 v11) v1 ==== 116+0+0 (secure 0 0 0) 0x7feb6402a0b0 con 0x7feb740885c0 2023-09-13T02:11:59.691 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.671+0000 7ff6bbfff640 1 --2- 172.21.15.104:0/3007833611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6bc0ad0d0 0x7ff6bc1ea8c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00afd0 tx=0x7ff6ac007c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:11:59.691 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.671+0000 7ff6b97fa640 1 -- 172.21.15.104:0/3007833611 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac043070 con 0x7ff6bc0ad0d0 2023-09-13T02:11:59.691 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.671+0000 7ff6b97fa640 1 -- 172.21.15.104:0/3007833611 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff6ac003970 con 0x7ff6bc0ad0d0 2023-09-13T02:11:59.692 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.671+0000 7ff6c2f33640 1 -- 172.21.15.104:0/3007833611 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6bc06ec70 con 0x7ff6bc0ad0d0 2023-09-13T02:11:59.692 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.671+0000 7ff6c2f33640 1 -- 172.21.15.104:0/3007833611 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6bc13c880 con 0x7ff6bc0ad0d0 2023-09-13T02:11:59.692 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.673+0000 7ff6b97fa640 1 -- 172.21.15.104:0/3007833611 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac003d40 con 0x7ff6bc0ad0d0 2023-09-13T02:11:59.692 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.673+0000 7ff6b97fa640 1 -- 172.21.15.104:0/3007833611 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff6ac00a5e0 con 0x7ff6bc0ad0d0 2023-09-13T02:11:59.692 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.673+0000 7ff6b97fa640 1 -- 172.21.15.104:0/3007833611 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff6ac0044f0 con 0x7ff6bc0ad0d0 2023-09-13T02:11:59.693 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.673+0000 7feb7ac4b640 1 -- 172.21.15.104:0/3854221291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb740885c0 msgr2=0x7feb74157170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.693 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.673+0000 7feb7ac4b640 1 --2- 172.21.15.104:0/3854221291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb740885c0 0x7feb74157170 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7feb6400c780 tx=0x7feb6400cc40 comp rx=0 tx=0).stop 2023-09-13T02:11:59.694 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.669+0000 7fb0c88fc640 1 -- 172.21.15.104:0/2758877053 shutdown_connections 2023-09-13T02:11:59.694 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.669+0000 7fb0c88fc640 1 -- 172.21.15.104:0/2758877053 wait complete. 2023-09-13T02:11:59.694 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.671+0000 7fb0c88fc640 1 Processor -- start 2023-09-13T02:11:59.694 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.671+0000 7fb0c88fc640 1 -- start start 2023-09-13T02:11:59.695 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.673+0000 7feb7ac4b640 1 -- 172.21.15.104:0/3854221291 shutdown_connections 2023-09-13T02:11:59.695 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.674+0000 7feb7ac4b640 1 --2- 172.21.15.104:0/3854221291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb740a6730 0x7feb741593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.695 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.673+0000 7ff6c2f33640 1 -- 172.21.15.104:0/3007833611 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a0005250 con 0x7ff6bc0ad0d0 2023-09-13T02:11:59.696 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.674+0000 7feb7ac4b640 1 --2- 172.21.15.104:0/3854221291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb740ae3e0 0x7feb74158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.696 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.674+0000 7feb7ac4b640 1 --2- 172.21.15.104:0/3854221291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb740885c0 0x7feb74157170 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.696 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.674+0000 7feb7ac4b640 1 -- 172.21.15.104:0/3854221291 >> 172.21.15.104:0/3854221291 conn(0x7feb740699e0 msgr2=0x7feb740b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.697 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.674+0000 7f7bd2ffd640 1 -- 172.21.15.104:0/4099001548 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f7bd4015020 con 0x7f7bdc037230 2023-09-13T02:11:59.697 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.672+0000 7fb0c88fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c40ad0d0 0x7fb0c40b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.697 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.672+0000 7fb0c88fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c40ae330 0x7fb0c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.698 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.672+0000 7fb0c88fc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c406e860 0x7fb0c413adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:11:59.698 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.672+0000 7fb0c88fc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c406edc0 con 0x7fb0c40ae330 2023-09-13T02:11:59.698 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.672+0000 7fb0c88fc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c4139900 con 0x7fb0c40ad0d0 2023-09-13T02:11:59.698 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.672+0000 7fb0c88fc640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c406dc00 con 0x7fb0c406e860 2023-09-13T02:11:59.698 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.672+0000 7fb0c2d9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c406e860 0x7fb0c413adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.672+0000 7fb0c2d9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c406e860 0x7fb0c413adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.104:37374/0 (socket says 172.21.15.104:37374) 2023-09-13T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.672+0000 7fb0c2d9d640 1 -- 172.21.15.104:0/2088418281 learned_addr learned my addr 172.21.15.104:0/2088418281 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.672+0000 7fb0c1d9b640 1 --2- 172.21.15.104:0/2088418281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c40ae330 0x7fb0c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.673+0000 7fb0c2d9d640 1 -- 172.21.15.104:0/2088418281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c40ad0d0 msgr2=0x7fb0c40b4a30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-13T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.673+0000 7fb0c2d9d640 1 --2- 172.21.15.104:0/2088418281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c40ad0d0 0x7fb0c40b4a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.673+0000 7fb0c2d9d640 1 -- 172.21.15.104:0/2088418281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c40ae330 msgr2=0x7fb0c406e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.700 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.673+0000 7fb0c2d9d640 1 --2- 172.21.15.104:0/2088418281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c40ae330 0x7fb0c406e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.700 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.674+0000 7feb7ac4b640 1 -- 172.21.15.104:0/3854221291 shutdown_connections 2023-09-13T02:11:59.700 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.674+0000 7feb7ac4b640 1 -- 172.21.15.104:0/3854221291 wait complete. 2023-09-13T02:11:59.701 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.673+0000 7fb0c2d9d640 1 -- 172.21.15.104:0/2088418281 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b4009560 con 0x7fb0c406e860 2023-09-13T02:11:59.701 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.673+0000 7fb0c1d9b640 1 --2- 172.21.15.104:0/2088418281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c40ae330 0x7fb0c406e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T02:11:59.701 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.673+0000 7fb0c2d9d640 1 --2- 172.21.15.104:0/2088418281 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c406e860 0x7fb0c413adc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800e970 tx=0x7fb0b800ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:11:59.701 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.674+0000 7fceba933640 1 -- 172.21.15.104:0/1911759303 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce94005250 con 0x7fce9c003970 2023-09-13T02:11:59.702 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.674+0000 7fb0b2ffd640 1 -- 172.21.15.104:0/2088418281 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b800ccc0 con 0x7fb0c406e860 2023-09-13T02:11:59.702 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.669+0000 7f6f49ffb640 1 -- 172.21.15.104:0/1595775344 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) v1 -- 0x7f6f640650f0 con 0x7f6f640b0850 2023-09-13T02:11:59.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.674+0000 7fb0c88fc640 1 -- 172.21.15.104:0/2088418281 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c406dee0 con 0x7fb0c406e860 2023-09-13T02:11:59.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.674+0000 7fb0c88fc640 1 -- 172.21.15.104:0/2088418281 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c413b300 con 0x7fb0c406e860 2023-09-13T02:11:59.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.676+0000 7ff6b97fa640 1 -- 172.21.15.104:0/3007833611 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7ff6ac004700 con 0x7ff6bc0ad0d0 2023-09-13T02:11:59.704 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.675+0000 7fb0b2ffd640 1 -- 172.21.15.104:0/2088418281 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb0b800ce20 con 0x7fb0c406e860 2023-09-13T02:11:59.704 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.675+0000 7fb0b2ffd640 1 -- 172.21.15.104:0/2088418281 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8005280 con 0x7fb0c406e860 2023-09-13T02:11:59.704 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.675+0000 7fb0b2ffd640 1 -- 172.21.15.104:0/2088418281 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb0b8005420 con 0x7fb0c406e860 2023-09-13T02:11:59.704 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.675+0000 7fb0b2ffd640 1 -- 172.21.15.104:0/2088418281 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb0b8014070 con 0x7fb0c406e860 2023-09-13T02:11:59.705 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.677+0000 7fb0c88fc640 1 -- 172.21.15.104:0/2088418281 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a8005250 con 0x7fb0c406e860 2023-09-13T02:11:59.705 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.679+0000 7fb0b2ffd640 1 -- 172.21.15.104:0/2088418281 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fb0b80047a0 con 0x7fb0c406e860 2023-09-13T02:11:59.705 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.680+0000 7fceb0ff9640 1 -- 172.21.15.104:0/1911759303 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fcea4047060 con 0x7fce9c003970 2023-09-13T02:11:59.706 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.685+0000 7f6f4bfff640 1 -- 172.21.15.104:0/1595775344 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v12)=0 v12) v1 ==== 116+0+0 (secure 0 0 0) 0x7f6f58014bd0 con 0x7f6f640b0850 2023-09-13T02:11:59.706 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.687+0000 7f6f49ffb640 1 -- 172.21.15.104:0/1595775344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f640b0850 msgr2=0x7f6f64087dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.706 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.687+0000 7f6f49ffb640 1 --2- 172.21.15.104:0/1595775344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f640b0850 0x7f6f64087dc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800b780 tx=0x7f6f5800bb80 comp rx=0 tx=0).stop 2023-09-13T02:11:59.707 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.687+0000 7f6f49ffb640 1 -- 172.21.15.104:0/1595775344 shutdown_connections 2023-09-13T02:11:59.707 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.687+0000 7f6f49ffb640 1 --2- 172.21.15.104:0/1595775344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f640b0850 0x7f6f64087dc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.707 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.687+0000 7f6f49ffb640 1 --2- 172.21.15.104:0/1595775344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f640ae3e0 0x7f6f64087880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.707 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.687+0000 7f6f49ffb640 1 --2- 172.21.15.104:0/1595775344 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f640885c0 0x7f6f641dc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.707 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.687+0000 7f6f49ffb640 1 -- 172.21.15.104:0/1595775344 >> 172.21.15.104:0/1595775344 conn(0x7f6f640699e0 msgr2=0x7f6f640b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.708 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.691+0000 7f6f49ffb640 1 -- 172.21.15.104:0/1595775344 shutdown_connections 2023-09-13T02:11:59.708 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.691+0000 7f6f49ffb640 1 -- 172.21.15.104:0/1595775344 wait complete. 2023-09-13T02:11:59.709 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.709 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.776 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.776+0000 7f533c21a640 1 -- 172.21.15.104:0/1737715144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) v1 -- 0x7f53341faef0 con 0x7f5334154500 2023-09-13T02:11:59.779 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.780+0000 7efc78dce640 1 -- 172.21.15.104:0/1080574231 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) v1 -- 0x7efc740711f0 con 0x7efc740acb30 2023-09-13T02:11:59.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.780+0000 7f08d8c90640 1 -- 172.21.15.104:0/481806524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f08b40050c0 con 0x7f08d4071720 2023-09-13T02:11:59.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.780+0000 7f009a705640 1 -- 172.21.15.104:0/1694885062 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) v1 -- 0x7f0094066c00 con 0x7f0094088060 2023-09-13T02:11:59.782 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.783+0000 7f532a7fc640 1 -- 172.21.15.104:0/1737715144 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v13)=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f53341faef0 con 0x7f5334154500 2023-09-13T02:11:59.784 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.784+0000 7f533c21a640 1 -- 172.21.15.104:0/1737715144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5334154500 msgr2=0x7f53340a7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.784 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.784+0000 7f533c21a640 1 --2- 172.21.15.104:0/1737715144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5334154500 0x7f53340a7ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f532400c410 tx=0x7f532400c8d0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.784 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.784+0000 7f533c21a640 1 -- 172.21.15.104:0/1737715144 shutdown_connections 2023-09-13T02:11:59.785 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.784+0000 7f533c21a640 1 --2- 172.21.15.104:0/1737715144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53341db6d0 0x7f53341ed9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.785 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.784+0000 7f533c21a640 1 --2- 172.21.15.104:0/1737715144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5334154500 0x7f53340a7ab0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.785 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.784+0000 7f533c21a640 1 --2- 172.21.15.104:0/1737715144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53340ae540 0x7f53341fb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.785 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.784+0000 7f533c21a640 1 -- 172.21.15.104:0/1737715144 >> 172.21.15.104:0/1737715144 conn(0x7f53340b56f0 msgr2=0x7f5334152c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.785 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.784+0000 7f533c21a640 1 -- 172.21.15.104:0/1737715144 shutdown_connections 2023-09-13T02:11:59.786 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.784+0000 7f533c21a640 1 -- 172.21.15.104:0/1737715144 wait complete. 2023-09-13T02:11:59.790 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.790+0000 7f41c8075640 1 -- 172.21.15.104:0/2028061288 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7f41b8036ff0 con 0x7f41b8034890 2023-09-13T02:11:59.791 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.791+0000 7f08bbfff640 1 -- 172.21.15.104:0/481806524 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v14)=0 v14) v1 ==== 121+0+0 (secure 0 0 0) 0x7f08cc003d10 con 0x7f08d4071720 2023-09-13T02:11:59.792 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.792+0000 7f08d8c90640 1 -- 172.21.15.104:0/481806524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08d4071720 msgr2=0x7f08d40a8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.792 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.792+0000 7f08d8c90640 1 --2- 172.21.15.104:0/481806524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08d4071720 0x7f08d40a8ad0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00cc40 tx=0x7f08cc00a430 comp rx=0 tx=0).stop 2023-09-13T02:11:59.793 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.792+0000 7f08d8c90640 1 -- 172.21.15.104:0/481806524 shutdown_connections 2023-09-13T02:11:59.793 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.792+0000 7f08d8c90640 1 --2- 172.21.15.104:0/481806524 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08d4154d00 0x7f08d40ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.793 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.792+0000 7f08d8c90640 1 --2- 172.21.15.104:0/481806524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08d4071720 0x7f08d40a8ad0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.793 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.793+0000 7f08d8c90640 1 --2- 172.21.15.104:0/481806524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08d4071340 0x7f08d4155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.794 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.793+0000 7f08d8c90640 1 -- 172.21.15.104:0/481806524 >> 172.21.15.104:0/481806524 conn(0x7f08d4069970 msgr2=0x7f08d40b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.794 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.793+0000 7f08d8c90640 1 -- 172.21.15.104:0/481806524 shutdown_connections 2023-09-13T02:11:59.794 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.793+0000 7f08d8c90640 1 -- 172.21.15.104:0/481806524 wait complete. 2023-09-13T02:11:59.795 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.794+0000 7efc62ffd640 1 -- 172.21.15.104:0/1080574231 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v15)=0 v15) v1 ==== 115+0+0 (secure 0 0 0) 0x7efc68028030 con 0x7efc740acb30 2023-09-13T02:11:59.795 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.796+0000 7efc60ff9640 1 -- 172.21.15.104:0/1080574231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc740acb30 msgr2=0x7efc74140e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.796 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.796+0000 7efc60ff9640 1 --2- 172.21.15.104:0/1080574231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc740acb30 0x7efc74140e30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efc6800b3e0 tx=0x7efc6800b8a0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.798 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.798+0000 7efc60ff9640 1 -- 172.21.15.104:0/1080574231 shutdown_connections 2023-09-13T02:11:59.798 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.798+0000 7efc60ff9640 1 --2- 172.21.15.104:0/1080574231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc740af900 0x7efc74070220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.798 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.798+0000 7efc60ff9640 1 --2- 172.21.15.104:0/1080574231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc740acf10 0x7efc741de340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.798 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.798+0000 7efc60ff9640 1 --2- 172.21.15.104:0/1080574231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc740acb30 0x7efc74140e30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.798 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.798+0000 7efc60ff9640 1 -- 172.21.15.104:0/1080574231 >> 172.21.15.104:0/1080574231 conn(0x7efc740b56f0 msgr2=0x7efc740653e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.799 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.798+0000 7efc60ff9640 1 -- 172.21.15.104:0/1080574231 shutdown_connections 2023-09-13T02:11:59.799 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.798+0000 7efc60ff9640 1 -- 172.21.15.104:0/1080574231 wait complete. 2023-09-13T02:11:59.800 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.802 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.802+0000 7f0090ff9640 1 -- 172.21.15.104:0/1694885062 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v16)=0 v16) v1 ==== 119+0+0 (secure 0 0 0) 0x7f0088006b40 con 0x7f0094088060 2023-09-13T02:11:59.803 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.803+0000 7f40157fa640 1 -- 172.21.15.104:0/599594978 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) v1 -- 0x7f402813b080 con 0x7f4028071650 2023-09-13T02:11:59.805 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.805+0000 7f009a705640 1 -- 172.21.15.104:0/1694885062 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0094088060 msgr2=0x7f00941eea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.805 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.805+0000 7f009a705640 1 --2- 172.21.15.104:0/1694885062 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0094088060 0x7f00941eea10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f008802c8f0 tx=0x7f0088001640 comp rx=0 tx=0).stop 2023-09-13T02:11:59.806 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.805+0000 7f009a705640 1 -- 172.21.15.104:0/1694885062 shutdown_connections 2023-09-13T02:11:59.806 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.805+0000 7f009a705640 1 --2- 172.21.15.104:0/1694885062 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0094088060 0x7f00941eea10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.806 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.805+0000 7f009a705640 1 --2- 172.21.15.104:0/1694885062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00941e2c80 0x7f00941d5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.806 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.805+0000 7f009a705640 1 --2- 172.21.15.104:0/1694885062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00941e1b60 0x7f00941d5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.807 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.805+0000 7f009a705640 1 -- 172.21.15.104:0/1694885062 >> 172.21.15.104:0/1694885062 conn(0x7f00940699e0 msgr2=0x7f00940653e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.807 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.805+0000 7f009a705640 1 -- 172.21.15.104:0/1694885062 shutdown_connections 2023-09-13T02:11:59.807 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.805+0000 7f009a705640 1 -- 172.21.15.104:0/1694885062 wait complete. 2023-09-13T02:11:59.811 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.811+0000 7f41b67fc640 1 -- 172.21.15.104:0/2028061288 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v17)=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f41c00ce0c0 con 0x7f41b8034890 2023-09-13T02:11:59.814 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.813+0000 7f41c8075640 1 -- 172.21.15.104:0/2028061288 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41b8034890 msgr2=0x7f41b80c76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.814 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.813+0000 7f41c8075640 1 --2- 172.21.15.104:0/2028061288 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41b8034890 0x7f41b80c76d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f41c0068280 tx=0x7f41c00ade50 comp rx=0 tx=0).stop 2023-09-13T02:11:59.815 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.813+0000 7f41c8075640 1 -- 172.21.15.104:0/2028061288 shutdown_connections 2023-09-13T02:11:59.815 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.813+0000 7f41c8075640 1 --2- 172.21.15.104:0/2028061288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41b80bcad0 0x7f41b80bbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.815 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.813+0000 7f41c8075640 1 --2- 172.21.15.104:0/2028061288 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41b8034890 0x7f41b80c76d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.815 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.813+0000 7f41c8075640 1 --2- 172.21.15.104:0/2028061288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41b8033c00 0x7f41b80c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.816 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.813+0000 7f41c8075640 1 -- 172.21.15.104:0/2028061288 >> 172.21.15.104:0/2028061288 conn(0x7f41b803a880 msgr2=0x7f41b8038cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.816 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.813+0000 7f41c8075640 1 -- 172.21.15.104:0/2028061288 shutdown_connections 2023-09-13T02:11:59.816 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.813+0000 7f41c8075640 1 -- 172.21.15.104:0/2028061288 wait complete. 2023-09-13T02:11:59.818 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.820 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.821+0000 7f40177fe640 1 -- 172.21.15.104:0/599594978 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v18)=0 v18) v1 ==== 121+0+0 (secure 0 0 0) 0x7f401803e440 con 0x7f4028071650 2023-09-13T02:11:59.822 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.822+0000 7f40157fa640 1 -- 172.21.15.104:0/599594978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4028071650 msgr2=0x7f40280b5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.823 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.822+0000 7f40157fa640 1 --2- 172.21.15.104:0/599594978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4028071650 0x7f40280b5f20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f401800c410 tx=0x7f401800c8d0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.823 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.822+0000 7f40157fa640 1 -- 172.21.15.104:0/599594978 shutdown_connections 2023-09-13T02:11:59.823 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.822+0000 7f40157fa640 1 --2- 172.21.15.104:0/599594978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40280b2e60 0x7f40281de6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.824 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.822+0000 7f40157fa640 1 --2- 172.21.15.104:0/599594978 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40280b23c0 0x7f40280b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.824 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.822+0000 7f40157fa640 1 --2- 172.21.15.104:0/599594978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4028071650 0x7f40280b5f20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.824 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.822+0000 7f40157fa640 1 -- 172.21.15.104:0/599594978 >> 172.21.15.104:0/599594978 conn(0x7f402806aa50 msgr2=0x7f402813a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.825 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.822+0000 7f40157fa640 1 -- 172.21.15.104:0/599594978 shutdown_connections 2023-09-13T02:11:59.825 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.822+0000 7f40157fa640 1 -- 172.21.15.104:0/599594978 wait complete. 2023-09-13T02:11:59.829 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.830 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.830+0000 7ff6c2f33640 1 -- 172.21.15.104:0/3007833611 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7ff6a0005500 con 0x7ff6bc0ad0d0 2023-09-13T02:11:59.831 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.831+0000 7fceba933640 1 -- 172.21.15.104:0/1911759303 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) v1 -- 0x7fce940050c0 con 0x7fce9c003970 2023-09-13T02:11:59.835 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.835+0000 7ff6b97fa640 1 -- 172.21.15.104:0/3007833611 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v19)=0 v19) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff6ac003ea0 con 0x7ff6bc0ad0d0 2023-09-13T02:11:59.837 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.836+0000 7ff6c2f33640 1 -- 172.21.15.104:0/3007833611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6bc0ad0d0 msgr2=0x7ff6bc1ea8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.837 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.836+0000 7ff6c2f33640 1 --2- 172.21.15.104:0/3007833611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6bc0ad0d0 0x7ff6bc1ea8c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00afd0 tx=0x7ff6ac007c80 comp rx=0 tx=0).stop 2023-09-13T02:11:59.837 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.836+0000 7ff6c2f33640 1 -- 172.21.15.104:0/3007833611 shutdown_connections 2023-09-13T02:11:59.838 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.836+0000 7ff6c2f33640 1 --2- 172.21.15.104:0/3007833611 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6bc0ae330 0x7ff6bc13aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.838 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.836+0000 7ff6c2f33640 1 --2- 172.21.15.104:0/3007833611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6bc0ad0d0 0x7ff6bc1ea8c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.838 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.836+0000 7ff6c2f33640 1 --2- 172.21.15.104:0/3007833611 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6bc0717d0 0x7ff6bc140a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.838 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.836+0000 7ff6c2f33640 1 -- 172.21.15.104:0/3007833611 >> 172.21.15.104:0/3007833611 conn(0x7ff6bc0b56f0 msgr2=0x7ff6bc0b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.839 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.836+0000 7ff6c2f33640 1 -- 172.21.15.104:0/3007833611 shutdown_connections 2023-09-13T02:11:59.839 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.836+0000 7ff6c2f33640 1 -- 172.21.15.104:0/3007833611 wait complete. 2023-09-13T02:11:59.840 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.841 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.841 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.842 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.839+0000 7fceb0ff9640 1 -- 172.21.15.104:0/1911759303 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v20)=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7fcea4003bb0 con 0x7fce9c003970 2023-09-13T02:11:59.843 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.840+0000 7fceba933640 1 -- 172.21.15.104:0/1911759303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce9c003970 msgr2=0x7fceb4070190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.843 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.840+0000 7fceba933640 1 --2- 172.21.15.104:0/1911759303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce9c003970 0x7fceb4070190 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcea4031000 tx=0x7fcea4001bb0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.843 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.840+0000 7fceba933640 1 -- 172.21.15.104:0/1911759303 shutdown_connections 2023-09-13T02:11:59.844 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.840+0000 7fceba933640 1 --2- 172.21.15.104:0/1911759303 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fceb4140ac0 0x7fceb41371a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.844 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.840+0000 7fceba933640 1 --2- 172.21.15.104:0/1911759303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceb413ef70 0x7fceb41de200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.844 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.840+0000 7fceba933640 1 --2- 172.21.15.104:0/1911759303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce9c003970 0x7fceb4070190 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.845 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.840+0000 7fceba933640 1 -- 172.21.15.104:0/1911759303 >> 172.21.15.104:0/1911759303 conn(0x7fceb4069570 msgr2=0x7fceb4142ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.845 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.841+0000 7fceba933640 1 -- 172.21.15.104:0/1911759303 shutdown_connections 2023-09-13T02:11:59.845 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.841+0000 7fceba933640 1 -- 172.21.15.104:0/1911759303 wait complete. 2023-09-13T02:11:59.846 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.843+0000 7f7be359e640 1 -- 172.21.15.104:0/4099001548 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f7bc80050c0 con 0x7f7bdc037230 2023-09-13T02:11:59.849 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.849+0000 7f7bd2ffd640 1 -- 172.21.15.104:0/4099001548 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v21)=0 v21) v1 ==== 120+0+0 (secure 0 0 0) 0x7f7bd40290b0 con 0x7f7bdc037230 2023-09-13T02:11:59.850 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.849+0000 7f7be359e640 1 -- 172.21.15.104:0/4099001548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bdc037230 msgr2=0x7f7bdc0c5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.850 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.849+0000 7f7be359e640 1 --2- 172.21.15.104:0/4099001548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bdc037230 0x7f7bdc0c5bc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400b450 tx=0x7f7bd400b910 comp rx=0 tx=0).stop 2023-09-13T02:11:59.850 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.850+0000 7f7be359e640 1 -- 172.21.15.104:0/4099001548 shutdown_connections 2023-09-13T02:11:59.851 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.850+0000 7f7be359e640 1 --2- 172.21.15.104:0/4099001548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bdc03a020 0x7f7bdc0cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.851 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.850+0000 7f7be359e640 1 --2- 172.21.15.104:0/4099001548 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bdc038ec0 0x7f7bdc0c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.851 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.850+0000 7f7be359e640 1 --2- 172.21.15.104:0/4099001548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bdc037230 0x7f7bdc0c5bc0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.851 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.850+0000 7f7be359e640 1 -- 172.21.15.104:0/4099001548 >> 172.21.15.104:0/4099001548 conn(0x7f7bdc03a8e0 msgr2=0x7f7bdc0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.853 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.850+0000 7f7be359e640 1 -- 172.21.15.104:0/4099001548 shutdown_connections 2023-09-13T02:11:59.853 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.850+0000 7f7be359e640 1 -- 172.21.15.104:0/4099001548 wait complete. 2023-09-13T02:11:59.854 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.852+0000 7fb0c88fc640 1 -- 172.21.15.104:0/2088418281 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7fb0a80050c0 con 0x7fb0c406e860 2023-09-13T02:11:59.857 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.858+0000 7fb0b2ffd640 1 -- 172.21.15.104:0/2088418281 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v22)=0 v22) v1 ==== 121+0+0 (secure 0 0 0) 0x7fb0b8004940 con 0x7fb0c406e860 2023-09-13T02:11:59.859 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.858+0000 7fb0c88fc640 1 -- 172.21.15.104:0/2088418281 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c406e860 msgr2=0x7fb0c413adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:11:59.859 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.858+0000 7fb0c88fc640 1 --2- 172.21.15.104:0/2088418281 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c406e860 0x7fb0c413adc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800e970 tx=0x7fb0b800ed70 comp rx=0 tx=0).stop 2023-09-13T02:11:59.860 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.859+0000 7fb0c88fc640 1 -- 172.21.15.104:0/2088418281 shutdown_connections 2023-09-13T02:11:59.860 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.859+0000 7fb0c88fc640 1 --2- 172.21.15.104:0/2088418281 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c406e860 0x7fb0c413adc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.860 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.859+0000 7fb0c88fc640 1 --2- 172.21.15.104:0/2088418281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c40ae330 0x7fb0c406e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.861 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.859+0000 7fb0c88fc640 1 --2- 172.21.15.104:0/2088418281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c40ad0d0 0x7fb0c40b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:11:59.861 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.859+0000 7fb0c88fc640 1 -- 172.21.15.104:0/2088418281 >> 172.21.15.104:0/2088418281 conn(0x7fb0c40b56f0 msgr2=0x7fb0c40aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:11:59.861 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.859+0000 7fb0c88fc640 1 -- 172.21.15.104:0/2088418281 shutdown_connections 2023-09-13T02:11:59.861 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:11:59.859+0000 7fb0c88fc640 1 -- 172.21.15.104:0/2088418281 wait complete. 2023-09-13T02:11:59.863 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.863 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.864 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi104') 2023-09-13T02:11:59.869 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-13T02:11:59.870 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-09-13T02:11:59.870 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-09-13T02:11:59.911 INFO:tasks.ceph.mgr.y:Started 2023-09-13T02:11:59.912 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-13T02:11:59.912 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-13T02:11:59.915 INFO:tasks.ceph.mgr.x:Started 2023-09-13T02:11:59.916 INFO:tasks.ceph:Setting crush tunables to default 2023-09-13T02:11:59.916 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd crush tunables default 2023-09-13T02:12:00.018 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.017+0000 7fb67201a640 1 -- 172.21.15.104:0/3821302540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb66c147b90 msgr2=0x7fb66c1482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:00.019 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.017+0000 7fb67201a640 1 --2- 172.21.15.104:0/3821302540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb66c147b90 0x7fb66c1482f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb660009830 tx=0x7fb66002bd60 comp rx=0 tx=0).stop 2023-09-13T02:12:00.019 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.017+0000 7fb67201a640 1 -- 172.21.15.104:0/3821302540 shutdown_connections 2023-09-13T02:12:00.020 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.017+0000 7fb67201a640 1 --2- 172.21.15.104:0/3821302540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb66c147b90 0x7fb66c1482f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.020 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.017+0000 7fb67201a640 1 -- 172.21.15.104:0/3821302540 >> 172.21.15.104:0/3821302540 conn(0x7fb66c0708b0 msgr2=0x7fb66c070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:00.020 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.017+0000 7fb67201a640 1 -- 172.21.15.104:0/3821302540 shutdown_connections 2023-09-13T02:12:00.021 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.017+0000 7fb67201a640 1 -- 172.21.15.104:0/3821302540 wait complete. 2023-09-13T02:12:00.021 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.018+0000 7fb67201a640 1 Processor -- start 2023-09-13T02:12:00.022 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.018+0000 7fb67201a640 1 -- start start 2023-09-13T02:12:00.026 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.019+0000 7fb67201a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb66c0b5ba0 0x7fb66c131960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:00.027 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.019+0000 7fb67201a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb66c147b90 0x7fb66c1dd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:00.027 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.019+0000 7fb67201a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb66c1471d0 0x7fb66c137a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:00.027 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.019+0000 7fb67201a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c1de640 con 0x7fb66c1471d0 2023-09-13T02:12:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.019+0000 7fb67201a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c146310 con 0x7fb66c147b90 2023-09-13T02:12:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.019+0000 7fb67201a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c145e50 con 0x7fb66c0b5ba0 2023-09-13T02:12:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.019+0000 7fb66bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb66c1471d0 0x7fb66c137a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:00.029 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.019+0000 7fb66bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb66c1471d0 0x7fb66c137a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38272/0 (socket says 172.21.15.104:38272) 2023-09-13T02:12:00.029 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.019+0000 7fb66bfff640 1 -- 172.21.15.104:0/4115116057 learned_addr learned my addr 172.21.15.104:0/4115116057 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:00.030 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.019+0000 7fb66affd640 1 --2- 172.21.15.104:0/4115116057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb66c147b90 0x7fb66c1dd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:00.030 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.019+0000 7fb66b7fe640 1 --2- 172.21.15.104:0/4115116057 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb66c0b5ba0 0x7fb66c131960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:00.030 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.019+0000 7fb66affd640 1 -- 172.21.15.104:0/4115116057 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb66c0b5ba0 msgr2=0x7fb66c131960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:00.031 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.019+0000 7fb66affd640 1 --2- 172.21.15.104:0/4115116057 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb66c0b5ba0 0x7fb66c131960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.031 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.019+0000 7fb66affd640 1 -- 172.21.15.104:0/4115116057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb66c1471d0 msgr2=0x7fb66c137a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:00.032 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.019+0000 7fb66affd640 1 --2- 172.21.15.104:0/4115116057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb66c1471d0 0x7fb66c137a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.032 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.019+0000 7fb66affd640 1 -- 172.21.15.104:0/4115116057 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb660009490 con 0x7fb66c147b90 2023-09-13T02:12:00.032 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.020+0000 7fb66affd640 1 --2- 172.21.15.104:0/4115116057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb66c147b90 0x7fb66c1dd690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb66c06bb90 tx=0x7fb65c00c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:00.033 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.020+0000 7fb653fff640 1 -- 172.21.15.104:0/4115116057 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0052d0 con 0x7fb66c147b90 2023-09-13T02:12:00.033 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.020+0000 7fb653fff640 1 -- 172.21.15.104:0/4115116057 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb65c0035f0 con 0x7fb66c147b90 2023-09-13T02:12:00.033 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.020+0000 7fb67201a640 1 -- 172.21.15.104:0/4115116057 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66c070ed0 con 0x7fb66c147b90 2023-09-13T02:12:00.034 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.020+0000 7fb653fff640 1 -- 172.21.15.104:0/4115116057 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c003a00 con 0x7fb66c147b90 2023-09-13T02:12:00.034 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.020+0000 7fb67201a640 1 -- 172.21.15.104:0/4115116057 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66c146030 con 0x7fb66c147b90 2023-09-13T02:12:00.034 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.020+0000 7fb653fff640 1 -- 172.21.15.104:0/4115116057 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb65c011590 con 0x7fb66c147b90 2023-09-13T02:12:00.035 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.020+0000 7fb653fff640 1 -- 172.21.15.104:0/4115116057 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb65c01c7d0 con 0x7fb66c147b90 2023-09-13T02:12:00.035 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.021+0000 7fb67201a640 1 -- 172.21.15.104:0/4115116057 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66c0b1610 con 0x7fb66c147b90 2023-09-13T02:12:00.035 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.023+0000 7fb653fff640 1 -- 172.21.15.104:0/4115116057 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fb65c017070 con 0x7fb66c147b90 2023-09-13T02:12:00.087 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.087+0000 7fb67201a640 1 -- 172.21.15.104:0/4115116057 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb66c0b0f20 con 0x7fb66c147b90 2023-09-13T02:12:00.093 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.093+0000 7fb653fff640 1 -- 172.21.15.104:0/4115116057 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb65c011a20 con 0x7fb66c147b90 2023-09-13T02:12:00.093 INFO:teuthology.orchestra.run.smithi104.stderr:adjusted tunables profile to default 2023-09-13T02:12:00.094 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.094+0000 7fb67201a640 1 -- 172.21.15.104:0/4115116057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb66c147b90 msgr2=0x7fb66c1dd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.094+0000 7fb67201a640 1 --2- 172.21.15.104:0/4115116057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb66c147b90 0x7fb66c1dd690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb66c06bb90 tx=0x7fb65c00c820 comp rx=0 tx=0).stop 2023-09-13T02:12:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.094+0000 7fb67201a640 1 -- 172.21.15.104:0/4115116057 shutdown_connections 2023-09-13T02:12:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.094+0000 7fb67201a640 1 --2- 172.21.15.104:0/4115116057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb66c1471d0 0x7fb66c137a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.094+0000 7fb67201a640 1 --2- 172.21.15.104:0/4115116057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb66c147b90 0x7fb66c1dd690 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.094+0000 7fb67201a640 1 --2- 172.21.15.104:0/4115116057 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb66c0b5ba0 0x7fb66c131960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.096 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.094+0000 7fb67201a640 1 -- 172.21.15.104:0/4115116057 >> 172.21.15.104:0/4115116057 conn(0x7fb66c0708b0 msgr2=0x7fb66c138b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:00.096 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.094+0000 7fb67201a640 1 -- 172.21.15.104:0/4115116057 shutdown_connections 2023-09-13T02:12:00.096 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:00.094+0000 7fb67201a640 1 -- 172.21.15.104:0/4115116057 wait complete. 2023-09-13T02:12:00.104 INFO:tasks.ceph:check_enable_crimson: False 2023-09-13T02:12:00.104 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-13T02:12:00.105 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:12:00.105 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-13T02:12:00.131 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:12:00.132 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-13T02:12:00.198 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:12:00.199 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-13T02:12:00.264 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:12:00.265 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-13T02:12:00.332 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:12:00.332 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-09-13T02:12:00.359 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:12:00.359 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-09-13T02:12:00.425 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:12:00.425 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-09-13T02:12:00.491 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:00.491+0000 7f800d848040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-13T02:12:00.492 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-09-13T02:12:00.493 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-09-13T02:12:00.493 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:00.491+0000 7fb1dcc14040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-13T02:12:00.541 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:00.541+0000 7f800d848040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-13T02:12:00.545 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:00.544+0000 7fb1dcc14040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-13T02:12:00.559 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 67190066-4851-4b1f-aae8-bad59e79ebb5 0 2023-09-13T02:12:00.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.700+0000 7f5311d05640 1 -- 172.21.15.119:0/2311121414 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f530c0adc50 msgr2=0x7f530c1444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:00.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.700+0000 7f5311d05640 1 --2- 172.21.15.119:0/2311121414 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f530c0adc50 0x7f530c1444a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5300009860 tx=0x7f530002bcb0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.700+0000 7f5311d05640 1 -- 172.21.15.119:0/2311121414 shutdown_connections 2023-09-13T02:12:00.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.700+0000 7f5311d05640 1 --2- 172.21.15.119:0/2311121414 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f530c0adc50 0x7f530c1444a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.700+0000 7f5311d05640 1 -- 172.21.15.119:0/2311121414 >> 172.21.15.119:0/2311121414 conn(0x7f530c06aa50 msgr2=0x7f530c0b6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:00.702 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.700+0000 7f5311d05640 1 -- 172.21.15.119:0/2311121414 shutdown_connections 2023-09-13T02:12:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.700+0000 7f5311d05640 1 -- 172.21.15.119:0/2311121414 wait complete. 2023-09-13T02:12:00.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.701+0000 7f5311d05640 1 Processor -- start 2023-09-13T02:12:00.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.701+0000 7f5311d05640 1 -- start start 2023-09-13T02:12:00.705 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.702+0000 7f5311d05640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f530c0adc50 0x7f530c141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:00.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.702+0000 7f5311d05640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f530c0ae710 0x7f530c13f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:00.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.702+0000 7f5311d05640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f530c0af4c0 0x7f530c13f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:00.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.702+0000 7f5311d05640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c1440b0 con 0x7f530c0ae710 2023-09-13T02:12:00.706 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.702+0000 7f5311d05640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c140760 con 0x7f530c0af4c0 2023-09-13T02:12:00.707 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.702+0000 7f5311d05640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530c1439f0 con 0x7f530c0adc50 2023-09-13T02:12:00.707 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.702+0000 7f530b7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f530c0adc50 0x7f530c141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:00.707 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.702+0000 7f530bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f530c0af4c0 0x7f530c13f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:00.707 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.702+0000 7f530b7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f530c0adc50 0x7f530c141870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:58528/0 (socket says 172.21.15.119:58528) 2023-09-13T02:12:00.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.702+0000 7f530affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f530c0ae710 0x7f530c13f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:00.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.702+0000 7f530b7fe640 1 -- 172.21.15.119:0/2841616826 learned_addr learned my addr 172.21.15.119:0/2841616826 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-09-13T02:12:00.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.702+0000 7f530bfff640 1 -- 172.21.15.119:0/2841616826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f530c0adc50 msgr2=0x7f530c141870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:00.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.702+0000 7f530bfff640 1 --2- 172.21.15.119:0/2841616826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f530c0adc50 0x7f530c141870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.702+0000 7f530bfff640 1 -- 172.21.15.119:0/2841616826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f530c0ae710 msgr2=0x7f530c13f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:00.708 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.702+0000 7f530bfff640 1 --2- 172.21.15.119:0/2841616826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f530c0ae710 0x7f530c13f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.702+0000 7f530bfff640 1 -- 172.21.15.119:0/2841616826 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5300009490 con 0x7f530c0af4c0 2023-09-13T02:12:00.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.702+0000 7f530affd640 1 --2- 172.21.15.119:0/2841616826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f530c0ae710 0x7f530c13f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T02:12:00.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.703+0000 7f530bfff640 1 --2- 172.21.15.119:0/2841616826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f530c0af4c0 0x7f530c13f830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f530400caa0 tx=0x7f530400cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:00.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.703+0000 7f52f3fff640 1 -- 172.21.15.119:0/2841616826 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530400ac00 con 0x7f530c0af4c0 2023-09-13T02:12:00.709 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.703+0000 7f52f3fff640 1 -- 172.21.15.119:0/2841616826 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f530400ae50 con 0x7f530c0af4c0 2023-09-13T02:12:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.703+0000 7f5311d05640 1 -- 172.21.15.119:0/2841616826 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530c143cd0 con 0x7f530c0af4c0 2023-09-13T02:12:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.703+0000 7f52f3fff640 1 -- 172.21.15.119:0/2841616826 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304012680 con 0x7f530c0af4c0 2023-09-13T02:12:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.703+0000 7f5311d05640 1 -- 172.21.15.119:0/2841616826 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530c144310 con 0x7f530c0af4c0 2023-09-13T02:12:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.703+0000 7f52f3fff640 1 -- 172.21.15.119:0/2841616826 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5304012ae0 con 0x7f530c0af4c0 2023-09-13T02:12:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.703+0000 7f52f3fff640 1 -- 172.21.15.119:0/2841616826 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f530401bd90 con 0x7f530c0af4c0 2023-09-13T02:12:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.704+0000 7f5311d05640 1 -- 172.21.15.119:0/2841616826 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530c143850 con 0x7f530c0af4c0 2023-09-13T02:12:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.706+0000 7f52f3fff640 1 -- 172.21.15.119:0/2841616826 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f530c143850 con 0x7f530c0af4c0 2023-09-13T02:12:00.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.777+0000 7f5311d05640 1 -- 172.21.15.119:0/2841616826 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "67190066-4851-4b1f-aae8-bad59e79ebb5", "id": 0} v 0) v1 -- 0x7f530c04e100 con 0x7f530c0af4c0 2023-09-13T02:12:00.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.780+0000 7f52f3fff640 1 -- 172.21.15.119:0/2841616826 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "67190066-4851-4b1f-aae8-bad59e79ebb5", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5304016020 con 0x7f530c0af4c0 2023-09-13T02:12:00.781 INFO:teuthology.orchestra.run.smithi119.stdout:0 2023-09-13T02:12:00.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.781+0000 7f5311d05640 1 -- 172.21.15.119:0/2841616826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f530c0af4c0 msgr2=0x7f530c13f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:00.782 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.781+0000 7f5311d05640 1 --2- 172.21.15.119:0/2841616826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f530c0af4c0 0x7f530c13f830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f530400caa0 tx=0x7f530400cf60 comp rx=0 tx=0).stop 2023-09-13T02:12:00.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.781+0000 7f5311d05640 1 -- 172.21.15.119:0/2841616826 shutdown_connections 2023-09-13T02:12:00.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.781+0000 7f5311d05640 1 --2- 172.21.15.119:0/2841616826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f530c0af4c0 0x7f530c13f830 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.781+0000 7f5311d05640 1 --2- 172.21.15.119:0/2841616826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f530c0ae710 0x7f530c13f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.781+0000 7f5311d05640 1 --2- 172.21.15.119:0/2841616826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f530c0adc50 0x7f530c141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.781+0000 7f5311d05640 1 -- 172.21.15.119:0/2841616826 >> 172.21.15.119:0/2841616826 conn(0x7f530c06aa50 msgr2=0x7f530c0b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:00.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.781+0000 7f5311d05640 1 -- 172.21.15.119:0/2841616826 shutdown_connections 2023-09-13T02:12:00.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.781+0000 7f5311d05640 1 -- 172.21.15.119:0/2841616826 wait complete. 2023-09-13T02:12:00.792 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new f1907075-bb97-4a19-8dd6-322232caaf4b 1 2023-09-13T02:12:00.894 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.893+0000 7f8e7cd0f640 1 -- 172.21.15.119:0/3169228695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e780af4c0 msgr2=0x7f8e780b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:00.894 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.893+0000 7f8e7cd0f640 1 --2- 172.21.15.119:0/3169228695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e780af4c0 0x7f8e780b2460 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c005fd0 tx=0x7f8e6c02bcf0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.894 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.893+0000 7f8e7cd0f640 1 -- 172.21.15.119:0/3169228695 shutdown_connections 2023-09-13T02:12:00.894 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.893+0000 7f8e7cd0f640 1 --2- 172.21.15.119:0/3169228695 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e780adc50 0x7f8e780b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.895 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.893+0000 7f8e7cd0f640 1 --2- 172.21.15.119:0/3169228695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e780af4c0 0x7f8e780b2460 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.895 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.893+0000 7f8e7cd0f640 1 -- 172.21.15.119:0/3169228695 >> 172.21.15.119:0/3169228695 conn(0x7f8e7806aa50 msgr2=0x7f8e780b6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:00.895 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.893+0000 7f8e7cd0f640 1 -- 172.21.15.119:0/3169228695 shutdown_connections 2023-09-13T02:12:00.895 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.893+0000 7f8e7cd0f640 1 -- 172.21.15.119:0/3169228695 wait complete. 2023-09-13T02:12:00.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.894+0000 7f8e7cd0f640 1 Processor -- start 2023-09-13T02:12:00.898 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.894+0000 7f8e7cd0f640 1 -- start start 2023-09-13T02:12:00.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.894+0000 7f8e7cd0f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8e780adc50 0x7f8e78143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:00.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.894+0000 7f8e7cd0f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e780ae710 0x7f8e781da450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:00.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.894+0000 7f8e7cd0f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e780af4c0 0x7f8e781da990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:00.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.894+0000 7f8e7cd0f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e781364c0 con 0x7f8e780adc50 2023-09-13T02:12:00.899 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.894+0000 7f8e7cd0f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e78136a40 con 0x7f8e780ae710 2023-09-13T02:12:00.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e7cd0f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e781415c0 con 0x7f8e780af4c0 2023-09-13T02:12:00.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e75d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e780ae710 0x7f8e781da450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:00.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e75d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e780ae710 0x7f8e781da450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56578/0 (socket says 172.21.15.119:56578) 2023-09-13T02:12:00.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e75d9b640 1 -- 172.21.15.119:0/3996767419 learned_addr learned my addr 172.21.15.119:0/3996767419 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-09-13T02:12:00.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e76d9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e780af4c0 0x7f8e781da990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:00.900 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e7659c640 1 --2- 172.21.15.119:0/3996767419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8e780adc50 0x7f8e78143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:00.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e76d9d640 1 -- 172.21.15.119:0/3996767419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e780ae710 msgr2=0x7f8e781da450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:00.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e76d9d640 1 --2- 172.21.15.119:0/3996767419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e780ae710 0x7f8e781da450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e76d9d640 1 -- 172.21.15.119:0/3996767419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8e780adc50 msgr2=0x7f8e78143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:00.901 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e76d9d640 1 --2- 172.21.15.119:0/3996767419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8e780adc50 0x7f8e78143690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e76d9d640 1 -- 172.21.15.119:0/3996767419 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e68009490 con 0x7f8e780af4c0 2023-09-13T02:12:00.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e75d9b640 1 --2- 172.21.15.119:0/3996767419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e780ae710 0x7f8e781da450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T02:12:00.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e7659c640 1 --2- 172.21.15.119:0/3996767419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8e780adc50 0x7f8e78143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:00.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e76d9d640 1 --2- 172.21.15.119:0/3996767419 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e780af4c0 0x7f8e781da990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000c690 tx=0x7f8e7000cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:00.902 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e66ffd640 1 -- 172.21.15.119:0/3996767419 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70003b70 con 0x7f8e780af4c0 2023-09-13T02:12:00.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e66ffd640 1 -- 172.21.15.119:0/3996767419 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8e70003cd0 con 0x7f8e780af4c0 2023-09-13T02:12:00.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e66ffd640 1 -- 172.21.15.119:0/3996767419 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70005330 con 0x7f8e780af4c0 2023-09-13T02:12:00.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e7cd0f640 1 -- 172.21.15.119:0/3996767419 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6c009560 con 0x7f8e780af4c0 2023-09-13T02:12:00.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e7cd0f640 1 -- 172.21.15.119:0/3996767419 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e781412e0 con 0x7f8e780af4c0 2023-09-13T02:12:00.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e66ffd640 1 -- 172.21.15.119:0/3996767419 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8e7000a640 con 0x7f8e780af4c0 2023-09-13T02:12:00.903 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.895+0000 7f8e66ffd640 1 -- 172.21.15.119:0/3996767419 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f8e70012470 con 0x7f8e780af4c0 2023-09-13T02:12:00.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.896+0000 7f8e7cd0f640 1 -- 172.21.15.119:0/3996767419 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e780b0e60 con 0x7f8e780af4c0 2023-09-13T02:12:00.904 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.898+0000 7f8e66ffd640 1 -- 172.21.15.119:0/3996767419 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f8e7000aad0 con 0x7f8e780af4c0 2023-09-13T02:12:00.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.969+0000 7f8e7cd0f640 1 -- 172.21.15.119:0/3996767419 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f1907075-bb97-4a19-8dd6-322232caaf4b", "id": 1} v 0) v1 -- 0x7f8e780b0c20 con 0x7f8e780af4c0 2023-09-13T02:12:00.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.973+0000 7f8e66ffd640 1 -- 172.21.15.119:0/3996767419 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f1907075-bb97-4a19-8dd6-322232caaf4b", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e7000ac70 con 0x7f8e780af4c0 2023-09-13T02:12:00.974 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-09-13T02:12:00.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.974+0000 7f8e7cd0f640 1 -- 172.21.15.119:0/3996767419 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e780af4c0 msgr2=0x7f8e781da990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:00.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.974+0000 7f8e7cd0f640 1 --2- 172.21.15.119:0/3996767419 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e780af4c0 0x7f8e781da990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000c690 tx=0x7f8e7000cb50 comp rx=0 tx=0).stop 2023-09-13T02:12:00.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.974+0000 7f8e7cd0f640 1 -- 172.21.15.119:0/3996767419 shutdown_connections 2023-09-13T02:12:00.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.974+0000 7f8e7cd0f640 1 --2- 172.21.15.119:0/3996767419 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e780af4c0 0x7f8e781da990 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.974+0000 7f8e7cd0f640 1 --2- 172.21.15.119:0/3996767419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e780ae710 0x7f8e781da450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.974+0000 7f8e7cd0f640 1 --2- 172.21.15.119:0/3996767419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8e780adc50 0x7f8e78143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:00.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.974+0000 7f8e7cd0f640 1 -- 172.21.15.119:0/3996767419 >> 172.21.15.119:0/3996767419 conn(0x7f8e7806aa50 msgr2=0x7f8e780b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:00.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.974+0000 7f8e7cd0f640 1 -- 172.21.15.119:0/3996767419 shutdown_connections 2023-09-13T02:12:00.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:00.974+0000 7f8e7cd0f640 1 -- 172.21.15.119:0/3996767419 wait complete. 2023-09-13T02:12:00.985 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 8c323c83-330c-4181-b622-10177c81f975 2 2023-09-13T02:12:01.077 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:01.077+0000 7f800d848040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-13T02:12:01.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.087+0000 7f216b8e7640 1 -- 172.21.15.119:0/2828972232 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2164072420 msgr2=0x7f2164070d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:01.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.087+0000 7f216b8e7640 1 --2- 172.21.15.119:0/2828972232 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2164072420 0x7f2164070d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2154005fd0 tx=0x7f215402bcf0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.087+0000 7f216b8e7640 1 -- 172.21.15.119:0/2828972232 shutdown_connections 2023-09-13T02:12:01.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.087+0000 7f216b8e7640 1 --2- 172.21.15.119:0/2828972232 >> v2:172.21.15.104:3300/0 conn(0x7f21640ac4d0 0x7f21640ac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.087+0000 7f216b8e7640 1 --2- 172.21.15.119:0/2828972232 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2164072420 0x7f2164070d30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.087+0000 7f216b8e7640 1 -- 172.21.15.119:0/2828972232 >> 172.21.15.119:0/2828972232 conn(0x7f2164069570 msgr2=0x7f2164069980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:01.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.087+0000 7f216b8e7640 1 -- 172.21.15.119:0/2828972232 shutdown_connections 2023-09-13T02:12:01.092 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.087+0000 7f216b8e7640 1 -- 172.21.15.119:0/2828972232 wait complete. 2023-09-13T02:12:01.092 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.088+0000 7f216b8e7640 1 Processor -- start 2023-09-13T02:12:01.092 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.088+0000 7f216b8e7640 1 -- start start 2023-09-13T02:12:01.097 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f216b8e7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2164072420 0x7f216406f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:01.098 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f216b8e7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21640ac4d0 0x7f21641dd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:01.098 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f216b8e7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21641435f0 0x7f2164134000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:01.099 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f216b8e7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2164135870 con 0x7f2164072420 2023-09-13T02:12:01.099 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f216b8e7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216406e2f0 con 0x7f21640ac4d0 2023-09-13T02:12:01.099 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f216b8e7640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216406f310 con 0x7f21641435f0 2023-09-13T02:12:01.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f2168e82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21640ac4d0 0x7f21641dd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:01.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f2169e84640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21641435f0 0x7f2164134000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:01.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f2169e84640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21641435f0 0x7f2164134000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:58572/0 (socket says 172.21.15.119:58572) 2023-09-13T02:12:01.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f2169e84640 1 -- 172.21.15.119:0/1088951294 learned_addr learned my addr 172.21.15.119:0/1088951294 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-09-13T02:12:01.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f2168e82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21640ac4d0 0x7f21641dd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56590/0 (socket says 172.21.15.119:56590) 2023-09-13T02:12:01.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f2169683640 1 --2- 172.21.15.119:0/1088951294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2164072420 0x7f216406f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:01.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f2169e84640 1 -- 172.21.15.119:0/1088951294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21640ac4d0 msgr2=0x7f21641dd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:01.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f2169e84640 1 --2- 172.21.15.119:0/1088951294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21640ac4d0 0x7f21641dd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f2169e84640 1 -- 172.21.15.119:0/1088951294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2164072420 msgr2=0x7f216406f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:01.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f2169e84640 1 --2- 172.21.15.119:0/1088951294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2164072420 0x7f216406f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f2169e84640 1 -- 172.21.15.119:0/1088951294 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2154009560 con 0x7f21641435f0 2023-09-13T02:12:01.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f2169e84640 1 --2- 172.21.15.119:0/1088951294 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21641435f0 0x7f2164134000 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f215c00eb10 tx=0x7f215c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:01.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.089+0000 7f2159ffb640 1 -- 172.21.15.119:0/1088951294 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c004b20 con 0x7f21641435f0 2023-09-13T02:12:01.105 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.090+0000 7f2159ffb640 1 -- 172.21.15.119:0/1088951294 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f215c004ca0 con 0x7f21641435f0 2023-09-13T02:12:01.106 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.090+0000 7f2159ffb640 1 -- 172.21.15.119:0/1088951294 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c005280 con 0x7f21641435f0 2023-09-13T02:12:01.106 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.090+0000 7f216b8e7640 1 -- 172.21.15.119:0/1088951294 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216413b180 con 0x7f21641435f0 2023-09-13T02:12:01.106 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.090+0000 7f2159ffb640 1 -- 172.21.15.119:0/1088951294 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f215c0053e0 con 0x7f21641435f0 2023-09-13T02:12:01.107 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.090+0000 7f216b8e7640 1 -- 172.21.15.119:0/1088951294 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216406f030 con 0x7f21641435f0 2023-09-13T02:12:01.107 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.090+0000 7f2159ffb640 1 -- 172.21.15.119:0/1088951294 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f215c014070 con 0x7f21641435f0 2023-09-13T02:12:01.107 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.091+0000 7f216b8e7640 1 -- 172.21.15.119:0/1088951294 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216413afe0 con 0x7f21641435f0 2023-09-13T02:12:01.107 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.093+0000 7f2159ffb640 1 -- 172.21.15.119:0/1088951294 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f216413afe0 con 0x7f21641435f0 2023-09-13T02:12:01.118 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:01.117+0000 7fb1dcc14040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-13T02:12:01.129 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:01.129+0000 7f800d848040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-13T02:12:01.172 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:01.172+0000 7f800d848040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-13T02:12:01.179 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:01.178+0000 7fb1dcc14040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-13T02:12:01.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.186+0000 7f216b8e7640 1 -- 172.21.15.119:0/1088951294 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8c323c83-330c-4181-b622-10177c81f975", "id": 2} v 0) v1 -- 0x7f216406e010 con 0x7f21641435f0 2023-09-13T02:12:01.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.191+0000 7f2159ffb640 1 -- 172.21.15.119:0/1088951294 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c323c83-330c-4181-b622-10177c81f975", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f216406e010 con 0x7f21641435f0 2023-09-13T02:12:01.192 INFO:teuthology.orchestra.run.smithi119.stdout:2 2023-09-13T02:12:01.194 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.191+0000 7f216b8e7640 1 -- 172.21.15.119:0/1088951294 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21641435f0 msgr2=0x7f2164134000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:01.194 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.191+0000 7f216b8e7640 1 --2- 172.21.15.119:0/1088951294 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21641435f0 0x7f2164134000 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f215c00eb10 tx=0x7f215c00c2d0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.194 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.191+0000 7f216b8e7640 1 -- 172.21.15.119:0/1088951294 shutdown_connections 2023-09-13T02:12:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.191+0000 7f216b8e7640 1 --2- 172.21.15.119:0/1088951294 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21641435f0 0x7f2164134000 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.191+0000 7f216b8e7640 1 --2- 172.21.15.119:0/1088951294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21640ac4d0 0x7f21641dd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.196 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.191+0000 7f216b8e7640 1 --2- 172.21.15.119:0/1088951294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2164072420 0x7f216406f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.196 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.191+0000 7f216b8e7640 1 -- 172.21.15.119:0/1088951294 >> 172.21.15.119:0/1088951294 conn(0x7f2164069570 msgr2=0x7f2164069950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:01.196 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.192+0000 7f216b8e7640 1 -- 172.21.15.119:0/1088951294 shutdown_connections 2023-09-13T02:12:01.197 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.192+0000 7f216b8e7640 1 -- 172.21.15.119:0/1088951294 wait complete. 2023-09-13T02:12:01.202 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 811457f5-c408-488d-a4ed-b947d1c55e82 3 2023-09-13T02:12:01.225 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:01.225+0000 7f800d848040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-13T02:12:01.227 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:01.227+0000 7fb1dcc14040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-13T02:12:01.266 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:01.266+0000 7f800d848040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-13T02:12:01.283 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:01.283+0000 7fb1dcc14040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-13T02:12:01.303 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.303+0000 7fdf2d05d640 1 -- 172.21.15.119:0/178785662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf2806e110 msgr2=0x7fdf28145890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:01.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.303+0000 7fdf2d05d640 1 --2- 172.21.15.119:0/178785662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf2806e110 0x7fdf28145890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009830 tx=0x7fdf1802bd60 comp rx=0 tx=0).stop 2023-09-13T02:12:01.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.303+0000 7fdf2d05d640 1 -- 172.21.15.119:0/178785662 shutdown_connections 2023-09-13T02:12:01.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.303+0000 7fdf2d05d640 1 --2- 172.21.15.119:0/178785662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf2806e110 0x7fdf28145890 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.304 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.303+0000 7fdf2d05d640 1 -- 172.21.15.119:0/178785662 >> 172.21.15.119:0/178785662 conn(0x7fdf280b6860 msgr2=0x7fdf280b6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:01.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.303+0000 7fdf2d05d640 1 -- 172.21.15.119:0/178785662 shutdown_connections 2023-09-13T02:12:01.305 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.303+0000 7fdf2d05d640 1 -- 172.21.15.119:0/178785662 wait complete. 2023-09-13T02:12:01.307 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.304+0000 7fdf2d05d640 1 Processor -- start 2023-09-13T02:12:01.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.304+0000 7fdf2d05d640 1 -- start start 2023-09-13T02:12:01.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2d05d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf2806e110 0x7fdf2814ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:01.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2d05d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf280b00e0 0x7fdf28071130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:01.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2d05d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf28145dd0 0x7fdf2806fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:01.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2d05d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf28071a00 con 0x7fdf2806e110 2023-09-13T02:12:01.308 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2d05d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2814d420 con 0x7fdf280b00e0 2023-09-13T02:12:01.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2d05d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf281db120 con 0x7fdf28145dd0 2023-09-13T02:12:01.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf280b00e0 0x7fdf28071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:01.309 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2759e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf28145dd0 0x7fdf2806fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:01.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf280b00e0 0x7fdf28071130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56598/0 (socket says 172.21.15.119:56598) 2023-09-13T02:12:01.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2659c640 1 -- 172.21.15.119:0/489951977 learned_addr learned my addr 172.21.15.119:0/489951977 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-09-13T02:12:01.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf26d9d640 1 --2- 172.21.15.119:0/489951977 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf2806e110 0x7fdf2814ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:01.311 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2659c640 1 -- 172.21.15.119:0/489951977 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf28145dd0 msgr2=0x7fdf2806fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:01.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2659c640 1 --2- 172.21.15.119:0/489951977 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf28145dd0 0x7fdf2806fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2659c640 1 -- 172.21.15.119:0/489951977 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf2806e110 msgr2=0x7fdf2814ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:01.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2659c640 1 --2- 172.21.15.119:0/489951977 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf2806e110 0x7fdf2814ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.313 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2659c640 1 -- 172.21.15.119:0/489951977 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf18009490 con 0x7fdf280b00e0 2023-09-13T02:12:01.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2759e640 1 --2- 172.21.15.119:0/489951977 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf28145dd0 0x7fdf2806fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T02:12:01.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2659c640 1 --2- 172.21.15.119:0/489951977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf280b00e0 0x7fdf28071130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009780 tx=0x7fdf180038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:01.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf1f7fe640 1 -- 172.21.15.119:0/489951977 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18003ea0 con 0x7fdf280b00e0 2023-09-13T02:12:01.314 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf1f7fe640 1 -- 172.21.15.119:0/489951977 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdf18034550 con 0x7fdf280b00e0 2023-09-13T02:12:01.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2d05d640 1 -- 172.21.15.119:0/489951977 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf281da920 con 0x7fdf280b00e0 2023-09-13T02:12:01.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf1f7fe640 1 -- 172.21.15.119:0/489951977 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18034960 con 0x7fdf280b00e0 2023-09-13T02:12:01.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.305+0000 7fdf2d05d640 1 -- 172.21.15.119:0/489951977 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2814b1f0 con 0x7fdf280b00e0 2023-09-13T02:12:01.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.306+0000 7fdf1f7fe640 1 -- 172.21.15.119:0/489951977 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdf1803b040 con 0x7fdf280b00e0 2023-09-13T02:12:01.315 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.306+0000 7fdf1f7fe640 1 -- 172.21.15.119:0/489951977 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fdf18046400 con 0x7fdf280b00e0 2023-09-13T02:12:01.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.307+0000 7fdf2d05d640 1 -- 172.21.15.119:0/489951977 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf281dae40 con 0x7fdf280b00e0 2023-09-13T02:12:01.316 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.309+0000 7fdf1f7fe640 1 -- 172.21.15.119:0/489951977 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fdf18064b20 con 0x7fdf280b00e0 2023-09-13T02:12:01.341 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:01.340+0000 7fb1dcc14040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-13T02:12:01.365 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:01.365+0000 7f800d848040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-13T02:12:01.433 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:01.433+0000 7f800d848040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-13T02:12:01.434 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.433+0000 7fdf2d05d640 1 -- 172.21.15.119:0/489951977 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "811457f5-c408-488d-a4ed-b947d1c55e82", "id": 3} v 0) v1 -- 0x7fdf280b2340 con 0x7fdf280b00e0 2023-09-13T02:12:01.438 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.437+0000 7fdf1f7fe640 1 -- 172.21.15.119:0/489951977 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "811457f5-c408-488d-a4ed-b947d1c55e82", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdf18053020 con 0x7fdf280b00e0 2023-09-13T02:12:01.438 INFO:teuthology.orchestra.run.smithi119.stdout:3 2023-09-13T02:12:01.439 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.438+0000 7fdf2d05d640 1 -- 172.21.15.119:0/489951977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf280b00e0 msgr2=0x7fdf28071130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:01.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.438+0000 7fdf2d05d640 1 --2- 172.21.15.119:0/489951977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf280b00e0 0x7fdf28071130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009780 tx=0x7fdf180038a0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.439+0000 7fdf2d05d640 1 -- 172.21.15.119:0/489951977 shutdown_connections 2023-09-13T02:12:01.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.439+0000 7fdf2d05d640 1 --2- 172.21.15.119:0/489951977 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf28145dd0 0x7fdf2806fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.439+0000 7fdf2d05d640 1 --2- 172.21.15.119:0/489951977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf280b00e0 0x7fdf28071130 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.439+0000 7fdf2d05d640 1 --2- 172.21.15.119:0/489951977 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf2806e110 0x7fdf2814ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.441 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.439+0000 7fdf2d05d640 1 -- 172.21.15.119:0/489951977 >> 172.21.15.119:0/489951977 conn(0x7fdf280b6860 msgr2=0x7fdf280b39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:01.441 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.439+0000 7fdf2d05d640 1 -- 172.21.15.119:0/489951977 shutdown_connections 2023-09-13T02:12:01.441 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.439+0000 7fdf2d05d640 1 -- 172.21.15.119:0/489951977 wait complete. 2023-09-13T02:12:01.449 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 552010ea-7d61-47c7-b4ac-657845e55e69 4 2023-09-13T02:12:01.473 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:01.472+0000 7fb1dcc14040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-13T02:12:01.478 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:01.478+0000 7f800d848040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-13T02:12:01.529 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:01.529+0000 7f800d848040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-13T02:12:01.547 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:01.546+0000 7fb1dcc14040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-13T02:12:01.575 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:01.575+0000 7f800d848040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-13T02:12:01.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.574+0000 7f6307239640 1 -- 172.21.15.119:0/1978136117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6300070fd0 msgr2=0x7f63001425e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:01.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.574+0000 7f6307239640 1 --2- 172.21.15.119:0/1978136117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6300070fd0 0x7f63001425e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f63000b5530 tx=0x7f62fc02bcf0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.574+0000 7f6307239640 1 -- 172.21.15.119:0/1978136117 shutdown_connections 2023-09-13T02:12:01.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.574+0000 7f6307239640 1 --2- 172.21.15.119:0/1978136117 >> v2:172.21.15.104:3300/0 conn(0x7f630006fb50 0x7f630006ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.574+0000 7f6307239640 1 --2- 172.21.15.119:0/1978136117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6300070fd0 0x7f63001425e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.574+0000 7f6307239640 1 -- 172.21.15.119:0/1978136117 >> 172.21.15.119:0/1978136117 conn(0x7f6300069b30 msgr2=0x7f63000b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:01.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.574+0000 7f6307239640 1 -- 172.21.15.119:0/1978136117 shutdown_connections 2023-09-13T02:12:01.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.574+0000 7f6307239640 1 -- 172.21.15.119:0/1978136117 wait complete. 2023-09-13T02:12:01.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.575+0000 7f6307239640 1 Processor -- start 2023-09-13T02:12:01.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.575+0000 7f6307239640 1 -- start start 2023-09-13T02:12:01.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f6307239640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f630006fb50 0x7f6300135920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:01.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f6307239640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6300070fd0 0x7f63001dbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:01.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f6307239640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f630013be60 0x7f63001dc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:01.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f6307239640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63001d81d0 con 0x7f630013be60 2023-09-13T02:12:01.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f6307239640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63001db870 con 0x7f630006fb50 2023-09-13T02:12:01.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f6307239640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63000b0150 con 0x7f6300070fd0 2023-09-13T02:12:01.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f6304fd5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f630006fb50 0x7f6300135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:01.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f6304fd5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f630006fb50 0x7f6300135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56616/0 (socket says 172.21.15.119:56616) 2023-09-13T02:12:01.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f6304fd5640 1 -- 172.21.15.119:0/1497520050 learned_addr learned my addr 172.21.15.119:0/1497520050 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-09-13T02:12:01.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f62f7fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6300070fd0 0x7f63001dbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:01.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f63057d6640 1 --2- 172.21.15.119:0/1497520050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f630013be60 0x7f63001dc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:01.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f6304fd5640 1 -- 172.21.15.119:0/1497520050 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6300070fd0 msgr2=0x7f63001dbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:01.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f6304fd5640 1 --2- 172.21.15.119:0/1497520050 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6300070fd0 0x7f63001dbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f6304fd5640 1 -- 172.21.15.119:0/1497520050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f630013be60 msgr2=0x7f63001dc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:01.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f6304fd5640 1 --2- 172.21.15.119:0/1497520050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f630013be60 0x7f63001dc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f6304fd5640 1 -- 172.21.15.119:0/1497520050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc009490 con 0x7f630006fb50 2023-09-13T02:12:01.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f62f7fff640 1 --2- 172.21.15.119:0/1497520050 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6300070fd0 0x7f63001dbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T02:12:01.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.576+0000 7f6304fd5640 1 --2- 172.21.15.119:0/1497520050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f630006fb50 0x7f6300135920 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f62fc000c00 tx=0x7f62fc02c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:01.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.577+0000 7f62f57fa640 1 -- 172.21.15.119:0/1497520050 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc003a80 con 0x7f630006fb50 2023-09-13T02:12:01.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.577+0000 7f62f57fa640 1 -- 172.21.15.119:0/1497520050 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f62fc003cf0 con 0x7f630006fb50 2023-09-13T02:12:01.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.577+0000 7f6307239640 1 -- 172.21.15.119:0/1497520050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63000b1240 con 0x7f630006fb50 2023-09-13T02:12:01.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.577+0000 7f62f57fa640 1 -- 172.21.15.119:0/1497520050 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc0346a0 con 0x7f630006fb50 2023-09-13T02:12:01.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.577+0000 7f6307239640 1 -- 172.21.15.119:0/1497520050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6300134ea0 con 0x7f630006fb50 2023-09-13T02:12:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.577+0000 7f62f57fa640 1 -- 172.21.15.119:0/1497520050 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f62fc03b040 con 0x7f630006fb50 2023-09-13T02:12:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.577+0000 7f62f57fa640 1 -- 172.21.15.119:0/1497520050 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f62fc03dbc0 con 0x7f630006fb50 2023-09-13T02:12:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.578+0000 7f6307239640 1 -- 172.21.15.119:0/1497520050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63001dba30 con 0x7f630006fb50 2023-09-13T02:12:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.580+0000 7f62f57fa640 1 -- 172.21.15.119:0/1497520050 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f62fc064b20 con 0x7f630006fb50 2023-09-13T02:12:01.596 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:01.595+0000 7fb1dcc14040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-13T02:12:01.649 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:01.649+0000 7fb1dcc14040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-13T02:12:01.651 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.651+0000 7f6307239640 1 -- 172.21.15.119:0/1497520050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "552010ea-7d61-47c7-b4ac-657845e55e69", "id": 4} v 0) v1 -- 0x7f630004e100 con 0x7f630006fb50 2023-09-13T02:12:01.655 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.655+0000 7f62f57fa640 1 -- 172.21.15.119:0/1497520050 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "552010ea-7d61-47c7-b4ac-657845e55e69", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f62fc053020 con 0x7f630006fb50 2023-09-13T02:12:01.655 INFO:teuthology.orchestra.run.smithi119.stdout:4 2023-09-13T02:12:01.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.655+0000 7f6307239640 1 -- 172.21.15.119:0/1497520050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f630006fb50 msgr2=0x7f6300135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:01.656 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.655+0000 7f6307239640 1 --2- 172.21.15.119:0/1497520050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f630006fb50 0x7f6300135920 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f62fc000c00 tx=0x7f62fc02c880 comp rx=0 tx=0).stop 2023-09-13T02:12:01.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.655+0000 7f6307239640 1 -- 172.21.15.119:0/1497520050 shutdown_connections 2023-09-13T02:12:01.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.655+0000 7f6307239640 1 --2- 172.21.15.119:0/1497520050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f630013be60 0x7f63001dc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.655+0000 7f6307239640 1 --2- 172.21.15.119:0/1497520050 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6300070fd0 0x7f63001dbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.655+0000 7f6307239640 1 --2- 172.21.15.119:0/1497520050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f630006fb50 0x7f6300135920 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.657 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.655+0000 7f6307239640 1 -- 172.21.15.119:0/1497520050 >> 172.21.15.119:0/1497520050 conn(0x7f6300069b30 msgr2=0x7f630013ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:01.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.655+0000 7f6307239640 1 -- 172.21.15.119:0/1497520050 shutdown_connections 2023-09-13T02:12:01.658 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.655+0000 7f6307239640 1 -- 172.21.15.119:0/1497520050 wait complete. 2023-09-13T02:12:01.666 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 41f415b0-6886-44ed-bccc-57c46cc975b7 5 2023-09-13T02:12:01.700 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:01.699+0000 7fb1dcc14040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-13T02:12:01.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.768+0000 7f2305d39640 1 -- 172.21.15.119:0/2323615631 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2300071840 msgr2=0x7f2300145d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:01.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.768+0000 7f2305d39640 1 --2- 172.21.15.119:0/2323615631 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2300071840 0x7f2300145d80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009860 tx=0x7f22e802bd60 comp rx=0 tx=0).stop 2023-09-13T02:12:01.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.768+0000 7f2305d39640 1 -- 172.21.15.119:0/2323615631 shutdown_connections 2023-09-13T02:12:01.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.768+0000 7f2305d39640 1 --2- 172.21.15.119:0/2323615631 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2300071840 0x7f2300145d80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.768+0000 7f2305d39640 1 -- 172.21.15.119:0/2323615631 >> 172.21.15.119:0/2323615631 conn(0x7f230006aa50 msgr2=0x7f23000b6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:01.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.768+0000 7f2305d39640 1 -- 172.21.15.119:0/2323615631 shutdown_connections 2023-09-13T02:12:01.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.768+0000 7f2305d39640 1 -- 172.21.15.119:0/2323615631 wait complete. 2023-09-13T02:12:01.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.769+0000 7f2305d39640 1 Processor -- start 2023-09-13T02:12:01.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.769+0000 7f2305d39640 1 -- start start 2023-09-13T02:12:01.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f2305d39640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2300071840 0x7f2300135030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:01.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f2305d39640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23000b0090 0x7f23001dba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:01.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f2305d39640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2300142580 0x7f2300132d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:01.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f2305d39640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2300139890 con 0x7f23000b0090 2023-09-13T02:12:01.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f2305d39640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23001dbf50 con 0x7f2300142580 2023-09-13T02:12:01.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f2305d39640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23000ad600 con 0x7f2300071840 2023-09-13T02:12:01.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f22ff7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2300071840 0x7f2300135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:01.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f22fffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2300142580 0x7f2300132d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:01.775 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f22ff7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2300071840 0x7f2300135030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:58604/0 (socket says 172.21.15.119:58604) 2023-09-13T02:12:01.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f22ff7fe640 1 -- 172.21.15.119:0/4167612778 learned_addr learned my addr 172.21.15.119:0/4167612778 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-09-13T02:12:01.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f22f7fff640 1 --2- 172.21.15.119:0/4167612778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23000b0090 0x7f23001dba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:01.777 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f22fffff640 1 -- 172.21.15.119:0/4167612778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2300071840 msgr2=0x7f2300135030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:01.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f22fffff640 1 --2- 172.21.15.119:0/4167612778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2300071840 0x7f2300135030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f22fffff640 1 -- 172.21.15.119:0/4167612778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23000b0090 msgr2=0x7f23001dba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:01.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f22fffff640 1 --2- 172.21.15.119:0/4167612778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23000b0090 0x7f23001dba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f22fffff640 1 -- 172.21.15.119:0/4167612778 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e8009490 con 0x7f2300142580 2023-09-13T02:12:01.778 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f22ff7fe640 1 --2- 172.21.15.119:0/4167612778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2300071840 0x7f2300135030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T02:12:01.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f22fffff640 1 --2- 172.21.15.119:0/4167612778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2300142580 0x7f2300132d10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f22f800caa0 tx=0x7f22f800cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:01.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.770+0000 7f22fcff9640 1 -- 172.21.15.119:0/4167612778 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f800aba0 con 0x7f2300142580 2023-09-13T02:12:01.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.771+0000 7f2305d39640 1 -- 172.21.15.119:0/4167612778 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23001349a0 con 0x7f2300142580 2023-09-13T02:12:01.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.771+0000 7f22fcff9640 1 -- 172.21.15.119:0/4167612778 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f22f800adf0 con 0x7f2300142580 2023-09-13T02:12:01.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.771+0000 7f22fcff9640 1 -- 172.21.15.119:0/4167612778 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f8012680 con 0x7f2300142580 2023-09-13T02:12:01.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.771+0000 7f2305d39640 1 -- 172.21.15.119:0/4167612778 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23001db4f0 con 0x7f2300142580 2023-09-13T02:12:01.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.771+0000 7f22fcff9640 1 -- 172.21.15.119:0/4167612778 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f22f8012b00 con 0x7f2300142580 2023-09-13T02:12:01.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.771+0000 7f22fcff9640 1 -- 172.21.15.119:0/4167612778 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f22f801bc70 con 0x7f2300142580 2023-09-13T02:12:01.780 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.771+0000 7f2305d39640 1 -- 172.21.15.119:0/4167612778 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23001db070 con 0x7f2300142580 2023-09-13T02:12:01.781 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.773+0000 7f22fcff9640 1 -- 172.21.15.119:0/4167612778 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f23001db070 con 0x7f2300142580 2023-09-13T02:12:01.846 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.845+0000 7f2305d39640 1 -- 172.21.15.119:0/4167612778 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "41f415b0-6886-44ed-bccc-57c46cc975b7", "id": 5} v 0) v1 -- 0x7f2300134be0 con 0x7f2300142580 2023-09-13T02:12:01.849 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.849+0000 7f22fcff9640 1 -- 172.21.15.119:0/4167612778 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "41f415b0-6886-44ed-bccc-57c46cc975b7", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f22f8016020 con 0x7f2300142580 2023-09-13T02:12:01.849 INFO:teuthology.orchestra.run.smithi119.stdout:5 2023-09-13T02:12:01.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.849+0000 7f2305d39640 1 -- 172.21.15.119:0/4167612778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2300142580 msgr2=0x7f2300132d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:01.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.849+0000 7f2305d39640 1 --2- 172.21.15.119:0/4167612778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2300142580 0x7f2300132d10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f22f800caa0 tx=0x7f22f800cf60 comp rx=0 tx=0).stop 2023-09-13T02:12:01.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.850+0000 7f2305d39640 1 -- 172.21.15.119:0/4167612778 shutdown_connections 2023-09-13T02:12:01.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.850+0000 7f2305d39640 1 --2- 172.21.15.119:0/4167612778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2300142580 0x7f2300132d10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.851 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.850+0000 7f2305d39640 1 --2- 172.21.15.119:0/4167612778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23000b0090 0x7f23001dba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.850+0000 7f2305d39640 1 --2- 172.21.15.119:0/4167612778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2300071840 0x7f2300135030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:01.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.850+0000 7f2305d39640 1 -- 172.21.15.119:0/4167612778 >> 172.21.15.119:0/4167612778 conn(0x7f230006aa50 msgr2=0x7f23000b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:01.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.850+0000 7f2305d39640 1 -- 172.21.15.119:0/4167612778 shutdown_connections 2023-09-13T02:12:01.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:01.850+0000 7f2305d39640 1 -- 172.21.15.119:0/4167612778 wait complete. 2023-09-13T02:12:01.860 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 1f415570-dbcc-4cb9-930a-ad31a96c3ef3 6 2023-09-13T02:12:01.947 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:01.948+0000 7f800d848040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-13T02:12:02.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.003+0000 7f3b3ec64640 1 -- 172.21.15.119:0/901240060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b38142580 msgr2=0x7f3b381429d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:02.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.003+0000 7f3b3ec64640 1 --2- 172.21.15.119:0/901240060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b38142580 0x7f3b381429d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3b380723c0 tx=0x7f3b3002c080 comp rx=0 tx=0).stop 2023-09-13T02:12:02.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.004+0000 7f3b3ec64640 1 -- 172.21.15.119:0/901240060 shutdown_connections 2023-09-13T02:12:02.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.004+0000 7f3b3ec64640 1 --2- 172.21.15.119:0/901240060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b38142580 0x7f3b381429d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.004+0000 7f3b3ec64640 1 --2- 172.21.15.119:0/901240060 >> v2:172.21.15.104:3300/0 conn(0x7f3b38071840 0x7f3b38145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.004+0000 7f3b3ec64640 1 -- 172.21.15.119:0/901240060 >> 172.21.15.119:0/901240060 conn(0x7f3b3806aa50 msgr2=0x7f3b380b6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:02.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.004+0000 7f3b3ec64640 1 -- 172.21.15.119:0/901240060 shutdown_connections 2023-09-13T02:12:02.006 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.004+0000 7f3b3ec64640 1 -- 172.21.15.119:0/901240060 wait complete. 2023-09-13T02:12:02.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.005+0000 7f3b3ec64640 1 Processor -- start 2023-09-13T02:12:02.008 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.005+0000 7f3b3ec64640 1 -- start start 2023-09-13T02:12:02.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.005+0000 7f3b3ec64640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3b38071840 0x7f3b38138440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:02.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.005+0000 7f3b3ec64640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b380b0090 0x7f3b381446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:02.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.005+0000 7f3b3ec64640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b38142580 0x7f3b381328e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:02.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.005+0000 7f3b3ec64640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38138980 con 0x7f3b38071840 2023-09-13T02:12:02.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.005+0000 7f3b3ec64640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38138fd0 con 0x7f3b380b0090 2023-09-13T02:12:02.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.005+0000 7f3b3ec64640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38144210 con 0x7f3b38142580 2023-09-13T02:12:02.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.005+0000 7f3b37fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b380b0090 0x7f3b381446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:02.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.005+0000 7f3b3d201640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b38142580 0x7f3b381328e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:02.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.005+0000 7f3b37fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b380b0090 0x7f3b381446a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56658/0 (socket says 172.21.15.119:56658) 2023-09-13T02:12:02.010 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.005+0000 7f3b37fff640 1 -- 172.21.15.119:0/2910522945 learned_addr learned my addr 172.21.15.119:0/2910522945 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-09-13T02:12:02.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.006+0000 7f3b3ca00640 1 --2- 172.21.15.119:0/2910522945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3b38071840 0x7f3b38138440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:02.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.006+0000 7f3b37fff640 1 -- 172.21.15.119:0/2910522945 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b38142580 msgr2=0x7f3b381328e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:02.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.006+0000 7f3b37fff640 1 --2- 172.21.15.119:0/2910522945 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b38142580 0x7f3b381328e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.006+0000 7f3b37fff640 1 -- 172.21.15.119:0/2910522945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3b38071840 msgr2=0x7f3b38138440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:02.011 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.006+0000 7f3b37fff640 1 --2- 172.21.15.119:0/2910522945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3b38071840 0x7f3b38138440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.006+0000 7f3b37fff640 1 -- 172.21.15.119:0/2910522945 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b30009840 con 0x7f3b380b0090 2023-09-13T02:12:02.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.006+0000 7f3b37fff640 1 --2- 172.21.15.119:0/2910522945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b380b0090 0x7f3b381446a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400ea20 tx=0x7f3b2400eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:02.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.006+0000 7f3b357fa640 1 -- 172.21.15.119:0/2910522945 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24009700 con 0x7f3b380b0090 2023-09-13T02:12:02.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.006+0000 7f3b357fa640 1 -- 172.21.15.119:0/2910522945 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3b2400ce70 con 0x7f3b380b0090 2023-09-13T02:12:02.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.006+0000 7f3b357fa640 1 -- 172.21.15.119:0/2910522945 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24010690 con 0x7f3b380b0090 2023-09-13T02:12:02.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.006+0000 7f3b3ec64640 1 -- 172.21.15.119:0/2910522945 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b38134780 con 0x7f3b380b0090 2023-09-13T02:12:02.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.006+0000 7f3b3ec64640 1 -- 172.21.15.119:0/2910522945 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b38143610 con 0x7f3b380b0090 2023-09-13T02:12:02.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.006+0000 7f3b357fa640 1 -- 172.21.15.119:0/2910522945 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3b240107f0 con 0x7f3b380b0090 2023-09-13T02:12:02.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.006+0000 7f3b357fa640 1 -- 172.21.15.119:0/2910522945 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f3b24014070 con 0x7f3b380b0090 2023-09-13T02:12:02.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.007+0000 7f3b3ec64640 1 -- 172.21.15.119:0/2910522945 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b38133d40 con 0x7f3b380b0090 2023-09-13T02:12:02.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.009+0000 7f3b357fa640 1 -- 172.21.15.119:0/2910522945 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f3b38133d40 con 0x7f3b380b0090 2023-09-13T02:12:02.080 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:02.080+0000 7f800d848040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-13T02:12:02.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.081+0000 7f3b3ec64640 1 -- 172.21.15.119:0/2910522945 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1f415570-dbcc-4cb9-930a-ad31a96c3ef3", "id": 6} v 0) v1 -- 0x7f3b38146480 con 0x7f3b380b0090 2023-09-13T02:12:02.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.084+0000 7f3b357fa640 1 -- 172.21.15.119:0/2910522945 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1f415570-dbcc-4cb9-930a-ad31a96c3ef3", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3b24026060 con 0x7f3b380b0090 2023-09-13T02:12:02.085 INFO:teuthology.orchestra.run.smithi119.stdout:6 2023-09-13T02:12:02.086 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.085+0000 7f3b3ec64640 1 -- 172.21.15.119:0/2910522945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b380b0090 msgr2=0x7f3b381446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:02.086 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.085+0000 7f3b3ec64640 1 --2- 172.21.15.119:0/2910522945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b380b0090 0x7f3b381446a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400ea20 tx=0x7f3b2400eee0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.086 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.085+0000 7f3b3ec64640 1 -- 172.21.15.119:0/2910522945 shutdown_connections 2023-09-13T02:12:02.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.085+0000 7f3b3ec64640 1 --2- 172.21.15.119:0/2910522945 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b38142580 0x7f3b381328e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.085+0000 7f3b3ec64640 1 --2- 172.21.15.119:0/2910522945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b380b0090 0x7f3b381446a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.085+0000 7f3b3ec64640 1 --2- 172.21.15.119:0/2910522945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3b38071840 0x7f3b38138440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.085+0000 7f3b3ec64640 1 -- 172.21.15.119:0/2910522945 >> 172.21.15.119:0/2910522945 conn(0x7f3b3806aa50 msgr2=0x7f3b380698d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:02.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.085+0000 7f3b3ec64640 1 -- 172.21.15.119:0/2910522945 shutdown_connections 2023-09-13T02:12:02.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.085+0000 7f3b3ec64640 1 -- 172.21.15.119:0/2910522945 wait complete. 2023-09-13T02:12:02.096 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c 7 2023-09-13T02:12:02.099 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:02.099+0000 7fb1dcc14040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-13T02:12:02.195 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:02.195+0000 7f800d848040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-13T02:12:02.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.197+0000 7fa1a3fa4640 1 -- 172.21.15.119:0/2654993191 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa19c0ae730 msgr2=0x7fa19c0aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:02.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.197+0000 7fa1a3fa4640 1 --2- 172.21.15.119:0/2654993191 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa19c0ae730 0x7fa19c0aebb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa19c06c130 tx=0x7fa19802bd10 comp rx=0 tx=0).stop 2023-09-13T02:12:02.198 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.197+0000 7fa1a3fa4640 1 -- 172.21.15.119:0/2654993191 shutdown_connections 2023-09-13T02:12:02.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.197+0000 7fa1a3fa4640 1 --2- 172.21.15.119:0/2654993191 >> v2:172.21.15.104:3300/0 conn(0x7fa19c13abb0 0x7fa19c13b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.197+0000 7fa1a3fa4640 1 --2- 172.21.15.119:0/2654993191 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa19c0ae730 0x7fa19c0aebb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.197+0000 7fa1a3fa4640 1 --2- 172.21.15.119:0/2654993191 >> v2:172.21.15.119:3300/0 conn(0x7fa19c0afaf0 0x7fa19c141410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.197+0000 7fa1a3fa4640 1 -- 172.21.15.119:0/2654993191 >> 172.21.15.119:0/2654993191 conn(0x7fa19c0b6860 msgr2=0x7fa19c0b6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:02.199 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.197+0000 7fa1a3fa4640 1 -- 172.21.15.119:0/2654993191 shutdown_connections 2023-09-13T02:12:02.200 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.197+0000 7fa1a3fa4640 1 -- 172.21.15.119:0/2654993191 wait complete. 2023-09-13T02:12:02.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.198+0000 7fa1a3fa4640 1 Processor -- start 2023-09-13T02:12:02.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.198+0000 7fa1a3fa4640 1 -- start start 2023-09-13T02:12:02.202 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a3fa4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19c0ae730 0x7fa19c0b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:02.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a3fa4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa19c0afaf0 0x7fa19c0698f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:02.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a3fa4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa19c13abb0 0x7fa19c137310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:02.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a3fa4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c143460 con 0x7fa19c0afaf0 2023-09-13T02:12:02.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a3fa4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c143c20 con 0x7fa19c0ae730 2023-09-13T02:12:02.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a3fa4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c06f850 con 0x7fa19c13abb0 2023-09-13T02:12:02.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a1d40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19c0ae730 0x7fa19c0b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:02.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a2541640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa19c13abb0 0x7fa19c137310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:02.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a1d40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19c0ae730 0x7fa19c0b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56676/0 (socket says 172.21.15.119:56676) 2023-09-13T02:12:02.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a1d40640 1 -- 172.21.15.119:0/1399419043 learned_addr learned my addr 172.21.15.119:0/1399419043 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-09-13T02:12:02.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a153f640 1 --2- 172.21.15.119:0/1399419043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa19c0afaf0 0x7fa19c0698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:02.204 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a2541640 1 -- 172.21.15.119:0/1399419043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19c0ae730 msgr2=0x7fa19c0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:02.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a2541640 1 --2- 172.21.15.119:0/1399419043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19c0ae730 0x7fa19c0b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a2541640 1 -- 172.21.15.119:0/1399419043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa19c0afaf0 msgr2=0x7fa19c0698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:02.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a2541640 1 --2- 172.21.15.119:0/1399419043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa19c0afaf0 0x7fa19c0698f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a2541640 1 -- 172.21.15.119:0/1399419043 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c009490 con 0x7fa19c13abb0 2023-09-13T02:12:02.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a1d40640 1 --2- 172.21.15.119:0/1399419043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19c0ae730 0x7fa19c0b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T02:12:02.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a2541640 1 --2- 172.21.15.119:0/1399419043 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa19c13abb0 0x7fa19c137310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa19400e9b0 tx=0x7fa19400ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:02.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1927fc640 1 -- 172.21.15.119:0/1399419043 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19400cd80 con 0x7fa19c13abb0 2023-09-13T02:12:02.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1927fc640 1 -- 172.21.15.119:0/1399419043 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa194004b20 con 0x7fa19c13abb0 2023-09-13T02:12:02.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1927fc640 1 -- 172.21.15.119:0/1399419043 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa194005020 con 0x7fa19c13abb0 2023-09-13T02:12:02.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a3fa4640 1 -- 172.21.15.119:0/1399419043 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa198009560 con 0x7fa19c13abb0 2023-09-13T02:12:02.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.199+0000 7fa1a3fa4640 1 -- 172.21.15.119:0/1399419043 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c143650 con 0x7fa19c13abb0 2023-09-13T02:12:02.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.200+0000 7fa1927fc640 1 -- 172.21.15.119:0/1399419043 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa194005180 con 0x7fa19c13abb0 2023-09-13T02:12:02.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.200+0000 7fa1927fc640 1 -- 172.21.15.119:0/1399419043 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fa194014070 con 0x7fa19c13abb0 2023-09-13T02:12:02.207 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.200+0000 7fa1a3fa4640 1 -- 172.21.15.119:0/1399419043 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19c143d90 con 0x7fa19c13abb0 2023-09-13T02:12:02.208 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.204+0000 7fa1927fc640 1 -- 172.21.15.119:0/1399419043 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fa19401d020 con 0x7fa19c13abb0 2023-09-13T02:12:02.240 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:02.240+0000 7f800d848040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-13T02:12:02.241 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:02.241+0000 7fb1dcc14040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-13T02:12:02.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.276+0000 7fa1a3fa4640 1 -- 172.21.15.119:0/1399419043 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c", "id": 7} v 0) v1 -- 0x7fa19c04e100 con 0x7fa19c13abb0 2023-09-13T02:12:02.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.280+0000 7fa1927fc640 1 -- 172.21.15.119:0/1399419043 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa194018df0 con 0x7fa19c13abb0 2023-09-13T02:12:02.281 INFO:teuthology.orchestra.run.smithi119.stdout:7 2023-09-13T02:12:02.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.281+0000 7fa1a3fa4640 1 -- 172.21.15.119:0/1399419043 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa19c13abb0 msgr2=0x7fa19c137310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:02.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.281+0000 7fa1a3fa4640 1 --2- 172.21.15.119:0/1399419043 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa19c13abb0 0x7fa19c137310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa19400e9b0 tx=0x7fa19400ee70 comp rx=0 tx=0).stop 2023-09-13T02:12:02.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.281+0000 7fa1a3fa4640 1 -- 172.21.15.119:0/1399419043 shutdown_connections 2023-09-13T02:12:02.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.281+0000 7fa1a3fa4640 1 --2- 172.21.15.119:0/1399419043 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa19c13abb0 0x7fa19c137310 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.281+0000 7fa1a3fa4640 1 --2- 172.21.15.119:0/1399419043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa19c0afaf0 0x7fa19c0698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.281+0000 7fa1a3fa4640 1 --2- 172.21.15.119:0/1399419043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19c0ae730 0x7fa19c0b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.283 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.281+0000 7fa1a3fa4640 1 -- 172.21.15.119:0/1399419043 >> 172.21.15.119:0/1399419043 conn(0x7fa19c0b6860 msgr2=0x7fa19c1ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:02.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.281+0000 7fa1a3fa4640 1 -- 172.21.15.119:0/1399419043 shutdown_connections 2023-09-13T02:12:02.284 INFO:teuthology.orchestra.run.smithi119.stderr:2023-09-13T02:12:02.281+0000 7fa1a3fa4640 1 -- 172.21.15.119:0/1399419043 wait complete. 2023-09-13T02:12:02.292 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-13T02:12:02.292 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-13T02:12:02.295 INFO:tasks.ceph.osd.0:Started 2023-09-13T02:12:02.295 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-13T02:12:02.295 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-13T02:12:02.297 INFO:tasks.ceph.osd.1:Started 2023-09-13T02:12:02.298 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-13T02:12:02.298 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-13T02:12:02.300 INFO:tasks.ceph.osd.2:Started 2023-09-13T02:12:02.301 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-13T02:12:02.301 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-13T02:12:02.303 INFO:tasks.ceph.osd.3:Started 2023-09-13T02:12:02.304 INFO:tasks.ceph.osd.4:Restarting daemon 2023-09-13T02:12:02.304 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-09-13T02:12:02.335 INFO:tasks.ceph.osd.4:Started 2023-09-13T02:12:02.335 INFO:tasks.ceph.osd.5:Restarting daemon 2023-09-13T02:12:02.336 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-09-13T02:12:02.338 INFO:tasks.ceph.osd.5:Started 2023-09-13T02:12:02.338 INFO:tasks.ceph.osd.6:Restarting daemon 2023-09-13T02:12:02.339 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-09-13T02:12:02.341 INFO:tasks.ceph.osd.6:Started 2023-09-13T02:12:02.341 INFO:tasks.ceph.osd.7:Restarting daemon 2023-09-13T02:12:02.341 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-09-13T02:12:02.344 INFO:tasks.ceph.osd.7:Started 2023-09-13T02:12:02.344 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T02:12:02.347 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:02.346+0000 7f800d848040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-13T02:12:02.410 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:02.409+0000 7fb1dcc14040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-13T02:12:02.456 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.456+0000 7f5ad7d9e640 1 -- 172.21.15.104:0/1700777929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ad0144bb0 msgr2=0x7f5ad014c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:02.456 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.456+0000 7f5ad7d9e640 1 --2- 172.21.15.104:0/1700777929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ad0144bb0 0x7f5ad014c820 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009be0 tx=0x7f5acc02be70 comp rx=0 tx=0).stop 2023-09-13T02:12:02.457 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.456+0000 7f5ad7d9e640 1 -- 172.21.15.104:0/1700777929 shutdown_connections 2023-09-13T02:12:02.457 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.456+0000 7f5ad7d9e640 1 --2- 172.21.15.104:0/1700777929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ad0144bb0 0x7f5ad014c820 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.457 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.456+0000 7f5ad7d9e640 1 -- 172.21.15.104:0/1700777929 >> 172.21.15.104:0/1700777929 conn(0x7f5ad006aa50 msgr2=0x7f5ad00b6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:02.457 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.456+0000 7f5ad7d9e640 1 -- 172.21.15.104:0/1700777929 shutdown_connections 2023-09-13T02:12:02.458 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.456+0000 7f5ad7d9e640 1 -- 172.21.15.104:0/1700777929 wait complete. 2023-09-13T02:12:02.460 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.457+0000 7f5ad7d9e640 1 Processor -- start 2023-09-13T02:12:02.460 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.457+0000 7f5ad7d9e640 1 -- start start 2023-09-13T02:12:02.460 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.457+0000 7f5ad7d9e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ad00adc50 0x7f5ad0141320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:02.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.457+0000 7f5ad7d9e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ad00af4c0 0x7f5ad013e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:02.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.457+0000 7f5ad7d9e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ad0144bb0 0x7f5ad013c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:02.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.457+0000 7f5ad7d9e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad0132970 con 0x7f5ad00adc50 2023-09-13T02:12:02.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.457+0000 7f5ad7d9e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad01db2a0 con 0x7f5ad00af4c0 2023-09-13T02:12:02.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.457+0000 7f5ad7d9e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad013be60 con 0x7f5ad0144bb0 2023-09-13T02:12:02.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.457+0000 7f5ad5b3a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ad00adc50 0x7f5ad0141320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:02.462 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.458+0000 7f5ad5b3a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ad00adc50 0x7f5ad0141320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38348/0 (socket says 172.21.15.104:38348) 2023-09-13T02:12:02.462 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.458+0000 7f5ad5b3a640 1 -- 172.21.15.104:0/1530270658 learned_addr learned my addr 172.21.15.104:0/1530270658 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:02.462 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.458+0000 7f5ad633b640 1 --2- 172.21.15.104:0/1530270658 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ad0144bb0 0x7f5ad013c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:02.462 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.458+0000 7f5ad5339640 1 --2- 172.21.15.104:0/1530270658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ad00af4c0 0x7f5ad013e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:02.462 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.458+0000 7f5ad5b3a640 1 -- 172.21.15.104:0/1530270658 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ad0144bb0 msgr2=0x7f5ad013c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:02.463 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.458+0000 7f5ad5b3a640 1 --2- 172.21.15.104:0/1530270658 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ad0144bb0 0x7f5ad013c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.463 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.458+0000 7f5ad5b3a640 1 -- 172.21.15.104:0/1530270658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ad00af4c0 msgr2=0x7f5ad013e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:02.463 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.458+0000 7f5ad5b3a640 1 --2- 172.21.15.104:0/1530270658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ad00af4c0 0x7f5ad013e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.463 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.458+0000 7f5ad5b3a640 1 -- 172.21.15.104:0/1530270658 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc009840 con 0x7f5ad00adc50 2023-09-13T02:12:02.463 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.458+0000 7f5ad5b3a640 1 --2- 172.21.15.104:0/1530270658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ad00adc50 0x7f5ad0141320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800ca70 tx=0x7f5ac800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:02.464 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.458+0000 7f5ac67fc640 1 -- 172.21.15.104:0/1530270658 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8005480 con 0x7f5ad00adc50 2023-09-13T02:12:02.464 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.458+0000 7f5ac67fc640 1 -- 172.21.15.104:0/1530270658 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5ac800a7c0 con 0x7f5ad00adc50 2023-09-13T02:12:02.464 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.458+0000 7f5ac67fc640 1 -- 172.21.15.104:0/1530270658 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac800abf0 con 0x7f5ad00adc50 2023-09-13T02:12:02.464 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.458+0000 7f5ad7d9e640 1 -- 172.21.15.104:0/1530270658 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad013d4f0 con 0x7f5ad00adc50 2023-09-13T02:12:02.464 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.458+0000 7f5ad7d9e640 1 -- 172.21.15.104:0/1530270658 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad0136f60 con 0x7f5ad00adc50 2023-09-13T02:12:02.465 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.458+0000 7f5ac67fc640 1 -- 172.21.15.104:0/1530270658 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5ac800ad50 con 0x7f5ad00adc50 2023-09-13T02:12:02.465 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.459+0000 7f5ac67fc640 1 -- 172.21.15.104:0/1530270658 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5ac8012400 con 0x7f5ad00adc50 2023-09-13T02:12:02.465 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.459+0000 7f5ad7d9e640 1 -- 172.21.15.104:0/1530270658 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad00af040 con 0x7f5ad00adc50 2023-09-13T02:12:02.466 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:02.461+0000 7fb1dcc14040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-13T02:12:02.466 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.461+0000 7f5ac67fc640 1 -- 172.21.15.104:0/1530270658 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f5ac80038f0 con 0x7f5ad00adc50 2023-09-13T02:12:02.467 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:02.461+0000 7f800d848040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-13T02:12:02.520 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.520+0000 7f5ad7d9e640 1 -- 172.21.15.104:0/1530270658 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ad004e100 con 0x7f5ad00adc50 2023-09-13T02:12:02.520 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.520+0000 7f5ac67fc640 1 -- 172.21.15.104:0/1530270658 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5ac8003a90 con 0x7f5ad00adc50 2023-09-13T02:12:02.521 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:02.521 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":10,"fsid":"ac1f5a95-0d3a-406e-b4ca-c8ea43282cab","created":"2023-09-13T02:11:59.067178+0000","modified":"2023-09-13T02:12:02.278796+0000","last_up_change":"0.000000","last_in_change":"2023-09-13T02:12:02.278796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"67190066-4851-4b1f-aae8-bad59e79ebb5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f1907075-bb97-4a19-8dd6-322232caaf4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8c323c83-330c-4181-b622-10177c81f975","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"811457f5-c408-488d-a4ed-b947d1c55e82","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"552010ea-7d61-47c7-b4ac-657845e55e69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"41f415b0-6886-44ed-bccc-57c46cc975b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1f415570-dbcc-4cb9-930a-ad31a96c3ef3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T02:12:02.522 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.521+0000 7f5ad7d9e640 1 -- 172.21.15.104:0/1530270658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ad00adc50 msgr2=0x7f5ad0141320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:02.522 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.521+0000 7f5ad7d9e640 1 --2- 172.21.15.104:0/1530270658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ad00adc50 0x7f5ad0141320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800ca70 tx=0x7f5ac800cf30 comp rx=0 tx=0).stop 2023-09-13T02:12:02.523 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.521+0000 7f5ad7d9e640 1 -- 172.21.15.104:0/1530270658 shutdown_connections 2023-09-13T02:12:02.523 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.521+0000 7f5ad7d9e640 1 --2- 172.21.15.104:0/1530270658 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ad0144bb0 0x7f5ad013c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.523 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.521+0000 7f5ad7d9e640 1 --2- 172.21.15.104:0/1530270658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ad00af4c0 0x7f5ad013e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.523 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.521+0000 7f5ad7d9e640 1 --2- 172.21.15.104:0/1530270658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ad00adc50 0x7f5ad0141320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:02.523 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.521+0000 7f5ad7d9e640 1 -- 172.21.15.104:0/1530270658 >> 172.21.15.104:0/1530270658 conn(0x7f5ad006aa50 msgr2=0x7f5ad00b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:02.524 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.521+0000 7f5ad7d9e640 1 -- 172.21.15.104:0/1530270658 shutdown_connections 2023-09-13T02:12:02.524 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:02.522+0000 7f5ad7d9e640 1 -- 172.21.15.104:0/1530270658 wait complete. 2023-09-13T02:12:02.531 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-13T02:12:02.532 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-13T02:12:02.557 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:02.556+0000 7fb1dcc14040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-13T02:12:02.603 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:02.603+0000 7f800d848040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-13T02:12:02.645 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:02.645+0000 7f800d848040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-13T02:12:02.651 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:02.650+0000 7fb1dcc14040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-13T02:12:02.784 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:02.784+0000 7f800d848040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-13T02:12:02.792 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:02.792+0000 7fb1dcc14040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-13T02:12:02.834 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:02.834+0000 7fb1dcc14040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-13T02:12:02.909 INFO:tasks.ceph.osd.0.smithi104.stderr:2023-09-13T02:12:02.909+0000 7fa9cf814500 -1 Falling back to public interface 2023-09-13T02:12:02.913 INFO:tasks.ceph.osd.1.smithi104.stderr:2023-09-13T02:12:02.913+0000 7f2f26c25500 -1 Falling back to public interface 2023-09-13T02:12:02.917 INFO:tasks.ceph.osd.3.smithi104.stderr:2023-09-13T02:12:02.917+0000 7f8bbf36c500 -1 Falling back to public interface 2023-09-13T02:12:02.917 INFO:tasks.ceph.osd.2.smithi104.stderr:2023-09-13T02:12:02.917+0000 7f7f5ee1d500 -1 Falling back to public interface 2023-09-13T02:12:02.933 INFO:tasks.ceph.osd.4.smithi119.stderr:2023-09-13T02:12:02.932+0000 7fb4f2423500 -1 Falling back to public interface 2023-09-13T02:12:02.937 INFO:tasks.ceph.osd.5.smithi119.stderr:2023-09-13T02:12:02.936+0000 7f6f2c49c500 -1 Falling back to public interface 2023-09-13T02:12:02.940 INFO:tasks.ceph.osd.7.smithi119.stderr:2023-09-13T02:12:02.940+0000 7fd130e0d500 -1 Falling back to public interface 2023-09-13T02:12:02.946 INFO:tasks.ceph.osd.6.smithi119.stderr:2023-09-13T02:12:02.946+0000 7fed9d200500 -1 Falling back to public interface 2023-09-13T02:12:02.977 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:02.977+0000 7fb1dcc14040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-13T02:12:03.338 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-13T02:12:03.430 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.430+0000 7fd4d9a62640 1 -- 172.21.15.104:0/2458196445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4d4142890 msgr2=0x7fd4d413c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:03.431 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.430+0000 7fd4d9a62640 1 --2- 172.21.15.104:0/2458196445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4d4142890 0x7fd4d413c3f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd4d406c130 tx=0x7fd4cc02c140 comp rx=0 tx=0).stop 2023-09-13T02:12:03.431 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.430+0000 7fd4d9a62640 1 -- 172.21.15.104:0/2458196445 shutdown_connections 2023-09-13T02:12:03.431 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.430+0000 7fd4d9a62640 1 --2- 172.21.15.104:0/2458196445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4d4142890 0x7fd4d413c3f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:03.431 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.430+0000 7fd4d9a62640 1 --2- 172.21.15.104:0/2458196445 >> v2:172.21.15.119:3300/0 conn(0x7fd4d40aefb0 0x7fd4d413beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:03.432 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.430+0000 7fd4d9a62640 1 -- 172.21.15.104:0/2458196445 >> 172.21.15.104:0/2458196445 conn(0x7fd4d40b56f0 msgr2=0x7fd4d40b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:03.432 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.430+0000 7fd4d9a62640 1 -- 172.21.15.104:0/2458196445 shutdown_connections 2023-09-13T02:12:03.432 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.430+0000 7fd4d9a62640 1 -- 172.21.15.104:0/2458196445 wait complete. 2023-09-13T02:12:03.435 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.431+0000 7fd4d9a62640 1 Processor -- start 2023-09-13T02:12:03.435 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.431+0000 7fd4d9a62640 1 -- start start 2023-09-13T02:12:03.435 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4d9a62640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4d40aefb0 0x7fd4d4070940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:03.436 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4d9a62640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4d4142890 0x7fd4d413dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:03.436 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4d9a62640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4d413e150 0x7fd4d413e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:03.436 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4d9a62640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d4070e80 con 0x7fd4d4142890 2023-09-13T02:12:03.437 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4d9a62640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40a7120 con 0x7fd4d413e150 2023-09-13T02:12:03.437 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4d9a62640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d413ce90 con 0x7fd4d40aefb0 2023-09-13T02:12:03.437 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4caffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4d4142890 0x7fd4d413dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:03.437 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4caffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4d4142890 0x7fd4d413dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38366/0 (socket says 172.21.15.104:38366) 2023-09-13T02:12:03.437 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4caffd640 1 -- 172.21.15.104:0/3127974950 learned_addr learned my addr 172.21.15.104:0/3127974950 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:03.438 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4d3fff640 1 --2- 172.21.15.104:0/3127974950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4d413e150 0x7fd4d413e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:03.438 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4d37fe640 1 --2- 172.21.15.104:0/3127974950 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4d40aefb0 0x7fd4d4070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:03.438 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4caffd640 1 -- 172.21.15.104:0/3127974950 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4d40aefb0 msgr2=0x7fd4d4070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:03.438 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4caffd640 1 --2- 172.21.15.104:0/3127974950 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4d40aefb0 0x7fd4d4070940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:03.439 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4caffd640 1 -- 172.21.15.104:0/3127974950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4d413e150 msgr2=0x7fd4d413e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:03.440 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4caffd640 1 --2- 172.21.15.104:0/3127974950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4d413e150 0x7fd4d413e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:03.440 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4caffd640 1 -- 172.21.15.104:0/3127974950 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4cc009900 con 0x7fd4d4142890 2023-09-13T02:12:03.440 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4d3fff640 1 --2- 172.21.15.104:0/3127974950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4d413e150 0x7fd4d413e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:03.440 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4d37fe640 1 --2- 172.21.15.104:0/3127974950 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4d40aefb0 0x7fd4d4070940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:03.440 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4caffd640 1 --2- 172.21.15.104:0/3127974950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4d4142890 0x7fd4d413dc10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00c430 tx=0x7fd4bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:03.441 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4d0ff9640 1 -- 172.21.15.104:0/3127974950 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc011790 con 0x7fd4d4142890 2023-09-13T02:12:03.441 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4d0ff9640 1 -- 172.21.15.104:0/3127974950 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd4bc0119e0 con 0x7fd4d4142890 2023-09-13T02:12:03.441 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4d0ff9640 1 -- 172.21.15.104:0/3127974950 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc011e30 con 0x7fd4d4142890 2023-09-13T02:12:03.441 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.432+0000 7fd4d9a62640 1 -- 172.21.15.104:0/3127974950 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d40a6e40 con 0x7fd4d4142890 2023-09-13T02:12:03.441 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.433+0000 7fd4d9a62640 1 -- 172.21.15.104:0/3127974950 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d413d410 con 0x7fd4d4142890 2023-09-13T02:12:03.442 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.433+0000 7fd4d0ff9640 1 -- 172.21.15.104:0/3127974950 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd4bc01c760 con 0x7fd4d4142890 2023-09-13T02:12:03.442 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.433+0000 7fd4d0ff9640 1 -- 172.21.15.104:0/3127974950 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd4bc01b3c0 con 0x7fd4d4142890 2023-09-13T02:12:03.442 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.433+0000 7fd4d9a62640 1 -- 172.21.15.104:0/3127974950 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d40008d0 con 0x7fd4d4142890 2023-09-13T02:12:03.443 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.435+0000 7fd4d0ff9640 1 -- 172.21.15.104:0/3127974950 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fd4bc012420 con 0x7fd4d4142890 2023-09-13T02:12:03.495 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.495+0000 7fd4d9a62640 1 -- 172.21.15.104:0/3127974950 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4d40ac440 con 0x7fd4d4142890 2023-09-13T02:12:03.496 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.496+0000 7fd4d0ff9640 1 -- 172.21.15.104:0/3127974950 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd4bc02b090 con 0x7fd4d4142890 2023-09-13T02:12:03.496 INFO:teuthology.misc.health.smithi104.stdout: 2023-09-13T02:12:03.497 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":10,"fsid":"ac1f5a95-0d3a-406e-b4ca-c8ea43282cab","created":"2023-09-13T02:11:59.067178+0000","modified":"2023-09-13T02:12:02.278796+0000","last_up_change":"0.000000","last_in_change":"2023-09-13T02:12:02.278796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"67190066-4851-4b1f-aae8-bad59e79ebb5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f1907075-bb97-4a19-8dd6-322232caaf4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8c323c83-330c-4181-b622-10177c81f975","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"811457f5-c408-488d-a4ed-b947d1c55e82","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"552010ea-7d61-47c7-b4ac-657845e55e69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"41f415b0-6886-44ed-bccc-57c46cc975b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1f415570-dbcc-4cb9-930a-ad31a96c3ef3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T02:12:03.497 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.497+0000 7fd4d9a62640 1 -- 172.21.15.104:0/3127974950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4d4142890 msgr2=0x7fd4d413dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:03.498 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.497+0000 7fd4d9a62640 1 --2- 172.21.15.104:0/3127974950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4d4142890 0x7fd4d413dc10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00c430 tx=0x7fd4bc00c8f0 comp rx=0 tx=0).stop 2023-09-13T02:12:03.498 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.497+0000 7fd4d9a62640 1 -- 172.21.15.104:0/3127974950 shutdown_connections 2023-09-13T02:12:03.498 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.497+0000 7fd4d9a62640 1 --2- 172.21.15.104:0/3127974950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4d413e150 0x7fd4d413e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:03.498 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.497+0000 7fd4d9a62640 1 --2- 172.21.15.104:0/3127974950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4d4142890 0x7fd4d413dc10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:03.499 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.497+0000 7fd4d9a62640 1 --2- 172.21.15.104:0/3127974950 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4d40aefb0 0x7fd4d4070940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:03.499 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.497+0000 7fd4d9a62640 1 -- 172.21.15.104:0/3127974950 >> 172.21.15.104:0/3127974950 conn(0x7fd4d40b56f0 msgr2=0x7fd4d41401d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:03.499 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.497+0000 7fd4d9a62640 1 -- 172.21.15.104:0/3127974950 shutdown_connections 2023-09-13T02:12:03.499 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:03.497+0000 7fd4d9a62640 1 -- 172.21.15.104:0/3127974950 wait complete. 2023-09-13T02:12:03.506 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-09-13T02:12:03.590 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:03.590+0000 7f800d848040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-13T02:12:03.783 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:03.782+0000 7fb1dcc14040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-13T02:12:03.861 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:03.861+0000 7f800d848040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-13T02:12:03.911 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:03.911+0000 7f800d848040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-13T02:12:04.010 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:04.010+0000 7f800d848040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-13T02:12:04.063 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:04.062+0000 7fb1dcc14040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-13T02:12:04.116 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:04.115+0000 7fb1dcc14040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-13T02:12:04.215 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-09-13T02:12:04.214+0000 7fb1dcc14040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-13T02:12:05.033 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:05.033+0000 7f7faed15640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-13T02:12:05.034 INFO:tasks.ceph.mgr.y.smithi104.stderr:2023-09-13T02:12:05.034+0000 7f7faed15640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-13T02:12:06.362 INFO:tasks.ceph.osd.4.smithi119.stderr:2023-09-13T02:12:06.362+0000 7fb4f2423500 -1 osd.4 0 log_to_monitors true 2023-09-13T02:12:06.402 INFO:tasks.ceph.osd.0.smithi104.stderr:2023-09-13T02:12:06.402+0000 7fa9cf814500 -1 osd.0 0 log_to_monitors true 2023-09-13T02:12:06.416 INFO:tasks.ceph.osd.7.smithi119.stderr:2023-09-13T02:12:06.416+0000 7fd130e0d500 -1 osd.7 0 log_to_monitors true 2023-09-13T02:12:06.430 INFO:tasks.ceph.osd.2.smithi104.stderr:2023-09-13T02:12:06.431+0000 7f7f5ee1d500 -1 osd.2 0 log_to_monitors true 2023-09-13T02:12:06.451 INFO:tasks.ceph.osd.6.smithi119.stderr:2023-09-13T02:12:06.450+0000 7fed9d200500 -1 osd.6 0 log_to_monitors true 2023-09-13T02:12:06.452 INFO:tasks.ceph.osd.5.smithi119.stderr:2023-09-13T02:12:06.451+0000 7f6f2c49c500 -1 osd.5 0 log_to_monitors true 2023-09-13T02:12:06.453 INFO:tasks.ceph.osd.3.smithi104.stderr:2023-09-13T02:12:06.454+0000 7f8bbf36c500 -1 osd.3 0 log_to_monitors true 2023-09-13T02:12:06.458 INFO:tasks.ceph.osd.1.smithi104.stderr:2023-09-13T02:12:06.459+0000 7f2f26c25500 -1 osd.1 0 log_to_monitors true 2023-09-13T02:12:10.174 INFO:tasks.ceph.osd.6.smithi119.stderr:2023-09-13T02:12:10.174+0000 7fed98969640 -1 osd.6 0 waiting for initial osdmap 2023-09-13T02:12:10.187 INFO:tasks.ceph.osd.6.smithi119.stderr:2023-09-13T02:12:10.187+0000 7fed90f9c640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T02:12:10.194 INFO:tasks.ceph.osd.0.smithi104.stderr:2023-09-13T02:12:10.195+0000 7fa9ca952640 -1 osd.0 0 waiting for initial osdmap 2023-09-13T02:12:10.195 INFO:tasks.ceph.osd.2.smithi104.stderr:2023-09-13T02:12:10.196+0000 7f7f59f3c640 -1 osd.2 0 waiting for initial osdmap 2023-09-13T02:12:10.197 INFO:tasks.ceph.osd.3.smithi104.stderr:2023-09-13T02:12:10.198+0000 7f8bbaad5640 -1 osd.3 0 waiting for initial osdmap 2023-09-13T02:12:10.200 INFO:tasks.ceph.osd.1.smithi104.stderr:2023-09-13T02:12:10.200+0000 7f2f22390640 -1 osd.1 0 waiting for initial osdmap 2023-09-13T02:12:10.202 INFO:tasks.ceph.osd.4.smithi119.stderr:2023-09-13T02:12:10.201+0000 7fb4eee28640 -1 osd.4 0 waiting for initial osdmap 2023-09-13T02:12:10.210 INFO:tasks.ceph.osd.0.smithi104.stderr:2023-09-13T02:12:10.210+0000 7fa9c2f85640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T02:12:10.210 INFO:tasks.ceph.osd.2.smithi104.stderr:2023-09-13T02:12:10.210+0000 7f7f5256f640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T02:12:10.211 INFO:tasks.ceph.osd.3.smithi104.stderr:2023-09-13T02:12:10.212+0000 7f8bb3108640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T02:12:10.212 INFO:tasks.ceph.osd.1.smithi104.stderr:2023-09-13T02:12:10.212+0000 7f2f1a9c3640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T02:12:10.215 INFO:tasks.ceph.osd.4.smithi119.stderr:2023-09-13T02:12:10.215+0000 7fb4e5c21640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T02:12:10.230 INFO:tasks.ceph.osd.5.smithi119.stderr:2023-09-13T02:12:10.229+0000 7f6f27c05640 -1 osd.5 0 waiting for initial osdmap 2023-09-13T02:12:10.240 INFO:tasks.ceph.osd.7.smithi119.stderr:2023-09-13T02:12:10.240+0000 7fd12c048640 -1 osd.7 0 waiting for initial osdmap 2023-09-13T02:12:10.241 INFO:tasks.ceph.osd.5.smithi119.stderr:2023-09-13T02:12:10.241+0000 7f6f20238640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T02:12:10.257 INFO:tasks.ceph.osd.7.smithi119.stderr:2023-09-13T02:12:10.257+0000 7fd12467b640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T02:12:10.312 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-13T02:12:10.403 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.403+0000 7f59b5a08640 1 -- 172.21.15.104:0/2371933212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59b0142240 msgr2=0x7f59b0142680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:10.404 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.403+0000 7f59b5a08640 1 --2- 172.21.15.104:0/2371933212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59b0142240 0x7f59b0142680 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f59b00aec40 tx=0x7f59a002be20 comp rx=0 tx=0).stop 2023-09-13T02:12:10.404 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.403+0000 7f59b5a08640 1 -- 172.21.15.104:0/2371933212 shutdown_connections 2023-09-13T02:12:10.404 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.403+0000 7f59b5a08640 1 --2- 172.21.15.104:0/2371933212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59b0142240 0x7f59b0142680 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:10.404 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.403+0000 7f59b5a08640 1 --2- 172.21.15.104:0/2371933212 >> v2:172.21.15.119:3300/0 conn(0x7f59b0070e60 0x7f59b0145590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:10.405 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.403+0000 7f59b5a08640 1 -- 172.21.15.104:0/2371933212 >> 172.21.15.104:0/2371933212 conn(0x7f59b0069a90 msgr2=0x7f59b00b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:10.405 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.403+0000 7f59b5a08640 1 -- 172.21.15.104:0/2371933212 shutdown_connections 2023-09-13T02:12:10.405 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.403+0000 7f59b5a08640 1 -- 172.21.15.104:0/2371933212 wait complete. 2023-09-13T02:12:10.408 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.404+0000 7f59b5a08640 1 Processor -- start 2023-09-13T02:12:10.408 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.404+0000 7f59b5a08640 1 -- start start 2023-09-13T02:12:10.408 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59b5a08640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59b0070e60 0x7f59b0144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:10.408 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59b5a08640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59b00b3660 0x7f59b01d89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:10.409 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59b5a08640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59b0142240 0x7f59b01db540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:10.409 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59b5a08640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b013fa30 con 0x7f59b0070e60 2023-09-13T02:12:10.409 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59b5a08640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b013f820 con 0x7f59b00b3660 2023-09-13T02:12:10.409 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59b5a08640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b01d7fd0 con 0x7f59b0142240 2023-09-13T02:12:10.409 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59aeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59b0070e60 0x7f59b0144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:10.410 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59aeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59b0070e60 0x7f59b0144850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38652/0 (socket says 172.21.15.104:38652) 2023-09-13T02:12:10.410 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59aeffd640 1 -- 172.21.15.104:0/3460764575 learned_addr learned my addr 172.21.15.104:0/3460764575 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:10.410 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59ae7fc640 1 --2- 172.21.15.104:0/3460764575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59b00b3660 0x7f59b01d89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:10.410 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59af7fe640 1 --2- 172.21.15.104:0/3460764575 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59b0142240 0x7f59b01db540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:10.410 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59aeffd640 1 -- 172.21.15.104:0/3460764575 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59b0142240 msgr2=0x7f59b01db540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:10.410 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59aeffd640 1 --2- 172.21.15.104:0/3460764575 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59b0142240 0x7f59b01db540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:10.411 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59aeffd640 1 -- 172.21.15.104:0/3460764575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59b00b3660 msgr2=0x7f59b01d89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:10.411 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59aeffd640 1 --2- 172.21.15.104:0/3460764575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59b00b3660 0x7f59b01d89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:10.411 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59aeffd640 1 -- 172.21.15.104:0/3460764575 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a0009560 con 0x7f59b0070e60 2023-09-13T02:12:10.411 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59ae7fc640 1 --2- 172.21.15.104:0/3460764575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59b00b3660 0x7f59b01d89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:10.411 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f59aeffd640 1 --2- 172.21.15.104:0/3460764575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59b0070e60 0x7f59b0144850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f59a400e9f0 tx=0x7f59a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:10.412 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.405+0000 7f5997fff640 1 -- 172.21.15.104:0/3460764575 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a4009700 con 0x7f59b0070e60 2023-09-13T02:12:10.412 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.406+0000 7f5997fff640 1 -- 172.21.15.104:0/3460764575 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f59a400ce10 con 0x7f59b0070e60 2023-09-13T02:12:10.412 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.406+0000 7f5997fff640 1 -- 172.21.15.104:0/3460764575 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a4010690 con 0x7f59b0070e60 2023-09-13T02:12:10.412 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.406+0000 7f59b5a08640 1 -- 172.21.15.104:0/3460764575 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b01d8550 con 0x7f59b0070e60 2023-09-13T02:12:10.412 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.406+0000 7f59b5a08640 1 -- 172.21.15.104:0/3460764575 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b013f0b0 con 0x7f59b0070e60 2023-09-13T02:12:10.413 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.406+0000 7f59b5a08640 1 -- 172.21.15.104:0/3460764575 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b00008d0 con 0x7f59b0070e60 2023-09-13T02:12:10.413 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.407+0000 7f5997fff640 1 -- 172.21.15.104:0/3460764575 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 4) v1 ==== 88677+0+0 (secure 0 0 0) 0x7f59a40107f0 con 0x7f59b0070e60 2023-09-13T02:12:10.413 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.407+0000 7f5997fff640 1 --2- 172.21.15.104:0/3460764575 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f599c06a460 0x7f599c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:10.413 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.407+0000 7f5997fff640 1 -- 172.21.15.104:0/3460764575 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f59a4014070 con 0x7f59b0070e60 2023-09-13T02:12:10.413 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.407+0000 7f59ae7fc640 1 --2- 172.21.15.104:0/3460764575 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f599c06a460 0x7f599c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:10.413 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.408+0000 7f59ae7fc640 1 --2- 172.21.15.104:0/3460764575 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f599c06a460 0x7f599c06c920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f59a0035000 tx=0x7f59a0004730 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:10.414 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.412+0000 7f5997fff640 1 -- 172.21.15.104:0/3460764575 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f59a40519b0 con 0x7f59b0070e60 2023-09-13T02:12:10.578 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.578+0000 7f59b5a08640 1 -- 172.21.15.104:0/3460764575 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59b0071430 con 0x7f59b0070e60 2023-09-13T02:12:10.579 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.579+0000 7f5997fff640 1 -- 172.21.15.104:0/3460764575 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f59a4054c20 con 0x7f59b0070e60 2023-09-13T02:12:10.579 INFO:teuthology.misc.health.smithi104.stdout: 2023-09-13T02:12:10.580 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":12,"fsid":"ac1f5a95-0d3a-406e-b4ca-c8ea43282cab","created":"2023-09-13T02:11:59.067178+0000","modified":"2023-09-13T02:12:08.088544+0000","last_up_change":"0.000000","last_in_change":"2023-09-13T02:12:02.278796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"67190066-4851-4b1f-aae8-bad59e79ebb5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f1907075-bb97-4a19-8dd6-322232caaf4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8c323c83-330c-4181-b622-10177c81f975","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"811457f5-c408-488d-a4ed-b947d1c55e82","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"552010ea-7d61-47c7-b4ac-657845e55e69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"41f415b0-6886-44ed-bccc-57c46cc975b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1f415570-dbcc-4cb9-930a-ad31a96c3ef3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T02:12:10.581 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.581+0000 7f59b5a08640 1 -- 172.21.15.104:0/3460764575 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f599c06a460 msgr2=0x7f599c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:10.581 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.581+0000 7f59b5a08640 1 --2- 172.21.15.104:0/3460764575 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f599c06a460 0x7f599c06c920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f59a0035000 tx=0x7f59a0004730 comp rx=0 tx=0).stop 2023-09-13T02:12:10.581 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.581+0000 7f59b5a08640 1 -- 172.21.15.104:0/3460764575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59b0070e60 msgr2=0x7f59b0144850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:10.581 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.581+0000 7f59b5a08640 1 --2- 172.21.15.104:0/3460764575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59b0070e60 0x7f59b0144850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f59a400e9f0 tx=0x7f59a400eeb0 comp rx=0 tx=0).stop 2023-09-13T02:12:10.582 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.581+0000 7f59b5a08640 1 -- 172.21.15.104:0/3460764575 shutdown_connections 2023-09-13T02:12:10.582 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.581+0000 7f59b5a08640 1 --2- 172.21.15.104:0/3460764575 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f599c06a460 0x7f599c06c920 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:10.582 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.581+0000 7f59b5a08640 1 --2- 172.21.15.104:0/3460764575 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59b0142240 0x7f59b01db540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:10.582 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.581+0000 7f59b5a08640 1 --2- 172.21.15.104:0/3460764575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59b00b3660 0x7f59b01d89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:10.582 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.581+0000 7f59b5a08640 1 --2- 172.21.15.104:0/3460764575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59b0070e60 0x7f59b0144850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:10.583 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.581+0000 7f59b5a08640 1 -- 172.21.15.104:0/3460764575 >> 172.21.15.104:0/3460764575 conn(0x7f59b0069a90 msgr2=0x7f59b00afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:10.583 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.581+0000 7f59b5a08640 1 -- 172.21.15.104:0/3460764575 shutdown_connections 2023-09-13T02:12:10.583 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:10.581+0000 7f59b5a08640 1 -- 172.21.15.104:0/3460764575 wait complete. 2023-09-13T02:12:10.590 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-09-13T02:12:17.397 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-13T02:12:17.498 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.497+0000 7fd6b0c4f640 1 -- 172.21.15.104:0/207746716 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6ac0aebb0 msgr2=0x7fd6ac13af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:17.498 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.497+0000 7fd6b0c4f640 1 --2- 172.21.15.104:0/207746716 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6ac0aebb0 0x7fd6ac13af90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd694009830 tx=0x7fd69402bc30 comp rx=0 tx=0).stop 2023-09-13T02:12:17.499 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.498+0000 7fd6b0c4f640 1 -- 172.21.15.104:0/207746716 shutdown_connections 2023-09-13T02:12:17.499 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.498+0000 7fd6b0c4f640 1 --2- 172.21.15.104:0/207746716 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6ac0aebb0 0x7fd6ac13af90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:17.499 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.498+0000 7fd6b0c4f640 1 --2- 172.21.15.104:0/207746716 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6ac1447f0 0x7fd6ac0b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:17.499 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.498+0000 7fd6b0c4f640 1 -- 172.21.15.104:0/207746716 >> 172.21.15.104:0/207746716 conn(0x7fd6ac0b6810 msgr2=0x7fd6ac0b6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:17.499 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.498+0000 7fd6b0c4f640 1 -- 172.21.15.104:0/207746716 shutdown_connections 2023-09-13T02:12:17.500 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.498+0000 7fd6b0c4f640 1 -- 172.21.15.104:0/207746716 wait complete. 2023-09-13T02:12:17.502 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.499+0000 7fd6b0c4f640 1 Processor -- start 2023-09-13T02:12:17.503 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.499+0000 7fd6b0c4f640 1 -- start start 2023-09-13T02:12:17.503 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.499+0000 7fd6b0c4f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6ac0aebb0 0x7fd6ac13bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:17.503 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.499+0000 7fd6b0c4f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6ac13b4d0 0x7fd6ac1d7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:17.503 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.499+0000 7fd6b0c4f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6ac1447f0 0x7fd6ac13ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:17.504 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.499+0000 7fd6b0c4f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac1d8520 con 0x7fd6ac1447f0 2023-09-13T02:12:17.504 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.499+0000 7fd6b0c4f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac1d87b0 con 0x7fd6ac13b4d0 2023-09-13T02:12:17.504 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.499+0000 7fd6b0c4f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac1d8a90 con 0x7fd6ac0aebb0 2023-09-13T02:12:17.504 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6aad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6ac1447f0 0x7fd6ac13ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:17.504 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6aad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6ac1447f0 0x7fd6ac13ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51824/0 (socket says 172.21.15.104:51824) 2023-09-13T02:12:17.504 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6aad9d640 1 -- 172.21.15.104:0/1368157803 learned_addr learned my addr 172.21.15.104:0/1368157803 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:17.505 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6aa59c640 1 --2- 172.21.15.104:0/1368157803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6ac0aebb0 0x7fd6ac13bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:17.505 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6a3fff640 1 --2- 172.21.15.104:0/1368157803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6ac13b4d0 0x7fd6ac1d7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:17.505 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6aad9d640 1 -- 172.21.15.104:0/1368157803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6ac0aebb0 msgr2=0x7fd6ac13bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:17.505 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6aad9d640 1 --2- 172.21.15.104:0/1368157803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6ac0aebb0 0x7fd6ac13bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:17.506 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6aad9d640 1 -- 172.21.15.104:0/1368157803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6ac13b4d0 msgr2=0x7fd6ac1d7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:17.506 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6aad9d640 1 --2- 172.21.15.104:0/1368157803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6ac13b4d0 0x7fd6ac1d7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:17.506 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6aad9d640 1 -- 172.21.15.104:0/1368157803 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd694009490 con 0x7fd6ac1447f0 2023-09-13T02:12:17.506 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6a3fff640 1 --2- 172.21.15.104:0/1368157803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6ac13b4d0 0x7fd6ac1d7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:12:17.506 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6aa59c640 1 --2- 172.21.15.104:0/1368157803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6ac0aebb0 0x7fd6ac13bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:12:17.507 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6aad9d640 1 --2- 172.21.15.104:0/1368157803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6ac1447f0 0x7fd6ac13ca60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400cae0 tx=0x7fd6a400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:17.507 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6a2ffd640 1 -- 172.21.15.104:0/1368157803 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a400ac40 con 0x7fd6ac1447f0 2023-09-13T02:12:17.507 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6a2ffd640 1 -- 172.21.15.104:0/1368157803 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd6a400ae90 con 0x7fd6ac1447f0 2023-09-13T02:12:17.507 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6b0c4f640 1 -- 172.21.15.104:0/1368157803 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ac1d8d70 con 0x7fd6ac1447f0 2023-09-13T02:12:17.507 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6a2ffd640 1 -- 172.21.15.104:0/1368157803 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4003bd0 con 0x7fd6ac1447f0 2023-09-13T02:12:17.507 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.500+0000 7fd6b0c4f640 1 -- 172.21.15.104:0/1368157803 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ac13cfa0 con 0x7fd6ac1447f0 2023-09-13T02:12:17.508 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.501+0000 7fd6b0c4f640 1 -- 172.21.15.104:0/1368157803 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ac1d8f00 con 0x7fd6ac1447f0 2023-09-13T02:12:17.508 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.502+0000 7fd6a2ffd640 1 -- 172.21.15.104:0/1368157803 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd6a4003d30 con 0x7fd6ac1447f0 2023-09-13T02:12:17.508 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.502+0000 7fd6a2ffd640 1 --2- 172.21.15.104:0/1368157803 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd68c06a4f0 0x7fd68c06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:17.508 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.502+0000 7fd6aa59c640 1 --2- 172.21.15.104:0/1368157803 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd68c06a4f0 0x7fd68c06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:17.508 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.502+0000 7fd6a2ffd640 1 -- 172.21.15.104:0/1368157803 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd6a40891a0 con 0x7fd6ac1447f0 2023-09-13T02:12:17.509 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.503+0000 7fd6aa59c640 1 --2- 172.21.15.104:0/1368157803 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd68c06a4f0 0x7fd68c06c9b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd69c005fd0 tx=0x7fd69c005d20 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:17.509 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.507+0000 7fd6a2ffd640 1 -- 172.21.15.104:0/1368157803 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd6a4054a70 con 0x7fd6ac1447f0 2023-09-13T02:12:17.676 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.676+0000 7fd6b0c4f640 1 -- 172.21.15.104:0/1368157803 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6ac0008d0 con 0x7fd6ac1447f0 2023-09-13T02:12:17.676 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.676+0000 7fd6a2ffd640 1 -- 172.21.15.104:0/1368157803 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12886 (secure 0 0 0) 0x7fd6a4058090 con 0x7fd6ac1447f0 2023-09-13T02:12:17.677 INFO:teuthology.misc.health.smithi104.stdout: 2023-09-13T02:12:17.677 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":16,"fsid":"ac1f5a95-0d3a-406e-b4ca-c8ea43282cab","created":"2023-09-13T02:11:59.067178+0000","modified":"2023-09-13T02:12:14.213277+0000","last_up_change":"2023-09-13T02:12:11.207888+0000","last_in_change":"2023-09-13T02:12:02.278796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T02:12:12.071023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67190066-4851-4b1f-aae8-bad59e79ebb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6801","nonce":3271772377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6803","nonce":3271772377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6807","nonce":3271772377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6805","nonce":3271772377}]},"public_addr":"172.21.15.104:6801/3271772377","cluster_addr":"172.21.15.104:6803/3271772377","heartbeat_back_addr":"172.21.15.104:6807/3271772377","heartbeat_front_addr":"172.21.15.104:6805/3271772377","state":["exists","up"]},{"osd":1,"uuid":"f1907075-bb97-4a19-8dd6-322232caaf4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6809","nonce":3786698894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6811","nonce":3786698894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6815","nonce":3786698894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6813","nonce":3786698894}]},"public_addr":"172.21.15.104:6809/3786698894","cluster_addr":"172.21.15.104:6811/3786698894","heartbeat_back_addr":"172.21.15.104:6815/3786698894","heartbeat_front_addr":"172.21.15.104:6813/3786698894","state":["exists","up"]},{"osd":2,"uuid":"8c323c83-330c-4181-b622-10177c81f975","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6819","nonce":2319361072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6822","nonce":2319361072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6827","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6829","nonce":2319361072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6826","nonce":2319361072}]},"public_addr":"172.21.15.104:6819/2319361072","cluster_addr":"172.21.15.104:6822/2319361072","heartbeat_back_addr":"172.21.15.104:6829/2319361072","heartbeat_front_addr":"172.21.15.104:6826/2319361072","state":["exists","up"]},{"osd":3,"uuid":"811457f5-c408-488d-a4ed-b947d1c55e82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6818","nonce":621253853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6823","nonce":621253853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6831","nonce":621253853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6825","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6828","nonce":621253853}]},"public_addr":"172.21.15.104:6818/621253853","cluster_addr":"172.21.15.104:6823/621253853","heartbeat_back_addr":"172.21.15.104:6831/621253853","heartbeat_front_addr":"172.21.15.104:6828/621253853","state":["exists","up"]},{"osd":4,"uuid":"552010ea-7d61-47c7-b4ac-657845e55e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6801","nonce":3049794634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6803","nonce":3049794634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6807","nonce":3049794634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6805","nonce":3049794634}]},"public_addr":"172.21.15.119:6801/3049794634","cluster_addr":"172.21.15.119:6803/3049794634","heartbeat_back_addr":"172.21.15.119:6807/3049794634","heartbeat_front_addr":"172.21.15.119:6805/3049794634","state":["exists","up"]},{"osd":5,"uuid":"41f415b0-6886-44ed-bccc-57c46cc975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6809","nonce":2918159428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6811","nonce":2918159428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6815","nonce":2918159428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6813","nonce":2918159428}]},"public_addr":"172.21.15.119:6809/2918159428","cluster_addr":"172.21.15.119:6811/2918159428","heartbeat_back_addr":"172.21.15.119:6815/2918159428","heartbeat_front_addr":"172.21.15.119:6813/2918159428","state":["exists","up"]},{"osd":6,"uuid":"1f415570-dbcc-4cb9-930a-ad31a96c3ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6825","nonce":3509665357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6827","nonce":3509665357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6831","nonce":3509665357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6829","nonce":3509665357}]},"public_addr":"172.21.15.119:6825/3509665357","cluster_addr":"172.21.15.119:6827/3509665357","heartbeat_back_addr":"172.21.15.119:6831/3509665357","heartbeat_front_addr":"172.21.15.119:6829/3509665357","state":["exists","up"]},{"osd":7,"uuid":"ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6817","nonce":892749725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6819","nonce":892749725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6823","nonce":892749725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6821","nonce":892749725}]},"public_addr":"172.21.15.119:6817/892749725","cluster_addr":"172.21.15.119:6819/892749725","heartbeat_back_addr":"172.21.15.119:6823/892749725","heartbeat_front_addr":"172.21.15.119:6821/892749725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.489481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.468615+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.485958+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.424425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.456308+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.427607+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T02:12:17.679 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.678+0000 7fd6b0c4f640 1 -- 172.21.15.104:0/1368157803 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd68c06a4f0 msgr2=0x7fd68c06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:17.679 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.678+0000 7fd6b0c4f640 1 --2- 172.21.15.104:0/1368157803 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd68c06a4f0 0x7fd68c06c9b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd69c005fd0 tx=0x7fd69c005d20 comp rx=0 tx=0).stop 2023-09-13T02:12:17.679 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.678+0000 7fd6b0c4f640 1 -- 172.21.15.104:0/1368157803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6ac1447f0 msgr2=0x7fd6ac13ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:17.679 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.678+0000 7fd6b0c4f640 1 --2- 172.21.15.104:0/1368157803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6ac1447f0 0x7fd6ac13ca60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400cae0 tx=0x7fd6a400a060 comp rx=0 tx=0).stop 2023-09-13T02:12:17.680 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.678+0000 7fd6b0c4f640 1 -- 172.21.15.104:0/1368157803 shutdown_connections 2023-09-13T02:12:17.680 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.678+0000 7fd6b0c4f640 1 --2- 172.21.15.104:0/1368157803 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd68c06a4f0 0x7fd68c06c9b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:17.680 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.678+0000 7fd6b0c4f640 1 --2- 172.21.15.104:0/1368157803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6ac1447f0 0x7fd6ac13ca60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:17.680 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.678+0000 7fd6b0c4f640 1 --2- 172.21.15.104:0/1368157803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6ac13b4d0 0x7fd6ac1d7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:17.680 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.678+0000 7fd6b0c4f640 1 --2- 172.21.15.104:0/1368157803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6ac0aebb0 0x7fd6ac13bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:17.680 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.678+0000 7fd6b0c4f640 1 -- 172.21.15.104:0/1368157803 >> 172.21.15.104:0/1368157803 conn(0x7fd6ac0b6810 msgr2=0x7fd6ac0b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:17.681 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.679+0000 7fd6b0c4f640 1 -- 172.21.15.104:0/1368157803 shutdown_connections 2023-09-13T02:12:17.681 INFO:teuthology.misc.health.smithi104.stderr:2023-09-13T02:12:17.679+0000 7fd6b0c4f640 1 -- 172.21.15.104:0/1368157803 wait complete. 2023-09-13T02:12:17.688 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-09-13T02:12:17.688 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-13T02:12:17.689 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-13T02:12:17.689 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-13T02:12:17.692 INFO:tasks.ceph.mds.a:Started 2023-09-13T02:12:17.692 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-13T02:12:17.692 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-13T02:12:17.695 INFO:tasks.ceph.mds.b:Started 2023-09-13T02:12:17.696 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-13T02:12:17.696 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T02:12:17.766 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2023-09-13T02:12:17.778 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-09-13T02:12:17.800 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.800+0000 7f57a4bf0640 1 -- 172.21.15.104:0/539903656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a00b1820 msgr2=0x7f57a00afdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:17.801 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.800+0000 7f57a4bf0640 1 --2- 172.21.15.104:0/539903656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a00b1820 0x7f57a00afdc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5794009900 tx=0x7f579402bd70 comp rx=0 tx=0).stop 2023-09-13T02:12:17.801 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.800+0000 7f57a4bf0640 1 -- 172.21.15.104:0/539903656 shutdown_connections 2023-09-13T02:12:17.801 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.800+0000 7f57a4bf0640 1 --2- 172.21.15.104:0/539903656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a00b1820 0x7f57a00afdc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:17.801 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.800+0000 7f57a4bf0640 1 --2- 172.21.15.104:0/539903656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57a0147b90 0x7f57a01482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:17.801 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.800+0000 7f57a4bf0640 1 -- 172.21.15.104:0/539903656 >> 172.21.15.104:0/539903656 conn(0x7f57a00708b0 msgr2=0x7f57a0070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:17.802 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.800+0000 7f57a4bf0640 1 -- 172.21.15.104:0/539903656 shutdown_connections 2023-09-13T02:12:17.802 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.800+0000 7f57a4bf0640 1 -- 172.21.15.104:0/539903656 wait complete. 2023-09-13T02:12:17.805 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.801+0000 7f57a4bf0640 1 Processor -- start 2023-09-13T02:12:17.805 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.801+0000 7f57a4bf0640 1 -- start start 2023-09-13T02:12:17.805 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.802+0000 7f57a4bf0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57a00b5ba0 0x7f57a01ce980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:17.805 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.802+0000 7f57a4bf0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a0147b90 0x7f57a013fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:17.806 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.802+0000 7f57a4bf0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57a01403d0 0x7f57a013ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:17.806 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.802+0000 7f57a4bf0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a013f4d0 con 0x7f57a0147b90 2023-09-13T02:12:17.806 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.802+0000 7f57a4bf0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00b9c00 con 0x7f57a00b5ba0 2023-09-13T02:12:17.806 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.802+0000 7f57a4bf0640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00ba1c0 con 0x7f57a01403d0 2023-09-13T02:12:17.806 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.802+0000 7f579dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a0147b90 0x7f57a013fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:17.807 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.802+0000 7f579dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a0147b90 0x7f57a013fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51850/0 (socket says 172.21.15.104:51850) 2023-09-13T02:12:17.807 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.802+0000 7f579dd9b640 1 -- 172.21.15.104:0/2566734117 learned_addr learned my addr 172.21.15.104:0/2566734117 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:17.807 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.802+0000 7f579ed9d640 1 --2- 172.21.15.104:0/2566734117 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57a01403d0 0x7f57a013ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:17.807 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.802+0000 7f579dd9b640 1 -- 172.21.15.104:0/2566734117 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57a01403d0 msgr2=0x7f57a013ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:17.807 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.802+0000 7f579e59c640 1 --2- 172.21.15.104:0/2566734117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57a00b5ba0 0x7f57a01ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:17.808 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.802+0000 7f579dd9b640 1 --2- 172.21.15.104:0/2566734117 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57a01403d0 0x7f57a013ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:17.808 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.802+0000 7f579dd9b640 1 -- 172.21.15.104:0/2566734117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57a00b5ba0 msgr2=0x7f57a01ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:17.808 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.802+0000 7f579dd9b640 1 --2- 172.21.15.104:0/2566734117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57a00b5ba0 0x7f57a01ce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:17.808 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.802+0000 7f579dd9b640 1 -- 172.21.15.104:0/2566734117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5794009560 con 0x7f57a0147b90 2023-09-13T02:12:17.808 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.802+0000 7f579dd9b640 1 --2- 172.21.15.104:0/2566734117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a0147b90 0x7f57a013fe90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5794036040 tx=0x7f579402da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:17.809 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.803+0000 7f578effd640 1 -- 172.21.15.104:0/2566734117 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794003800 con 0x7f57a0147b90 2023-09-13T02:12:17.809 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.803+0000 7f578effd640 1 -- 172.21.15.104:0/2566734117 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5794003a50 con 0x7f57a0147b90 2023-09-13T02:12:17.809 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.803+0000 7f57a4bf0640 1 -- 172.21.15.104:0/2566734117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a00ba650 con 0x7f57a0147b90 2023-09-13T02:12:17.809 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.803+0000 7f578effd640 1 -- 172.21.15.104:0/2566734117 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794003e40 con 0x7f57a0147b90 2023-09-13T02:12:17.809 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.803+0000 7f57a4bf0640 1 -- 172.21.15.104:0/2566734117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a013f720 con 0x7f57a0147b90 2023-09-13T02:12:17.810 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.804+0000 7f57a4bf0640 1 -- 172.21.15.104:0/2566734117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a00ba330 con 0x7f57a0147b90 2023-09-13T02:12:17.810 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.804+0000 7f578effd640 1 -- 172.21.15.104:0/2566734117 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f579403e450 con 0x7f57a0147b90 2023-09-13T02:12:17.810 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.804+0000 7f578effd640 1 --2- 172.21.15.104:0/2566734117 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f578006a4f0 0x7f578006c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:17.810 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.805+0000 7f579e59c640 1 --2- 172.21.15.104:0/2566734117 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f578006a4f0 0x7f578006c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:17.810 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.805+0000 7f578effd640 1 -- 172.21.15.104:0/2566734117 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f57940ab240 con 0x7f57a0147b90 2023-09-13T02:12:17.811 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.805+0000 7f579e59c640 1 --2- 172.21.15.104:0/2566734117 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f578006a4f0 0x7f578006c9b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5790009a00 tx=0x7f5790005f90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:17.811 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.809+0000 7f578effd640 1 -- 172.21.15.104:0/2566734117 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5794076cc0 con 0x7f57a0147b90 2023-09-13T02:12:17.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.975+0000 7f57a4bf0640 1 -- 172.21.15.104:0/2566734117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57a00b0ec0 con 0x7f57a0147b90 2023-09-13T02:12:17.976 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.976+0000 7f578effd640 1 -- 172.21.15.104:0/2566734117 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f579407a2e0 con 0x7f57a0147b90 2023-09-13T02:12:17.976 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:17.976 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":16,"fsid":"ac1f5a95-0d3a-406e-b4ca-c8ea43282cab","created":"2023-09-13T02:11:59.067178+0000","modified":"2023-09-13T02:12:14.213277+0000","last_up_change":"2023-09-13T02:12:11.207888+0000","last_in_change":"2023-09-13T02:12:02.278796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T02:12:12.071023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67190066-4851-4b1f-aae8-bad59e79ebb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6801","nonce":3271772377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6803","nonce":3271772377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6807","nonce":3271772377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6805","nonce":3271772377}]},"public_addr":"172.21.15.104:6801/3271772377","cluster_addr":"172.21.15.104:6803/3271772377","heartbeat_back_addr":"172.21.15.104:6807/3271772377","heartbeat_front_addr":"172.21.15.104:6805/3271772377","state":["exists","up"]},{"osd":1,"uuid":"f1907075-bb97-4a19-8dd6-322232caaf4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6809","nonce":3786698894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6811","nonce":3786698894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6815","nonce":3786698894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6813","nonce":3786698894}]},"public_addr":"172.21.15.104:6809/3786698894","cluster_addr":"172.21.15.104:6811/3786698894","heartbeat_back_addr":"172.21.15.104:6815/3786698894","heartbeat_front_addr":"172.21.15.104:6813/3786698894","state":["exists","up"]},{"osd":2,"uuid":"8c323c83-330c-4181-b622-10177c81f975","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6819","nonce":2319361072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6822","nonce":2319361072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6827","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6829","nonce":2319361072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6826","nonce":2319361072}]},"public_addr":"172.21.15.104:6819/2319361072","cluster_addr":"172.21.15.104:6822/2319361072","heartbeat_back_addr":"172.21.15.104:6829/2319361072","heartbeat_front_addr":"172.21.15.104:6826/2319361072","state":["exists","up"]},{"osd":3,"uuid":"811457f5-c408-488d-a4ed-b947d1c55e82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6818","nonce":621253853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6823","nonce":621253853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6831","nonce":621253853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6825","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6828","nonce":621253853}]},"public_addr":"172.21.15.104:6818/621253853","cluster_addr":"172.21.15.104:6823/621253853","heartbeat_back_addr":"172.21.15.104:6831/621253853","heartbeat_front_addr":"172.21.15.104:6828/621253853","state":["exists","up"]},{"osd":4,"uuid":"552010ea-7d61-47c7-b4ac-657845e55e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6801","nonce":3049794634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6803","nonce":3049794634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6807","nonce":3049794634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6805","nonce":3049794634}]},"public_addr":"172.21.15.119:6801/3049794634","cluster_addr":"172.21.15.119:6803/3049794634","heartbeat_back_addr":"172.21.15.119:6807/3049794634","heartbeat_front_addr":"172.21.15.119:6805/3049794634","state":["exists","up"]},{"osd":5,"uuid":"41f415b0-6886-44ed-bccc-57c46cc975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6809","nonce":2918159428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6811","nonce":2918159428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6815","nonce":2918159428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6813","nonce":2918159428}]},"public_addr":"172.21.15.119:6809/2918159428","cluster_addr":"172.21.15.119:6811/2918159428","heartbeat_back_addr":"172.21.15.119:6815/2918159428","heartbeat_front_addr":"172.21.15.119:6813/2918159428","state":["exists","up"]},{"osd":6,"uuid":"1f415570-dbcc-4cb9-930a-ad31a96c3ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6825","nonce":3509665357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6827","nonce":3509665357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6831","nonce":3509665357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6829","nonce":3509665357}]},"public_addr":"172.21.15.119:6825/3509665357","cluster_addr":"172.21.15.119:6827/3509665357","heartbeat_back_addr":"172.21.15.119:6831/3509665357","heartbeat_front_addr":"172.21.15.119:6829/3509665357","state":["exists","up"]},{"osd":7,"uuid":"ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6817","nonce":892749725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6819","nonce":892749725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6823","nonce":892749725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6821","nonce":892749725}]},"public_addr":"172.21.15.119:6817/892749725","cluster_addr":"172.21.15.119:6819/892749725","heartbeat_back_addr":"172.21.15.119:6823/892749725","heartbeat_front_addr":"172.21.15.119:6821/892749725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.489481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.468615+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.485958+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.424425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.456308+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.427607+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T02:12:17.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.978+0000 7f57a4bf0640 1 -- 172.21.15.104:0/2566734117 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f578006a4f0 msgr2=0x7f578006c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:17.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.978+0000 7f57a4bf0640 1 --2- 172.21.15.104:0/2566734117 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f578006a4f0 0x7f578006c9b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5790009a00 tx=0x7f5790005f90 comp rx=0 tx=0).stop 2023-09-13T02:12:17.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.978+0000 7f57a4bf0640 1 -- 172.21.15.104:0/2566734117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a0147b90 msgr2=0x7f57a013fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:17.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.978+0000 7f57a4bf0640 1 --2- 172.21.15.104:0/2566734117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a0147b90 0x7f57a013fe90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5794036040 tx=0x7f579402da40 comp rx=0 tx=0).stop 2023-09-13T02:12:17.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.978+0000 7f57a4bf0640 1 -- 172.21.15.104:0/2566734117 shutdown_connections 2023-09-13T02:12:17.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.978+0000 7f57a4bf0640 1 --2- 172.21.15.104:0/2566734117 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f578006a4f0 0x7f578006c9b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:17.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.978+0000 7f57a4bf0640 1 --2- 172.21.15.104:0/2566734117 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57a01403d0 0x7f57a013ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:17.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.978+0000 7f57a4bf0640 1 --2- 172.21.15.104:0/2566734117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a0147b90 0x7f57a013fe90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:17.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.978+0000 7f57a4bf0640 1 --2- 172.21.15.104:0/2566734117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57a00b5ba0 0x7f57a01ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:17.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.978+0000 7f57a4bf0640 1 -- 172.21.15.104:0/2566734117 >> 172.21.15.104:0/2566734117 conn(0x7f57a00708b0 msgr2=0x7f57a013dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:17.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.978+0000 7f57a4bf0640 1 -- 172.21.15.104:0/2566734117 shutdown_connections 2023-09-13T02:12:17.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:17.978+0000 7f57a4bf0640 1 -- 172.21.15.104:0/2566734117 wait complete. 2023-09-13T02:12:17.988 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T02:12:12.071023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T02:12:17.989 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T02:12:18.095 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.094+0000 7f241a7b0640 1 -- 172.21.15.104:0/3607427343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24140b1b40 msgr2=0x7f241406f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:18.095 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.094+0000 7f241a7b0640 1 --2- 172.21.15.104:0/3607427343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24140b1b40 0x7f241406f7e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2408005fd0 tx=0x7f240802be10 comp rx=0 tx=0).stop 2023-09-13T02:12:18.095 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.094+0000 7f241a7b0640 1 -- 172.21.15.104:0/3607427343 shutdown_connections 2023-09-13T02:12:18.095 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.094+0000 7f241a7b0640 1 --2- 172.21.15.104:0/3607427343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24140b1b40 0x7f241406f7e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.096 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.094+0000 7f241a7b0640 1 --2- 172.21.15.104:0/3607427343 >> v2:172.21.15.119:3300/0 conn(0x7f24140b1330 0x7f2414070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.096 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.094+0000 7f241a7b0640 1 -- 172.21.15.104:0/3607427343 >> 172.21.15.104:0/3607427343 conn(0x7f2414069b30 msgr2=0x7f24140b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:18.096 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.094+0000 7f241a7b0640 1 -- 172.21.15.104:0/3607427343 shutdown_connections 2023-09-13T02:12:18.096 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.094+0000 7f241a7b0640 1 -- 172.21.15.104:0/3607427343 wait complete. 2023-09-13T02:12:18.099 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.095+0000 7f241a7b0640 1 Processor -- start 2023-09-13T02:12:18.099 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.095+0000 7f241a7b0640 1 -- start start 2023-09-13T02:12:18.099 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.096+0000 7f241a7b0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f241406fd20 0x7f24140b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:18.099 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.096+0000 7f241a7b0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24140b1330 0x7f241413f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:18.100 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.096+0000 7f241a7b0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24140b1b40 0x7f2414139a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:18.100 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.096+0000 7f241a7b0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241413e9c0 con 0x7f24140b1330 2023-09-13T02:12:18.100 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.096+0000 7f241a7b0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241413d590 con 0x7f24140b1b40 2023-09-13T02:12:18.100 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.096+0000 7f241a7b0640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241413f970 con 0x7f241406fd20 2023-09-13T02:12:18.100 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.096+0000 7f24137fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24140b1330 0x7f241413f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:18.101 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.096+0000 7f24137fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24140b1330 0x7f241413f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51866/0 (socket says 172.21.15.104:51866) 2023-09-13T02:12:18.101 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.096+0000 7f24137fe640 1 -- 172.21.15.104:0/3678644840 learned_addr learned my addr 172.21.15.104:0/3678644840 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:18.101 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.096+0000 7f2413fff640 1 --2- 172.21.15.104:0/3678644840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f241406fd20 0x7f24140b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:18.101 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.096+0000 7f2418d4d640 1 --2- 172.21.15.104:0/3678644840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24140b1b40 0x7f2414139a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:18.101 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.096+0000 7f24137fe640 1 -- 172.21.15.104:0/3678644840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f241406fd20 msgr2=0x7f24140b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:18.102 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.096+0000 7f24137fe640 1 --2- 172.21.15.104:0/3678644840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f241406fd20 0x7f24140b66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.102 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.096+0000 7f24137fe640 1 -- 172.21.15.104:0/3678644840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24140b1b40 msgr2=0x7f2414139a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:18.102 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.096+0000 7f24137fe640 1 --2- 172.21.15.104:0/3678644840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24140b1b40 0x7f2414139a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.102 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.096+0000 7f24137fe640 1 -- 172.21.15.104:0/3678644840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2408009560 con 0x7f24140b1330 2023-09-13T02:12:18.102 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.096+0000 7f2413fff640 1 --2- 172.21.15.104:0/3678644840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f241406fd20 0x7f24140b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:18.103 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.097+0000 7f24137fe640 1 --2- 172.21.15.104:0/3678644840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24140b1330 0x7f241413f430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2408006010 tx=0x7f240802dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:18.103 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.097+0000 7f2410ff9640 1 -- 172.21.15.104:0/3678644840 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24080035f0 con 0x7f24140b1330 2023-09-13T02:12:18.103 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.097+0000 7f2410ff9640 1 -- 172.21.15.104:0/3678644840 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2408003840 con 0x7f24140b1330 2023-09-13T02:12:18.103 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.097+0000 7f2410ff9640 1 -- 172.21.15.104:0/3678644840 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2408003c50 con 0x7f24140b1330 2023-09-13T02:12:18.103 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.097+0000 7f241a7b0640 1 -- 172.21.15.104:0/3678644840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241413d7e0 con 0x7f24140b1330 2023-09-13T02:12:18.104 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.097+0000 7f241a7b0640 1 -- 172.21.15.104:0/3678644840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241413cc40 con 0x7f24140b1330 2023-09-13T02:12:18.104 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.098+0000 7f241a7b0640 1 -- 172.21.15.104:0/3678644840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241404e100 con 0x7f24140b1330 2023-09-13T02:12:18.104 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.098+0000 7f2410ff9640 1 -- 172.21.15.104:0/3678644840 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f240803e450 con 0x7f24140b1330 2023-09-13T02:12:18.104 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.098+0000 7f2410ff9640 1 --2- 172.21.15.104:0/3678644840 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f240006a4f0 0x7f240006c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:18.104 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.099+0000 7f2410ff9640 1 -- 172.21.15.104:0/3678644840 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f24080ab4d0 con 0x7f24140b1330 2023-09-13T02:12:18.104 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.099+0000 7f2413fff640 1 --2- 172.21.15.104:0/3678644840 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f240006a4f0 0x7f240006c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:18.105 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.099+0000 7f2413fff640 1 --2- 172.21.15.104:0/3678644840 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f240006a4f0 0x7f240006c9b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f24140adb50 tx=0x7f2404005f90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:18.105 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.103+0000 7f2410ff9640 1 -- 172.21.15.104:0/3678644840 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f2408076e40 con 0x7f24140b1330 2023-09-13T02:12:18.269 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.269+0000 7f241a7b0640 1 -- 172.21.15.104:0/3678644840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f24140aeb70 con 0x7f24140b1330 2023-09-13T02:12:18.269 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.269+0000 7f2410ff9640 1 -- 172.21.15.104:0/3678644840 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24080430a0 con 0x7f24140b1330 2023-09-13T02:12:18.269 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2023-09-13T02:12:18.271 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.271+0000 7f241a7b0640 1 -- 172.21.15.104:0/3678644840 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f240006a4f0 msgr2=0x7f240006c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:18.271 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.271+0000 7f241a7b0640 1 --2- 172.21.15.104:0/3678644840 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f240006a4f0 0x7f240006c9b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f24140adb50 tx=0x7f2404005f90 comp rx=0 tx=0).stop 2023-09-13T02:12:18.272 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.271+0000 7f241a7b0640 1 -- 172.21.15.104:0/3678644840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24140b1330 msgr2=0x7f241413f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:18.272 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.271+0000 7f241a7b0640 1 --2- 172.21.15.104:0/3678644840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24140b1330 0x7f241413f430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2408006010 tx=0x7f240802dae0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.272 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.271+0000 7f241a7b0640 1 -- 172.21.15.104:0/3678644840 shutdown_connections 2023-09-13T02:12:18.272 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.271+0000 7f241a7b0640 1 --2- 172.21.15.104:0/3678644840 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f240006a4f0 0x7f240006c9b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.272 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.271+0000 7f241a7b0640 1 --2- 172.21.15.104:0/3678644840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24140b1b40 0x7f2414139a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.273 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.271+0000 7f241a7b0640 1 --2- 172.21.15.104:0/3678644840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24140b1330 0x7f241413f430 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.273 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.271+0000 7f241a7b0640 1 --2- 172.21.15.104:0/3678644840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f241406fd20 0x7f24140b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.273 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.271+0000 7f241a7b0640 1 -- 172.21.15.104:0/3678644840 >> 172.21.15.104:0/3678644840 conn(0x7f2414069b30 msgr2=0x7f2414140000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:18.273 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.271+0000 7f241a7b0640 1 -- 172.21.15.104:0/3678644840 shutdown_connections 2023-09-13T02:12:18.273 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.271+0000 7f241a7b0640 1 -- 172.21.15.104:0/3678644840 wait complete. 2023-09-13T02:12:18.282 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T02:12:18.384 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.383+0000 7f109f9e3640 1 -- 172.21.15.104:0/4106517342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1098145650 msgr2=0x7f1098145ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:18.384 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.383+0000 7f109f9e3640 1 --2- 172.21.15.104:0/4106517342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1098145650 0x7f1098145ad0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1088005fd0 tx=0x7f108802bcf0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.384 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.383+0000 7f109f9e3640 1 -- 172.21.15.104:0/4106517342 shutdown_connections 2023-09-13T02:12:18.385 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.383+0000 7f109f9e3640 1 --2- 172.21.15.104:0/4106517342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1098145650 0x7f1098145ad0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.385 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.383+0000 7f109f9e3640 1 --2- 172.21.15.104:0/4106517342 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f10980b00f0 0x7f10980b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.385 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.383+0000 7f109f9e3640 1 -- 172.21.15.104:0/4106517342 >> 172.21.15.104:0/4106517342 conn(0x7f10980b67f0 msgr2=0x7f10980b6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:18.385 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.384+0000 7f109f9e3640 1 -- 172.21.15.104:0/4106517342 shutdown_connections 2023-09-13T02:12:18.385 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.384+0000 7f109f9e3640 1 -- 172.21.15.104:0/4106517342 wait complete. 2023-09-13T02:12:18.388 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.384+0000 7f109f9e3640 1 Processor -- start 2023-09-13T02:12:18.388 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.385+0000 7f109f9e3640 1 -- start start 2023-09-13T02:12:18.389 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.385+0000 7f109f9e3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10980b00f0 0x7f109806fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:18.389 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.385+0000 7f109f9e3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f109813b9e0 0x7f1098130550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:18.389 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.385+0000 7f109f9e3640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1098145650 0x7f1098135740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:18.389 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.385+0000 7f109f9e3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1098070fa0 con 0x7f109813b9e0 2023-09-13T02:12:18.389 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.385+0000 7f109f9e3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1098136be0 con 0x7f10980b00f0 2023-09-13T02:12:18.390 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.385+0000 7f109f9e3640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10981d8d60 con 0x7f1098145650 2023-09-13T02:12:18.390 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.385+0000 7f109cf7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f109813b9e0 0x7f1098130550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:18.390 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.385+0000 7f109cf7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f109813b9e0 0x7f1098130550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51878/0 (socket says 172.21.15.104:51878) 2023-09-13T02:12:18.390 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.385+0000 7f109cf7e640 1 -- 172.21.15.104:0/550955998 learned_addr learned my addr 172.21.15.104:0/550955998 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:18.390 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.385+0000 7f109d77f640 1 --2- 172.21.15.104:0/550955998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10980b00f0 0x7f109806fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:18.391 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.385+0000 7f109df80640 1 --2- 172.21.15.104:0/550955998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1098145650 0x7f1098135740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:18.391 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.385+0000 7f109cf7e640 1 -- 172.21.15.104:0/550955998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1098145650 msgr2=0x7f1098135740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:18.391 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.385+0000 7f109cf7e640 1 --2- 172.21.15.104:0/550955998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1098145650 0x7f1098135740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.393 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.385+0000 7f109cf7e640 1 -- 172.21.15.104:0/550955998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10980b00f0 msgr2=0x7f109806fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:18.393 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.385+0000 7f109cf7e640 1 --2- 172.21.15.104:0/550955998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10980b00f0 0x7f109806fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.393 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.385+0000 7f109cf7e640 1 -- 172.21.15.104:0/550955998 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1088009560 con 0x7f109813b9e0 2023-09-13T02:12:18.393 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.386+0000 7f109cf7e640 1 --2- 172.21.15.104:0/550955998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f109813b9e0 0x7f1098130550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1088036040 tx=0x7f108802da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:18.393 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.386+0000 7f108dffb640 1 -- 172.21.15.104:0/550955998 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108802de90 con 0x7f109813b9e0 2023-09-13T02:12:18.394 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.386+0000 7f108dffb640 1 -- 172.21.15.104:0/550955998 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f10880036e0 con 0x7f109813b9e0 2023-09-13T02:12:18.395 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.386+0000 7f108dffb640 1 -- 172.21.15.104:0/550955998 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088003af0 con 0x7f109813b9e0 2023-09-13T02:12:18.395 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.386+0000 7f109f9e3640 1 -- 172.21.15.104:0/550955998 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1098143150 con 0x7f109813b9e0 2023-09-13T02:12:18.395 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.386+0000 7f109f9e3640 1 -- 172.21.15.104:0/550955998 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10981d8710 con 0x7f109813b9e0 2023-09-13T02:12:18.395 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.387+0000 7f109f9e3640 1 -- 172.21.15.104:0/550955998 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109804e100 con 0x7f109813b9e0 2023-09-13T02:12:18.396 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.387+0000 7f108dffb640 1 -- 172.21.15.104:0/550955998 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f1088003c50 con 0x7f109813b9e0 2023-09-13T02:12:18.396 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.388+0000 7f108dffb640 1 --2- 172.21.15.104:0/550955998 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f107c06a520 0x7f107c06c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:18.396 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.388+0000 7f108dffb640 1 -- 172.21.15.104:0/550955998 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f10880ab0a0 con 0x7f109813b9e0 2023-09-13T02:12:18.397 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.388+0000 7f109d77f640 1 --2- 172.21.15.104:0/550955998 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f107c06a520 0x7f107c06c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:18.397 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.388+0000 7f109d77f640 1 --2- 172.21.15.104:0/550955998 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f107c06a520 0x7f107c06c9e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f10981356d0 tx=0x7f109400b390 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:18.397 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.392+0000 7f108dffb640 1 -- 172.21.15.104:0/550955998 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f1088076bd0 con 0x7f109813b9e0 2023-09-13T02:12:18.591 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.591+0000 7f109f9e3640 1 -- 172.21.15.104:0/550955998 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10981d8ea0 con 0x7f109813b9e0 2023-09-13T02:12:18.591 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.591+0000 7f108dffb640 1 -- 172.21.15.104:0/550955998 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f1088043540 con 0x7f109813b9e0 2023-09-13T02:12:18.592 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:18.592 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1426622388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1426622388},{"type":"v1","addr":"172.21.15.104:6835","nonce":1426622388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-09-13T02:12:18.593 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 2 2023-09-13T02:12:18.594 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.593+0000 7f109f9e3640 1 -- 172.21.15.104:0/550955998 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f107c06a520 msgr2=0x7f107c06c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:18.594 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.593+0000 7f109f9e3640 1 --2- 172.21.15.104:0/550955998 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f107c06a520 0x7f107c06c9e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f10981356d0 tx=0x7f109400b390 comp rx=0 tx=0).stop 2023-09-13T02:12:18.594 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.593+0000 7f109f9e3640 1 -- 172.21.15.104:0/550955998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f109813b9e0 msgr2=0x7f1098130550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:18.594 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.593+0000 7f109f9e3640 1 --2- 172.21.15.104:0/550955998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f109813b9e0 0x7f1098130550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1088036040 tx=0x7f108802da90 comp rx=0 tx=0).stop 2023-09-13T02:12:18.595 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.593+0000 7f109f9e3640 1 -- 172.21.15.104:0/550955998 shutdown_connections 2023-09-13T02:12:18.595 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.593+0000 7f109f9e3640 1 --2- 172.21.15.104:0/550955998 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f107c06a520 0x7f107c06c9e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.597 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.593+0000 7f109f9e3640 1 --2- 172.21.15.104:0/550955998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1098145650 0x7f1098135740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.597 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.593+0000 7f109f9e3640 1 --2- 172.21.15.104:0/550955998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f109813b9e0 0x7f1098130550 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.597 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.593+0000 7f109f9e3640 1 --2- 172.21.15.104:0/550955998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10980b00f0 0x7f109806fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:18.597 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.593+0000 7f109f9e3640 1 -- 172.21.15.104:0/550955998 >> 172.21.15.104:0/550955998 conn(0x7f10980b67f0 msgr2=0x7f10980653e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:18.598 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.593+0000 7f109f9e3640 1 -- 172.21.15.104:0/550955998 shutdown_connections 2023-09-13T02:12:18.598 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:18.593+0000 7f109f9e3640 1 -- 172.21.15.104:0/550955998 wait complete. 2023-09-13T02:12:20.604 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T02:12:20.718 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.717+0000 7f60cdd97640 1 -- 172.21.15.104:0/1693642561 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60c80b08c0 msgr2=0x7f60c8141f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:20.718 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.717+0000 7f60cdd97640 1 --2- 172.21.15.104:0/1693642561 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60c80b08c0 0x7f60c8141f50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f60c80717f0 tx=0x7f60bc02bd30 comp rx=0 tx=0).stop 2023-09-13T02:12:20.718 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.717+0000 7f60cdd97640 1 -- 172.21.15.104:0/1693642561 shutdown_connections 2023-09-13T02:12:20.718 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.717+0000 7f60cdd97640 1 --2- 172.21.15.104:0/1693642561 >> v2:172.21.15.119:3300/0 conn(0x7f60c806d4f0 0x7f60c814c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:20.719 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.717+0000 7f60cdd97640 1 --2- 172.21.15.104:0/1693642561 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60c80b08c0 0x7f60c8141f50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:20.719 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.717+0000 7f60cdd97640 1 -- 172.21.15.104:0/1693642561 >> 172.21.15.104:0/1693642561 conn(0x7f60c8069360 msgr2=0x7f60c8069740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:20.719 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.717+0000 7f60cdd97640 1 -- 172.21.15.104:0/1693642561 shutdown_connections 2023-09-13T02:12:20.719 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.717+0000 7f60cdd97640 1 -- 172.21.15.104:0/1693642561 wait complete. 2023-09-13T02:12:20.722 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.718+0000 7f60cdd97640 1 Processor -- start 2023-09-13T02:12:20.722 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.719+0000 7f60cdd97640 1 -- start start 2023-09-13T02:12:20.722 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.719+0000 7f60cdd97640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60c806d4f0 0x7f60c813a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:20.723 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.719+0000 7f60cdd97640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60c80b1810 0x7f60c81d84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:20.723 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.719+0000 7f60cdd97640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60c8139700 0x7f60c81d89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:20.723 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.719+0000 7f60cdd97640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c81d8050 con 0x7f60c80b1810 2023-09-13T02:12:20.723 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.719+0000 7f60cdd97640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c813b200 con 0x7f60c8139700 2023-09-13T02:12:20.723 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.719+0000 7f60cdd97640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8143b20 con 0x7f60c806d4f0 2023-09-13T02:12:20.724 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.719+0000 7f60c6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60c80b1810 0x7f60c81d84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:20.724 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.719+0000 7f60c6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60c80b1810 0x7f60c81d84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51900/0 (socket says 172.21.15.104:51900) 2023-09-13T02:12:20.724 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.719+0000 7f60c6ffd640 1 -- 172.21.15.104:0/2645744738 learned_addr learned my addr 172.21.15.104:0/2645744738 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:20.724 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.719+0000 7f60c77fe640 1 --2- 172.21.15.104:0/2645744738 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60c806d4f0 0x7f60c813a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:20.725 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.719+0000 7f60c7fff640 1 --2- 172.21.15.104:0/2645744738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60c8139700 0x7f60c81d89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:20.725 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.720+0000 7f60c6ffd640 1 -- 172.21.15.104:0/2645744738 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60c806d4f0 msgr2=0x7f60c813a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:20.725 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.720+0000 7f60c6ffd640 1 --2- 172.21.15.104:0/2645744738 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60c806d4f0 0x7f60c813a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:20.725 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.720+0000 7f60c6ffd640 1 -- 172.21.15.104:0/2645744738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60c8139700 msgr2=0x7f60c81d89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:20.726 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.720+0000 7f60c6ffd640 1 --2- 172.21.15.104:0/2645744738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60c8139700 0x7f60c81d89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:20.726 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.720+0000 7f60c6ffd640 1 -- 172.21.15.104:0/2645744738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc009560 con 0x7f60c80b1810 2023-09-13T02:12:20.726 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.720+0000 7f60c6ffd640 1 --2- 172.21.15.104:0/2645744738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60c80b1810 0x7f60c81d84a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f60bc000c00 tx=0x7f60bc02dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:20.726 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.720+0000 7f60affff640 1 -- 172.21.15.104:0/2645744738 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc003800 con 0x7f60c80b1810 2023-09-13T02:12:20.726 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.720+0000 7f60affff640 1 -- 172.21.15.104:0/2645744738 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f60bc003a50 con 0x7f60c80b1810 2023-09-13T02:12:20.727 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.720+0000 7f60cdd97640 1 -- 172.21.15.104:0/2645744738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c814c650 con 0x7f60c80b1810 2023-09-13T02:12:20.727 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.720+0000 7f60affff640 1 -- 172.21.15.104:0/2645744738 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc003e60 con 0x7f60c80b1810 2023-09-13T02:12:20.727 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.720+0000 7f60cdd97640 1 -- 172.21.15.104:0/2645744738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c81430b0 con 0x7f60c80b1810 2023-09-13T02:12:20.727 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.721+0000 7f60cdd97640 1 -- 172.21.15.104:0/2645744738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c813b050 con 0x7f60c80b1810 2023-09-13T02:12:20.727 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.721+0000 7f60affff640 1 -- 172.21.15.104:0/2645744738 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f60bc03e450 con 0x7f60c80b1810 2023-09-13T02:12:20.727 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.722+0000 7f60affff640 1 --2- 172.21.15.104:0/2645744738 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f60b406a4f0 0x7f60b406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:20.728 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.722+0000 7f60affff640 1 -- 172.21.15.104:0/2645744738 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f60bc0ab110 con 0x7f60c80b1810 2023-09-13T02:12:20.728 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.722+0000 7f60c77fe640 1 --2- 172.21.15.104:0/2645744738 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f60b406a4f0 0x7f60b406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:20.728 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.722+0000 7f60c77fe640 1 --2- 172.21.15.104:0/2645744738 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f60b406a4f0 0x7f60b406c9b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f60b8001780 tx=0x7f60b8009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:20.728 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.726+0000 7f60affff640 1 -- 172.21.15.104:0/2645744738 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f60bc076c40 con 0x7f60c80b1810 2023-09-13T02:12:20.928 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.928+0000 7f60cdd97640 1 -- 172.21.15.104:0/2645744738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60c8143360 con 0x7f60c80b1810 2023-09-13T02:12:20.929 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.929+0000 7f60affff640 1 -- 172.21.15.104:0/2645744738 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2117 (secure 0 0 0) 0x7f60bc07a260 con 0x7f60c80b1810 2023-09-13T02:12:20.929 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:20.930 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/811188307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":811188307},{"type":"v1","addr":"172.21.15.119:6833","nonce":811188307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1426622388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1426622388},{"type":"v1","addr":"172.21.15.104:6835","nonce":1426622388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-09-13T02:12:20.930 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 3 2023-09-13T02:12:20.931 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.931+0000 7f60cdd97640 1 -- 172.21.15.104:0/2645744738 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f60b406a4f0 msgr2=0x7f60b406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:20.931 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.931+0000 7f60cdd97640 1 --2- 172.21.15.104:0/2645744738 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f60b406a4f0 0x7f60b406c9b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f60b8001780 tx=0x7f60b8009040 comp rx=0 tx=0).stop 2023-09-13T02:12:20.931 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.931+0000 7f60cdd97640 1 -- 172.21.15.104:0/2645744738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60c80b1810 msgr2=0x7f60c81d84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:20.932 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.931+0000 7f60cdd97640 1 --2- 172.21.15.104:0/2645744738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60c80b1810 0x7f60c81d84a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f60bc000c00 tx=0x7f60bc02dad0 comp rx=0 tx=0).stop 2023-09-13T02:12:20.932 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.931+0000 7f60cdd97640 1 -- 172.21.15.104:0/2645744738 shutdown_connections 2023-09-13T02:12:20.932 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.931+0000 7f60cdd97640 1 --2- 172.21.15.104:0/2645744738 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f60b406a4f0 0x7f60b406c9b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:20.932 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.931+0000 7f60cdd97640 1 --2- 172.21.15.104:0/2645744738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60c8139700 0x7f60c81d89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:20.932 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.931+0000 7f60cdd97640 1 --2- 172.21.15.104:0/2645744738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60c80b1810 0x7f60c81d84a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:20.933 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.931+0000 7f60cdd97640 1 --2- 172.21.15.104:0/2645744738 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60c806d4f0 0x7f60c813a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:20.933 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.931+0000 7f60cdd97640 1 -- 172.21.15.104:0/2645744738 >> 172.21.15.104:0/2645744738 conn(0x7f60c8069360 msgr2=0x7f60c81407f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:20.933 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.931+0000 7f60cdd97640 1 -- 172.21.15.104:0/2645744738 shutdown_connections 2023-09-13T02:12:20.933 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:20.931+0000 7f60cdd97640 1 -- 172.21.15.104:0/2645744738 wait complete. 2023-09-13T02:12:20.941 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T02:12:21.043 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.043+0000 7f644b04f640 1 -- 172.21.15.104:0/2274510229 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64340047c0 msgr2=0x7f6434004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.043 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.043+0000 7f644b04f640 1 --2- 172.21.15.104:0/2274510229 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64340047c0 0x7f6434004c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6430001eb0 tx=0x7f64340057f0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.044 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.043+0000 7f644b04f640 1 -- 172.21.15.104:0/2274510229 shutdown_connections 2023-09-13T02:12:21.044 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.043+0000 7f644b04f640 1 --2- 172.21.15.104:0/2274510229 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64340047c0 0x7f6434004c40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.044 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.043+0000 7f644b04f640 1 -- 172.21.15.104:0/2274510229 >> 172.21.15.104:0/2274510229 conn(0x7f64440b56f0 msgr2=0x7f64440b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:21.044 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.043+0000 7f644b04f640 1 -- 172.21.15.104:0/2274510229 shutdown_connections 2023-09-13T02:12:21.044 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.043+0000 7f644b04f640 1 -- 172.21.15.104:0/2274510229 wait complete. 2023-09-13T02:12:21.047 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.044+0000 7f644b04f640 1 Processor -- start 2023-09-13T02:12:21.047 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.044+0000 7f644b04f640 1 -- start start 2023-09-13T02:12:21.048 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f644b04f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64340047c0 0x7f64441cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:21.048 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f644b04f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64441d7e40 0x7f644413ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:21.048 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f644b04f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64441d82c0 0x7f644413f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:21.048 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f644b04f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64441cd240 con 0x7f64441d82c0 2023-09-13T02:12:21.048 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f644b04f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64441cd520 con 0x7f64340047c0 2023-09-13T02:12:21.049 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f644b04f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64441cd800 con 0x7f64441d7e40 2023-09-13T02:12:21.049 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f64495ec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64441d82c0 0x7f644413f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:21.049 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f64495ec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64441d82c0 0x7f644413f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51922/0 (socket says 172.21.15.104:51922) 2023-09-13T02:12:21.049 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f64495ec640 1 -- 172.21.15.104:0/327765796 learned_addr learned my addr 172.21.15.104:0/327765796 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:21.050 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f6443fff640 1 --2- 172.21.15.104:0/327765796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64441d7e40 0x7f644413ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:21.050 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f6448deb640 1 --2- 172.21.15.104:0/327765796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64340047c0 0x7f64441cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:21.050 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f64495ec640 1 -- 172.21.15.104:0/327765796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64441d7e40 msgr2=0x7f644413ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.050 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f64495ec640 1 --2- 172.21.15.104:0/327765796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64441d7e40 0x7f644413ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.050 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f64495ec640 1 -- 172.21.15.104:0/327765796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64340047c0 msgr2=0x7f64441cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.051 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f64495ec640 1 --2- 172.21.15.104:0/327765796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64340047c0 0x7f64441cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.051 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f64495ec640 1 -- 172.21.15.104:0/327765796 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64441cdae0 con 0x7f64441d82c0 2023-09-13T02:12:21.051 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f6443fff640 1 --2- 172.21.15.104:0/327765796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64441d7e40 0x7f644413ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:21.051 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f64495ec640 1 --2- 172.21.15.104:0/327765796 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64441d82c0 0x7f644413f2d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f64440aca00 tx=0x7f643c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:21.051 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f64417fa640 1 -- 172.21.15.104:0/327765796 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c003b70 con 0x7f64441d82c0 2023-09-13T02:12:21.052 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f64417fa640 1 -- 172.21.15.104:0/327765796 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f643c003cd0 con 0x7f64441d82c0 2023-09-13T02:12:21.052 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f644b04f640 1 -- 172.21.15.104:0/327765796 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644413d630 con 0x7f64441d82c0 2023-09-13T02:12:21.052 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f64417fa640 1 -- 172.21.15.104:0/327765796 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c004290 con 0x7f64441d82c0 2023-09-13T02:12:21.052 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.045+0000 7f644b04f640 1 -- 172.21.15.104:0/327765796 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64441cc7c0 con 0x7f64441d82c0 2023-09-13T02:12:21.052 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.046+0000 7f644b04f640 1 -- 172.21.15.104:0/327765796 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6444139720 con 0x7f64441d82c0 2023-09-13T02:12:21.053 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.047+0000 7f64417fa640 1 -- 172.21.15.104:0/327765796 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f643c019030 con 0x7f64441d82c0 2023-09-13T02:12:21.053 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.047+0000 7f64417fa640 1 --2- 172.21.15.104:0/327765796 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f642806a520 0x7f642806c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:21.053 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.047+0000 7f64417fa640 1 -- 172.21.15.104:0/327765796 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f643c017070 con 0x7f64441d82c0 2023-09-13T02:12:21.053 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.047+0000 7f6448deb640 1 --2- 172.21.15.104:0/327765796 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f642806a520 0x7f642806c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:21.053 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.047+0000 7f6448deb640 1 --2- 172.21.15.104:0/327765796 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f642806a520 0x7f642806c9e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6438000c00 tx=0x7f6438006b30 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:21.054 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.051+0000 7f64417fa640 1 -- 172.21.15.104:0/327765796 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f643c0587e0 con 0x7f64441d82c0 2023-09-13T02:12:21.220 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.220+0000 7f644b04f640 1 -- 172.21.15.104:0/327765796 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64441cd380 con 0x7f64441d82c0 2023-09-13T02:12:21.220 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.221+0000 7f64417fa640 1 -- 172.21.15.104:0/327765796 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f64441cd380 con 0x7f64441d82c0 2023-09-13T02:12:21.221 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:21.221 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":16,"fsid":"ac1f5a95-0d3a-406e-b4ca-c8ea43282cab","created":"2023-09-13T02:11:59.067178+0000","modified":"2023-09-13T02:12:14.213277+0000","last_up_change":"2023-09-13T02:12:11.207888+0000","last_in_change":"2023-09-13T02:12:02.278796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T02:12:12.071023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67190066-4851-4b1f-aae8-bad59e79ebb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6801","nonce":3271772377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6803","nonce":3271772377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6807","nonce":3271772377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6805","nonce":3271772377}]},"public_addr":"172.21.15.104:6801/3271772377","cluster_addr":"172.21.15.104:6803/3271772377","heartbeat_back_addr":"172.21.15.104:6807/3271772377","heartbeat_front_addr":"172.21.15.104:6805/3271772377","state":["exists","up"]},{"osd":1,"uuid":"f1907075-bb97-4a19-8dd6-322232caaf4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6809","nonce":3786698894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6811","nonce":3786698894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6815","nonce":3786698894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6813","nonce":3786698894}]},"public_addr":"172.21.15.104:6809/3786698894","cluster_addr":"172.21.15.104:6811/3786698894","heartbeat_back_addr":"172.21.15.104:6815/3786698894","heartbeat_front_addr":"172.21.15.104:6813/3786698894","state":["exists","up"]},{"osd":2,"uuid":"8c323c83-330c-4181-b622-10177c81f975","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6819","nonce":2319361072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6822","nonce":2319361072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6827","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6829","nonce":2319361072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6826","nonce":2319361072}]},"public_addr":"172.21.15.104:6819/2319361072","cluster_addr":"172.21.15.104:6822/2319361072","heartbeat_back_addr":"172.21.15.104:6829/2319361072","heartbeat_front_addr":"172.21.15.104:6826/2319361072","state":["exists","up"]},{"osd":3,"uuid":"811457f5-c408-488d-a4ed-b947d1c55e82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6818","nonce":621253853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6823","nonce":621253853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6831","nonce":621253853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6825","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6828","nonce":621253853}]},"public_addr":"172.21.15.104:6818/621253853","cluster_addr":"172.21.15.104:6823/621253853","heartbeat_back_addr":"172.21.15.104:6831/621253853","heartbeat_front_addr":"172.21.15.104:6828/621253853","state":["exists","up"]},{"osd":4,"uuid":"552010ea-7d61-47c7-b4ac-657845e55e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6801","nonce":3049794634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6803","nonce":3049794634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6807","nonce":3049794634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6805","nonce":3049794634}]},"public_addr":"172.21.15.119:6801/3049794634","cluster_addr":"172.21.15.119:6803/3049794634","heartbeat_back_addr":"172.21.15.119:6807/3049794634","heartbeat_front_addr":"172.21.15.119:6805/3049794634","state":["exists","up"]},{"osd":5,"uuid":"41f415b0-6886-44ed-bccc-57c46cc975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6809","nonce":2918159428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6811","nonce":2918159428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6815","nonce":2918159428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6813","nonce":2918159428}]},"public_addr":"172.21.15.119:6809/2918159428","cluster_addr":"172.21.15.119:6811/2918159428","heartbeat_back_addr":"172.21.15.119:6815/2918159428","heartbeat_front_addr":"172.21.15.119:6813/2918159428","state":["exists","up"]},{"osd":6,"uuid":"1f415570-dbcc-4cb9-930a-ad31a96c3ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6825","nonce":3509665357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6827","nonce":3509665357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6831","nonce":3509665357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6829","nonce":3509665357}]},"public_addr":"172.21.15.119:6825/3509665357","cluster_addr":"172.21.15.119:6827/3509665357","heartbeat_back_addr":"172.21.15.119:6831/3509665357","heartbeat_front_addr":"172.21.15.119:6829/3509665357","state":["exists","up"]},{"osd":7,"uuid":"ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6817","nonce":892749725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6819","nonce":892749725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6823","nonce":892749725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6821","nonce":892749725}]},"public_addr":"172.21.15.119:6817/892749725","cluster_addr":"172.21.15.119:6819/892749725","heartbeat_back_addr":"172.21.15.119:6823/892749725","heartbeat_front_addr":"172.21.15.119:6821/892749725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.489481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.468615+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.485958+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.424425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.456308+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.427607+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T02:12:21.223 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.223+0000 7f644b04f640 1 -- 172.21.15.104:0/327765796 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f642806a520 msgr2=0x7f642806c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.223 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.223+0000 7f644b04f640 1 --2- 172.21.15.104:0/327765796 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f642806a520 0x7f642806c9e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6438000c00 tx=0x7f6438006b30 comp rx=0 tx=0).stop 2023-09-13T02:12:21.223 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.223+0000 7f644b04f640 1 -- 172.21.15.104:0/327765796 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64441d82c0 msgr2=0x7f644413f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.224 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.223+0000 7f644b04f640 1 --2- 172.21.15.104:0/327765796 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64441d82c0 0x7f644413f2d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f64440aca00 tx=0x7f643c00e720 comp rx=0 tx=0).stop 2023-09-13T02:12:21.224 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.223+0000 7f644b04f640 1 -- 172.21.15.104:0/327765796 shutdown_connections 2023-09-13T02:12:21.224 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.223+0000 7f644b04f640 1 --2- 172.21.15.104:0/327765796 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f642806a520 0x7f642806c9e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.224 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.223+0000 7f644b04f640 1 --2- 172.21.15.104:0/327765796 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64441d82c0 0x7f644413f2d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.224 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.223+0000 7f644b04f640 1 --2- 172.21.15.104:0/327765796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64441d7e40 0x7f644413ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.225 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.223+0000 7f644b04f640 1 --2- 172.21.15.104:0/327765796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64340047c0 0x7f64441cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.225 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.223+0000 7f644b04f640 1 -- 172.21.15.104:0/327765796 >> 172.21.15.104:0/327765796 conn(0x7f64440b56f0 msgr2=0x7f6444138910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:21.225 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.223+0000 7f644b04f640 1 -- 172.21.15.104:0/327765796 shutdown_connections 2023-09-13T02:12:21.225 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.223+0000 7f644b04f640 1 -- 172.21.15.104:0/327765796 wait complete. 2023-09-13T02:12:21.233 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T02:12:12.071023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T02:12:21.234 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T02:12:21.339 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.339+0000 7f6fb96d7640 1 -- 172.21.15.104:0/597879983 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f9c0051d0 msgr2=0x7f6f9c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.340 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.339+0000 7f6fb96d7640 1 --2- 172.21.15.104:0/597879983 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f9c0051d0 0x7f6f9c00b980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40aeb30 tx=0x7f6f9c0057f0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.340 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.339+0000 7f6fb37fe640 1 -- 172.21.15.104:0/597879983 reap_dead start 2023-09-13T02:12:21.340 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.339+0000 7f6fb96d7640 1 -- 172.21.15.104:0/597879983 shutdown_connections 2023-09-13T02:12:21.340 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.339+0000 7f6fb96d7640 1 -- 172.21.15.104:0/597879983 >> 172.21.15.104:0/597879983 conn(0x7f6fb40b67f0 msgr2=0x7f6fb40b6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:21.340 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.339+0000 7f6fb96d7640 1 -- 172.21.15.104:0/597879983 shutdown_connections 2023-09-13T02:12:21.341 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.339+0000 7f6fb96d7640 1 -- 172.21.15.104:0/597879983 wait complete. 2023-09-13T02:12:21.343 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.340+0000 7f6fb96d7640 1 Processor -- start 2023-09-13T02:12:21.343 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.340+0000 7f6fb96d7640 1 -- start start 2023-09-13T02:12:21.343 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb96d7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fb4149c00 0x7f6fb4143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:21.344 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb96d7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fb41dd4e0 0x7f6fb41424c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:21.344 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb96d7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fb4138be0 0x7f6fb4139090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:21.344 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb96d7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb4149fe0 con 0x7f6fb4149c00 2023-09-13T02:12:21.344 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb96d7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb413d350 con 0x7f6fb4138be0 2023-09-13T02:12:21.344 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb96d7640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb413d630 con 0x7f6fb41dd4e0 2023-09-13T02:12:21.345 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fb4149c00 0x7f6fb4143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:21.345 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fb4149c00 0x7f6fb4143f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51942/0 (socket says 172.21.15.104:51942) 2023-09-13T02:12:21.345 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb2ffd640 1 -- 172.21.15.104:0/2259237767 learned_addr learned my addr 172.21.15.104:0/2259237767 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:21.345 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb27fc640 1 --2- 172.21.15.104:0/2259237767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fb41dd4e0 0x7f6fb41424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:21.345 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb2ffd640 1 -- 172.21.15.104:0/2259237767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fb41dd4e0 msgr2=0x7f6fb41424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.346 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb2ffd640 1 --2- 172.21.15.104:0/2259237767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fb41dd4e0 0x7f6fb41424c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.346 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb2ffd640 1 -- 172.21.15.104:0/2259237767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fb4138be0 msgr2=0x7f6fb4139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.346 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb37fe640 1 --2- 172.21.15.104:0/2259237767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fb4138be0 0x7f6fb4139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:21.346 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb2ffd640 1 --2- 172.21.15.104:0/2259237767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fb4138be0 0x7f6fb4139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.346 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb2ffd640 1 -- 172.21.15.104:0/2259237767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb4142a00 con 0x7f6fb4149c00 2023-09-13T02:12:21.347 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb27fc640 1 --2- 172.21.15.104:0/2259237767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fb41dd4e0 0x7f6fb41424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:12:21.347 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb2ffd640 1 --2- 172.21.15.104:0/2259237767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fb4149c00 0x7f6fb4143f50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4003fd0 tx=0x7f6fa4006790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:21.347 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6f9b7fe640 1 -- 172.21.15.104:0/2259237767 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa400fce0 con 0x7f6fb4149c00 2023-09-13T02:12:21.347 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6f9b7fe640 1 -- 172.21.15.104:0/2259237767 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6fa400fe40 con 0x7f6fb4149c00 2023-09-13T02:12:21.347 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb96d7640 1 -- 172.21.15.104:0/2259237767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb413e390 con 0x7f6fb4149c00 2023-09-13T02:12:21.348 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6f9b7fe640 1 -- 172.21.15.104:0/2259237767 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4011690 con 0x7f6fb4149c00 2023-09-13T02:12:21.348 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.341+0000 7f6fb96d7640 1 -- 172.21.15.104:0/2259237767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb413b410 con 0x7f6fb4149c00 2023-09-13T02:12:21.348 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.342+0000 7f6fb96d7640 1 -- 172.21.15.104:0/2259237767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb404e100 con 0x7f6fb4149c00 2023-09-13T02:12:21.348 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.343+0000 7f6f9b7fe640 1 -- 172.21.15.104:0/2259237767 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6fa40117f0 con 0x7f6fb4149c00 2023-09-13T02:12:21.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.343+0000 7f6f9b7fe640 1 --2- 172.21.15.104:0/2259237767 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f6fa006a520 0x7f6fa006c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:21.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.343+0000 7f6fb27fc640 1 --2- 172.21.15.104:0/2259237767 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f6fa006a520 0x7f6fa006c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:21.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.343+0000 7f6f9b7fe640 1 -- 172.21.15.104:0/2259237767 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6fa4089430 con 0x7f6fb4149c00 2023-09-13T02:12:21.350 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.344+0000 7f6fb27fc640 1 --2- 172.21.15.104:0/2259237767 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f6fa006a520 0x7f6fa006c9e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8006950 tx=0x7f6fa8006b20 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:21.350 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.347+0000 7f6f9b7fe640 1 -- 172.21.15.104:0/2259237767 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6fa4054d90 con 0x7f6fb4149c00 2023-09-13T02:12:21.511 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.511+0000 7f6fb96d7640 1 -- 172.21.15.104:0/2259237767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6fb413b410 con 0x7f6fb4149c00 2023-09-13T02:12:21.512 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.512+0000 7f6f9b7fe640 1 -- 172.21.15.104:0/2259237767 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6fb413b410 con 0x7f6fb4149c00 2023-09-13T02:12:21.512 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2023-09-13T02:12:21.514 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.513+0000 7f6fb96d7640 1 -- 172.21.15.104:0/2259237767 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f6fa006a520 msgr2=0x7f6fa006c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.514 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.513+0000 7f6fb96d7640 1 --2- 172.21.15.104:0/2259237767 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f6fa006a520 0x7f6fa006c9e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8006950 tx=0x7f6fa8006b20 comp rx=0 tx=0).stop 2023-09-13T02:12:21.514 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.513+0000 7f6fb96d7640 1 -- 172.21.15.104:0/2259237767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fb4149c00 msgr2=0x7f6fb4143f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.514 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.513+0000 7f6fb96d7640 1 --2- 172.21.15.104:0/2259237767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fb4149c00 0x7f6fb4143f50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4003fd0 tx=0x7f6fa4006790 comp rx=0 tx=0).stop 2023-09-13T02:12:21.514 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.513+0000 7f6fb96d7640 1 -- 172.21.15.104:0/2259237767 shutdown_connections 2023-09-13T02:12:21.515 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.514+0000 7f6fb96d7640 1 --2- 172.21.15.104:0/2259237767 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f6fa006a520 0x7f6fa006c9e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.515 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.514+0000 7f6fb96d7640 1 --2- 172.21.15.104:0/2259237767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fb4138be0 0x7f6fb4139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.515 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.514+0000 7f6fb96d7640 1 --2- 172.21.15.104:0/2259237767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fb41dd4e0 0x7f6fb41424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.515 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.514+0000 7f6fb96d7640 1 --2- 172.21.15.104:0/2259237767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fb4149c00 0x7f6fb4143f50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.515 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.514+0000 7f6fb96d7640 1 -- 172.21.15.104:0/2259237767 >> 172.21.15.104:0/2259237767 conn(0x7f6fb40b67f0 msgr2=0x7f6fb40b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:21.516 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.514+0000 7f6fb96d7640 1 -- 172.21.15.104:0/2259237767 shutdown_connections 2023-09-13T02:12:21.516 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.514+0000 7f6fb96d7640 1 -- 172.21.15.104:0/2259237767 wait complete. 2023-09-13T02:12:21.524 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-13T02:12:21.625 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.625+0000 7f75e1f33640 1 -- 172.21.15.104:0/79736241 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75dc0b02e0 msgr2=0x7f75dc1443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.626 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.625+0000 7f75e1f33640 1 --2- 172.21.15.104:0/79736241 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75dc0b02e0 0x7f75dc1443b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009900 tx=0x7f75cc02bce0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.626 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.625+0000 7f75e1f33640 1 -- 172.21.15.104:0/79736241 shutdown_connections 2023-09-13T02:12:21.626 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.625+0000 7f75e1f33640 1 --2- 172.21.15.104:0/79736241 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75dc13ab80 0x7f75dc13afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.627 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.625+0000 7f75e1f33640 1 --2- 172.21.15.104:0/79736241 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75dc0b02e0 0x7f75dc1443b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.627 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.625+0000 7f75e1f33640 1 -- 172.21.15.104:0/79736241 >> 172.21.15.104:0/79736241 conn(0x7f75dc0b56f0 msgr2=0x7f75dc0b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:21.627 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.625+0000 7f75e1f33640 1 -- 172.21.15.104:0/79736241 shutdown_connections 2023-09-13T02:12:21.627 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.625+0000 7f75e1f33640 1 -- 172.21.15.104:0/79736241 wait complete. 2023-09-13T02:12:21.630 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.626+0000 7f75e1f33640 1 Processor -- start 2023-09-13T02:12:21.630 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.626+0000 7f75e1f33640 1 -- start start 2023-09-13T02:12:21.630 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.627+0000 7f75e1f33640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75dc0b02e0 0x7f75dc070790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:21.630 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.627+0000 7f75e1f33640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75dc13ab80 0x7f75dc1d83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:21.630 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.627+0000 7f75e1f33640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75dc140dc0 0x7f75dc1d8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:21.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.627+0000 7f75e1f33640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc0718b0 con 0x7f75dc0b02e0 2023-09-13T02:12:21.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.627+0000 7f75e1f33640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc06e640 con 0x7f75dc140dc0 2023-09-13T02:12:21.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.627+0000 7f75e1f33640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc06e8e0 con 0x7f75dc13ab80 2023-09-13T02:12:21.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.627+0000 7f75db7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75dc0b02e0 0x7f75dc070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:21.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.627+0000 7f75db7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75dc0b02e0 0x7f75dc070790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51964/0 (socket says 172.21.15.104:51964) 2023-09-13T02:12:21.632 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.627+0000 7f75db7fe640 1 -- 172.21.15.104:0/2681254952 learned_addr learned my addr 172.21.15.104:0/2681254952 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:21.632 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.627+0000 7f75daffd640 1 --2- 172.21.15.104:0/2681254952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75dc13ab80 0x7f75dc1d83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:21.632 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.627+0000 7f75dbfff640 1 --2- 172.21.15.104:0/2681254952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75dc140dc0 0x7f75dc1d8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:21.632 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.627+0000 7f75db7fe640 1 -- 172.21.15.104:0/2681254952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75dc13ab80 msgr2=0x7f75dc1d83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.632 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.627+0000 7f75db7fe640 1 --2- 172.21.15.104:0/2681254952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75dc13ab80 0x7f75dc1d83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.633 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.627+0000 7f75db7fe640 1 -- 172.21.15.104:0/2681254952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75dc140dc0 msgr2=0x7f75dc1d8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.633 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.627+0000 7f75db7fe640 1 --2- 172.21.15.104:0/2681254952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75dc140dc0 0x7f75dc1d8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.633 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.627+0000 7f75db7fe640 1 -- 172.21.15.104:0/2681254952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc009560 con 0x7f75dc0b02e0 2023-09-13T02:12:21.633 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.628+0000 7f75db7fe640 1 --2- 172.21.15.104:0/2681254952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75dc0b02e0 0x7f75dc070790 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009850 tx=0x7f75cc02dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:21.633 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.628+0000 7f75c3fff640 1 -- 172.21.15.104:0/2681254952 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc02dea0 con 0x7f75dc0b02e0 2023-09-13T02:12:21.634 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.628+0000 7f75c3fff640 1 -- 172.21.15.104:0/2681254952 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f75cc003800 con 0x7f75dc0b02e0 2023-09-13T02:12:21.634 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.628+0000 7f75e1f33640 1 -- 172.21.15.104:0/2681254952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75dc145910 con 0x7f75dc0b02e0 2023-09-13T02:12:21.634 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.628+0000 7f75c3fff640 1 -- 172.21.15.104:0/2681254952 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc003bf0 con 0x7f75dc0b02e0 2023-09-13T02:12:21.634 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.628+0000 7f75e1f33640 1 -- 172.21.15.104:0/2681254952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75dc145630 con 0x7f75dc0b02e0 2023-09-13T02:12:21.634 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.629+0000 7f75e1f33640 1 -- 172.21.15.104:0/2681254952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75dc06f730 con 0x7f75dc0b02e0 2023-09-13T02:12:21.635 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.629+0000 7f75c3fff640 1 -- 172.21.15.104:0/2681254952 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f75cc003d50 con 0x7f75dc0b02e0 2023-09-13T02:12:21.635 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.629+0000 7f75c3fff640 1 --2- 172.21.15.104:0/2681254952 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f75c806a4f0 0x7f75c806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:21.635 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.630+0000 7f75daffd640 1 --2- 172.21.15.104:0/2681254952 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f75c806a4f0 0x7f75c806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:21.635 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.630+0000 7f75c3fff640 1 -- 172.21.15.104:0/2681254952 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f75cc0aaf20 con 0x7f75dc0b02e0 2023-09-13T02:12:21.635 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.630+0000 7f75daffd640 1 --2- 172.21.15.104:0/2681254952 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f75c806a4f0 0x7f75c806c9b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f75dc145560 tx=0x7f75d0008040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:21.636 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.634+0000 7f75c3fff640 1 -- 172.21.15.104:0/2681254952 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f75dc06f730 con 0x7f75dc0b02e0 2023-09-13T02:12:21.800 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.800+0000 7f75e1f33640 1 -- 172.21.15.104:0/2681254952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f75dc06f730 con 0x7f75dc0b02e0 2023-09-13T02:12:21.801 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.800+0000 7f75c3fff640 1 -- 172.21.15.104:0/2681254952 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f75dc06f730 con 0x7f75dc0b02e0 2023-09-13T02:12:21.801 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:21.801 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2023-09-13T02:12:21.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2023-09-13T02:12:21.802 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2023-09-13T02:12:21.802 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2023-09-13T02:12:21.802 INFO:teuthology.orchestra.run.smithi104.stdout: } 2023-09-13T02:12:21.802 INFO:teuthology.orchestra.run.smithi104.stdout:] 2023-09-13T02:12:21.803 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.802+0000 7f75e1f33640 1 -- 172.21.15.104:0/2681254952 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f75c806a4f0 msgr2=0x7f75c806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.803 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.802+0000 7f75e1f33640 1 --2- 172.21.15.104:0/2681254952 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f75c806a4f0 0x7f75c806c9b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f75dc145560 tx=0x7f75d0008040 comp rx=0 tx=0).stop 2023-09-13T02:12:21.804 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.802+0000 7f75e1f33640 1 -- 172.21.15.104:0/2681254952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75dc0b02e0 msgr2=0x7f75dc070790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.804 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.802+0000 7f75e1f33640 1 --2- 172.21.15.104:0/2681254952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75dc0b02e0 0x7f75dc070790 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009850 tx=0x7f75cc02dcb0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.804 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.802+0000 7f75e1f33640 1 -- 172.21.15.104:0/2681254952 shutdown_connections 2023-09-13T02:12:21.804 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.802+0000 7f75e1f33640 1 --2- 172.21.15.104:0/2681254952 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f75c806a4f0 0x7f75c806c9b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.805 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.802+0000 7f75e1f33640 1 --2- 172.21.15.104:0/2681254952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75dc140dc0 0x7f75dc1d8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.805 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.802+0000 7f75e1f33640 1 --2- 172.21.15.104:0/2681254952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75dc13ab80 0x7f75dc1d83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.805 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.802+0000 7f75e1f33640 1 --2- 172.21.15.104:0/2681254952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75dc0b02e0 0x7f75dc070790 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.805 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.802+0000 7f75e1f33640 1 -- 172.21.15.104:0/2681254952 >> 172.21.15.104:0/2681254952 conn(0x7f75dc0b56f0 msgr2=0x7f75dc139fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:21.805 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.802+0000 7f75e1f33640 1 -- 172.21.15.104:0/2681254952 shutdown_connections 2023-09-13T02:12:21.806 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.802+0000 7f75e1f33640 1 -- 172.21.15.104:0/2681254952 wait complete. 2023-09-13T02:12:21.813 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-13T02:12:21.813 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-13T02:12:21.919 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.918+0000 7f20b54f2640 1 -- 172.21.15.104:0/3536192501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2098005180 msgr2=0x7f209800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.919 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.918+0000 7f20b54f2640 1 --2- 172.21.15.104:0/3536192501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2098005180 0x7f209800b980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f20a8006fa0 tx=0x7f20980057f0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.919 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.918+0000 7f20b54f2640 1 -- 172.21.15.104:0/3536192501 shutdown_connections 2023-09-13T02:12:21.920 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.918+0000 7f20b54f2640 1 --2- 172.21.15.104:0/3536192501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2098005180 0x7f209800b980 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.920 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.918+0000 7f20b54f2640 1 -- 172.21.15.104:0/3536192501 >> 172.21.15.104:0/3536192501 conn(0x7f20b00708b0 msgr2=0x7f20b0070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:21.920 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.918+0000 7f20b54f2640 1 -- 172.21.15.104:0/3536192501 shutdown_connections 2023-09-13T02:12:21.920 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.919+0000 7f20b54f2640 1 -- 172.21.15.104:0/3536192501 wait complete. 2023-09-13T02:12:21.923 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.920+0000 7f20b54f2640 1 Processor -- start 2023-09-13T02:12:21.923 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.920+0000 7f20b54f2640 1 -- start start 2023-09-13T02:12:21.923 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.920+0000 7f20b54f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2098005180 0x7f20b00b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:21.923 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.920+0000 7f20b54f2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20b01cf220 0x7f20b01cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:21.924 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.920+0000 7f20b54f2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20b01ce250 0x7f20b0136cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:21.924 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.920+0000 7f20b54f2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b01cf680 con 0x7f2098005180 2023-09-13T02:12:21.924 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.920+0000 7f20b54f2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b01cf900 con 0x7f20b01ce250 2023-09-13T02:12:21.924 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.920+0000 7f20b54f2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b01cfbe0 con 0x7f20b01cf220 2023-09-13T02:12:21.924 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.920+0000 7f20aeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2098005180 0x7f20b00b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:21.925 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.920+0000 7f20aeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2098005180 0x7f20b00b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51992/0 (socket says 172.21.15.104:51992) 2023-09-13T02:12:21.925 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.920+0000 7f20aeffd640 1 -- 172.21.15.104:0/3185342840 learned_addr learned my addr 172.21.15.104:0/3185342840 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:21.925 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.920+0000 7f20ae7fc640 1 --2- 172.21.15.104:0/3185342840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20b01cf220 0x7f20b01cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:21.925 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.920+0000 7f20af7fe640 1 --2- 172.21.15.104:0/3185342840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20b01ce250 0x7f20b0136cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:21.925 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.921+0000 7f20aeffd640 1 -- 172.21.15.104:0/3185342840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20b01cf220 msgr2=0x7f20b01cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.926 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.921+0000 7f20aeffd640 1 --2- 172.21.15.104:0/3185342840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20b01cf220 0x7f20b01cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.926 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.921+0000 7f20aeffd640 1 -- 172.21.15.104:0/3185342840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20b01ce250 msgr2=0x7f20b0136cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:21.926 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.921+0000 7f20aeffd640 1 --2- 172.21.15.104:0/3185342840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20b01ce250 0x7f20b0136cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:21.926 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.921+0000 7f20aeffd640 1 -- 172.21.15.104:0/3185342840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b01d0480 con 0x7f2098005180 2023-09-13T02:12:21.927 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.921+0000 7f20aeffd640 1 --2- 172.21.15.104:0/3185342840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2098005180 0x7f20b00b4db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f20a0011c40 tx=0x7f20a000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:21.927 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.921+0000 7f20977fe640 1 -- 172.21.15.104:0/3185342840 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a0003e40 con 0x7f2098005180 2023-09-13T02:12:21.927 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.921+0000 7f20977fe640 1 -- 172.21.15.104:0/3185342840 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f20a0004b20 con 0x7f2098005180 2023-09-13T02:12:21.927 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.921+0000 7f20b54f2640 1 -- 172.21.15.104:0/3185342840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b00af430 con 0x7f2098005180 2023-09-13T02:12:21.927 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.921+0000 7f20977fe640 1 -- 172.21.15.104:0/3185342840 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a0004050 con 0x7f2098005180 2023-09-13T02:12:21.928 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.921+0000 7f20b54f2640 1 -- 172.21.15.104:0/3185342840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b01d0070 con 0x7f2098005180 2023-09-13T02:12:21.928 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.922+0000 7f20b54f2640 1 -- 172.21.15.104:0/3185342840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b01ce660 con 0x7f2098005180 2023-09-13T02:12:21.928 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.922+0000 7f20977fe640 1 -- 172.21.15.104:0/3185342840 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f20a00041b0 con 0x7f2098005180 2023-09-13T02:12:21.928 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.923+0000 7f20977fe640 1 --2- 172.21.15.104:0/3185342840 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f209c06a520 0x7f209c06c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:21.928 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.923+0000 7f20977fe640 1 -- 172.21.15.104:0/3185342840 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f20a0089830 con 0x7f2098005180 2023-09-13T02:12:21.929 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.923+0000 7f20ae7fc640 1 --2- 172.21.15.104:0/3185342840 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f209c06a520 0x7f209c06c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:21.929 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.923+0000 7f20ae7fc640 1 --2- 172.21.15.104:0/3185342840 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f209c06a520 0x7f209c06c9e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f20b00b5690 tx=0x7f20a4006c60 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:21.929 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:21.927+0000 7f20977fe640 1 -- 172.21.15.104:0/3185342840 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f20a0055240 con 0x7f2098005180 2023-09-13T02:12:22.096 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.096+0000 7f20b54f2640 1 -- 172.21.15.104:0/3185342840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f20b01d0290 con 0x7f2098005180 2023-09-13T02:12:22.559 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.559+0000 7f20977fe640 1 -- 172.21.15.104:0/3185342840 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f20a0058860 con 0x7f2098005180 2023-09-13T02:12:22.560 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2023-09-13T02:12:22.562 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.562+0000 7f20b54f2640 1 -- 172.21.15.104:0/3185342840 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f209c06a520 msgr2=0x7f209c06c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:22.562 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.562+0000 7f20b54f2640 1 --2- 172.21.15.104:0/3185342840 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f209c06a520 0x7f209c06c9e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f20b00b5690 tx=0x7f20a4006c60 comp rx=0 tx=0).stop 2023-09-13T02:12:22.562 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.562+0000 7f20b54f2640 1 -- 172.21.15.104:0/3185342840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2098005180 msgr2=0x7f20b00b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:22.562 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.562+0000 7f20b54f2640 1 --2- 172.21.15.104:0/3185342840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2098005180 0x7f20b00b4db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f20a0011c40 tx=0x7f20a000f790 comp rx=0 tx=0).stop 2023-09-13T02:12:22.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.562+0000 7f20b54f2640 1 -- 172.21.15.104:0/3185342840 shutdown_connections 2023-09-13T02:12:22.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.562+0000 7f20b54f2640 1 --2- 172.21.15.104:0/3185342840 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f209c06a520 0x7f209c06c9e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:22.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.562+0000 7f20b54f2640 1 --2- 172.21.15.104:0/3185342840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20b01ce250 0x7f20b0136cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:22.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.562+0000 7f20b54f2640 1 --2- 172.21.15.104:0/3185342840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20b01cf220 0x7f20b01cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:22.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.562+0000 7f20b54f2640 1 --2- 172.21.15.104:0/3185342840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2098005180 0x7f20b00b4db0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:22.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.562+0000 7f20b54f2640 1 -- 172.21.15.104:0/3185342840 >> 172.21.15.104:0/3185342840 conn(0x7f20b00708b0 msgr2=0x7f20b00b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:22.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.562+0000 7f20b54f2640 1 -- 172.21.15.104:0/3185342840 shutdown_connections 2023-09-13T02:12:22.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.562+0000 7f20b54f2640 1 -- 172.21.15.104:0/3185342840 wait complete. 2023-09-13T02:12:22.576 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-13T02:12:22.687 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.687+0000 7fd542021640 1 -- 172.21.15.104:0/1898135385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd53c142770 msgr2=0x7fd53c14c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:22.688 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.687+0000 7fd542021640 1 --2- 172.21.15.104:0/1898135385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd53c142770 0x7fd53c14c940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd534005fd0 tx=0x7fd53402c050 comp rx=0 tx=0).stop 2023-09-13T02:12:22.688 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.687+0000 7fd542021640 1 -- 172.21.15.104:0/1898135385 shutdown_connections 2023-09-13T02:12:22.688 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.687+0000 7fd542021640 1 --2- 172.21.15.104:0/1898135385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd53c142770 0x7fd53c14c940 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:22.688 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.687+0000 7fd542021640 1 --2- 172.21.15.104:0/1898135385 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd53c0b1280 0x7fd53c142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:22.688 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.687+0000 7fd542021640 1 -- 172.21.15.104:0/1898135385 >> 172.21.15.104:0/1898135385 conn(0x7fd53c0b56f0 msgr2=0x7fd53c0b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:22.689 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.687+0000 7fd542021640 1 -- 172.21.15.104:0/1898135385 shutdown_connections 2023-09-13T02:12:22.689 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.687+0000 7fd542021640 1 -- 172.21.15.104:0/1898135385 wait complete. 2023-09-13T02:12:22.692 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.688+0000 7fd542021640 1 Processor -- start 2023-09-13T02:12:22.692 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.688+0000 7fd542021640 1 -- start start 2023-09-13T02:12:22.692 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd542021640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd53c0aefb0 0x7fd53c0b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:22.692 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd542021640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd53c0b1280 0x7fd53c135c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:22.692 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd542021640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd53c142770 0x7fd53c13fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:22.693 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd542021640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0b3670 con 0x7fd53c142770 2023-09-13T02:12:22.693 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd542021640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c070190 con 0x7fd53c0aefb0 2023-09-13T02:12:22.693 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd542021640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0b39c0 con 0x7fd53c0b1280 2023-09-13T02:12:22.693 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd53bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd53c142770 0x7fd53c13fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:22.693 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd53bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd53c142770 0x7fd53c13fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52006/0 (socket says 172.21.15.104:52006) 2023-09-13T02:12:22.694 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd53bfff640 1 -- 172.21.15.104:0/804644585 learned_addr learned my addr 172.21.15.104:0/804644585 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:22.694 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd53affd640 1 --2- 172.21.15.104:0/804644585 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd53c0b1280 0x7fd53c135c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:22.694 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd53b7fe640 1 --2- 172.21.15.104:0/804644585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd53c0aefb0 0x7fd53c0b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:22.694 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd53bfff640 1 -- 172.21.15.104:0/804644585 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd53c0b1280 msgr2=0x7fd53c135c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:22.694 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd53bfff640 1 --2- 172.21.15.104:0/804644585 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd53c0b1280 0x7fd53c135c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:22.697 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd53bfff640 1 -- 172.21.15.104:0/804644585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd53c0aefb0 msgr2=0x7fd53c0b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:22.697 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd53bfff640 1 --2- 172.21.15.104:0/804644585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd53c0aefb0 0x7fd53c0b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:22.697 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd53bfff640 1 -- 172.21.15.104:0/804644585 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd530009490 con 0x7fd53c142770 2023-09-13T02:12:22.697 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd53affd640 1 --2- 172.21.15.104:0/804644585 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd53c0b1280 0x7fd53c135c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:22.697 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd53bfff640 1 --2- 172.21.15.104:0/804644585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd53c142770 0x7fd53c13fef0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd534009b30 tx=0x7fd534004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:22.698 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd523fff640 1 -- 172.21.15.104:0/804644585 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534004870 con 0x7fd53c142770 2023-09-13T02:12:22.698 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd523fff640 1 -- 172.21.15.104:0/804644585 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd53403e460 con 0x7fd53c142770 2023-09-13T02:12:22.698 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd542021640 1 -- 172.21.15.104:0/804644585 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd534009840 con 0x7fd53c142770 2023-09-13T02:12:22.698 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.689+0000 7fd523fff640 1 -- 172.21.15.104:0/804644585 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53403e850 con 0x7fd53c142770 2023-09-13T02:12:22.698 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.690+0000 7fd542021640 1 -- 172.21.15.104:0/804644585 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c06feb0 con 0x7fd53c142770 2023-09-13T02:12:22.699 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.690+0000 7fd542021640 1 -- 172.21.15.104:0/804644585 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53c0b34d0 con 0x7fd53c142770 2023-09-13T02:12:22.699 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.691+0000 7fd523fff640 1 -- 172.21.15.104:0/804644585 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd53403e9b0 con 0x7fd53c142770 2023-09-13T02:12:22.699 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.691+0000 7fd523fff640 1 --2- 172.21.15.104:0/804644585 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd52806a4f0 0x7fd52806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:22.699 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.691+0000 7fd523fff640 1 -- 172.21.15.104:0/804644585 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd5340ab890 con 0x7fd53c142770 2023-09-13T02:12:22.699 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.691+0000 7fd53b7fe640 1 --2- 172.21.15.104:0/804644585 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd52806a4f0 0x7fd52806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:22.700 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.692+0000 7fd53b7fe640 1 --2- 172.21.15.104:0/804644585 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd52806a4f0 0x7fd52806c9b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd52c001640 tx=0x7fd52c009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:22.700 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.696+0000 7fd523fff640 1 -- 172.21.15.104:0/804644585 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd53c0b34d0 con 0x7fd53c142770 2023-09-13T02:12:22.862 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:22.862+0000 7fd542021640 1 -- 172.21.15.104:0/804644585 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd53c0b34d0 con 0x7fd53c142770 2023-09-13T02:12:23.562 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.562+0000 7fd523fff640 1 -- 172.21.15.104:0/804644585 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd53c0b34d0 con 0x7fd53c142770 2023-09-13T02:12:23.562 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2023-09-13T02:12:23.568 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.567+0000 7fd542021640 1 -- 172.21.15.104:0/804644585 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd52806a4f0 msgr2=0x7fd52806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:23.568 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.567+0000 7fd542021640 1 --2- 172.21.15.104:0/804644585 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd52806a4f0 0x7fd52806c9b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd52c001640 tx=0x7fd52c009040 comp rx=0 tx=0).stop 2023-09-13T02:12:23.568 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.567+0000 7fd542021640 1 -- 172.21.15.104:0/804644585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd53c142770 msgr2=0x7fd53c13fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:23.568 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.567+0000 7fd542021640 1 --2- 172.21.15.104:0/804644585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd53c142770 0x7fd53c13fef0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd534009b30 tx=0x7fd534004270 comp rx=0 tx=0).stop 2023-09-13T02:12:23.568 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.567+0000 7fd542021640 1 -- 172.21.15.104:0/804644585 shutdown_connections 2023-09-13T02:12:23.569 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.567+0000 7fd542021640 1 --2- 172.21.15.104:0/804644585 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd52806a4f0 0x7fd52806c9b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:23.569 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.567+0000 7fd542021640 1 --2- 172.21.15.104:0/804644585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd53c142770 0x7fd53c13fef0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:23.569 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.567+0000 7fd542021640 1 --2- 172.21.15.104:0/804644585 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd53c0b1280 0x7fd53c135c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:23.569 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.567+0000 7fd542021640 1 --2- 172.21.15.104:0/804644585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd53c0aefb0 0x7fd53c0b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:23.570 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.567+0000 7fd542021640 1 -- 172.21.15.104:0/804644585 >> 172.21.15.104:0/804644585 conn(0x7fd53c0b56f0 msgr2=0x7fd53c136fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:23.570 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.568+0000 7fd542021640 1 -- 172.21.15.104:0/804644585 shutdown_connections 2023-09-13T02:12:23.570 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.568+0000 7fd542021640 1 -- 172.21.15.104:0/804644585 wait complete. 2023-09-13T02:12:23.593 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-13T02:12:23.701 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.701+0000 7fdeebb4e640 1 -- 172.21.15.104:0/1583305902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdee4070fd0 msgr2=0x7fdee41425e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:23.702 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.701+0000 7fdeebb4e640 1 --2- 172.21.15.104:0/1583305902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdee4070fd0 0x7fdee41425e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdee4071d10 tx=0x7fded402c1d0 comp rx=0 tx=0).stop 2023-09-13T02:12:23.702 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.701+0000 7fdeebb4e640 1 -- 172.21.15.104:0/1583305902 shutdown_connections 2023-09-13T02:12:23.702 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.701+0000 7fdeebb4e640 1 --2- 172.21.15.104:0/1583305902 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdee413be60 0x7fdee413c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:23.702 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.701+0000 7fdeebb4e640 1 --2- 172.21.15.104:0/1583305902 >> v2:172.21.15.119:3300/0 conn(0x7fdee406fb50 0x7fdee406ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:23.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.701+0000 7fdeebb4e640 1 --2- 172.21.15.104:0/1583305902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdee4070fd0 0x7fdee41425e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:23.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.701+0000 7fdeebb4e640 1 -- 172.21.15.104:0/1583305902 >> 172.21.15.104:0/1583305902 conn(0x7fdee4069b30 msgr2=0x7fdee40b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:23.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.701+0000 7fdeebb4e640 1 -- 172.21.15.104:0/1583305902 shutdown_connections 2023-09-13T02:12:23.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.701+0000 7fdeebb4e640 1 -- 172.21.15.104:0/1583305902 wait complete. 2023-09-13T02:12:23.706 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.702+0000 7fdeebb4e640 1 Processor -- start 2023-09-13T02:12:23.706 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.702+0000 7fdeebb4e640 1 -- start start 2023-09-13T02:12:23.706 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdeebb4e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdee406fb50 0x7fdee41d98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:23.707 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdeebb4e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdee4070fd0 0x7fdee40b7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:23.707 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdeebb4e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdee413be60 0x7fdee41cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:23.707 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdeebb4e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee40b7790 con 0x7fdee406fb50 2023-09-13T02:12:23.707 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdeebb4e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee406aeb0 con 0x7fdee413be60 2023-09-13T02:12:23.707 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdeebb4e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee40b6dc0 con 0x7fdee4070fd0 2023-09-13T02:12:23.708 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdee98ea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdee406fb50 0x7fdee41d98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:23.708 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdee98ea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdee406fb50 0x7fdee41d98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52020/0 (socket says 172.21.15.104:52020) 2023-09-13T02:12:23.708 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdee98ea640 1 -- 172.21.15.104:0/2354146403 learned_addr learned my addr 172.21.15.104:0/2354146403 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:23.708 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdee90e9640 1 --2- 172.21.15.104:0/2354146403 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdee4070fd0 0x7fdee40b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:23.708 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdeea0eb640 1 --2- 172.21.15.104:0/2354146403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdee413be60 0x7fdee41cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:23.709 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdee98ea640 1 -- 172.21.15.104:0/2354146403 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdee4070fd0 msgr2=0x7fdee40b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:23.709 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdee98ea640 1 --2- 172.21.15.104:0/2354146403 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdee4070fd0 0x7fdee40b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:23.709 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdee98ea640 1 -- 172.21.15.104:0/2354146403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdee413be60 msgr2=0x7fdee41cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:23.709 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdee98ea640 1 --2- 172.21.15.104:0/2354146403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdee413be60 0x7fdee41cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:23.709 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdee98ea640 1 -- 172.21.15.104:0/2354146403 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded4009900 con 0x7fdee406fb50 2023-09-13T02:12:23.710 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdeea0eb640 1 --2- 172.21.15.104:0/2354146403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdee413be60 0x7fdee41cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:12:23.710 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdee98ea640 1 --2- 172.21.15.104:0/2354146403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdee406fb50 0x7fdee41d98e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fded4009d60 tx=0x7fded4035e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:23.710 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdee27fc640 1 -- 172.21.15.104:0/2354146403 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded4034440 con 0x7fdee406fb50 2023-09-13T02:12:23.710 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdee27fc640 1 -- 172.21.15.104:0/2354146403 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fded4004560 con 0x7fdee406fb50 2023-09-13T02:12:23.710 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdee27fc640 1 -- 172.21.15.104:0/2354146403 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded4003e60 con 0x7fdee406fb50 2023-09-13T02:12:23.711 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdeebb4e640 1 -- 172.21.15.104:0/2354146403 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee406b3e0 con 0x7fdee406fb50 2023-09-13T02:12:23.711 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.703+0000 7fdeebb4e640 1 -- 172.21.15.104:0/2354146403 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee406b100 con 0x7fdee406fb50 2023-09-13T02:12:23.711 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.704+0000 7fdeebb4e640 1 -- 172.21.15.104:0/2354146403 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee404e100 con 0x7fdee406fb50 2023-09-13T02:12:23.711 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.705+0000 7fdee27fc640 1 -- 172.21.15.104:0/2354146403 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fded400a040 con 0x7fdee406fb50 2023-09-13T02:12:23.711 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.705+0000 7fdee27fc640 1 --2- 172.21.15.104:0/2354146403 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fded006a520 0x7fded006c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:23.712 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.705+0000 7fdee90e9640 1 --2- 172.21.15.104:0/2354146403 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fded006a520 0x7fded006c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:23.712 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.705+0000 7fdee27fc640 1 -- 172.21.15.104:0/2354146403 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fded40ab800 con 0x7fdee406fb50 2023-09-13T02:12:23.712 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.706+0000 7fdee90e9640 1 --2- 172.21.15.104:0/2354146403 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fded006a520 0x7fded006c9e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fded8005e00 tx=0x7fded8005c70 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:23.712 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.709+0000 7fdee27fc640 1 -- 172.21.15.104:0/2354146403 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fded4076df0 con 0x7fdee406fb50 2023-09-13T02:12:23.794 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:12:23.797 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:12:23.915 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:23.915+0000 7fdeebb4e640 1 -- 172.21.15.104:0/2354146403 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdee406c1c0 con 0x7fdee406fb50 2023-09-13T02:12:24.850 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.849+0000 7fdee27fc640 1 -- 172.21.15.104:0/2354146403 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fded407a410 con 0x7fdee406fb50 2023-09-13T02:12:24.850 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 2 and data pool 3 2023-09-13T02:12:24.854 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.852+0000 7fdeebb4e640 1 -- 172.21.15.104:0/2354146403 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fded006a520 msgr2=0x7fded006c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:24.854 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.852+0000 7fdeebb4e640 1 --2- 172.21.15.104:0/2354146403 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fded006a520 0x7fded006c9e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fded8005e00 tx=0x7fded8005c70 comp rx=0 tx=0).stop 2023-09-13T02:12:24.854 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.852+0000 7fdeebb4e640 1 -- 172.21.15.104:0/2354146403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdee406fb50 msgr2=0x7fdee41d98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:24.854 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.852+0000 7fdeebb4e640 1 --2- 172.21.15.104:0/2354146403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdee406fb50 0x7fdee41d98e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fded4009d60 tx=0x7fded4035e30 comp rx=0 tx=0).stop 2023-09-13T02:12:24.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.852+0000 7fdeebb4e640 1 -- 172.21.15.104:0/2354146403 shutdown_connections 2023-09-13T02:12:24.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.852+0000 7fdeebb4e640 1 --2- 172.21.15.104:0/2354146403 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fded006a520 0x7fded006c9e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:24.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.852+0000 7fdeebb4e640 1 --2- 172.21.15.104:0/2354146403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdee413be60 0x7fdee41cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:24.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.852+0000 7fdeebb4e640 1 --2- 172.21.15.104:0/2354146403 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdee4070fd0 0x7fdee40b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:24.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.852+0000 7fdeebb4e640 1 --2- 172.21.15.104:0/2354146403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdee406fb50 0x7fdee41d98e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:24.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.852+0000 7fdeebb4e640 1 -- 172.21.15.104:0/2354146403 >> 172.21.15.104:0/2354146403 conn(0x7fdee4069b30 msgr2=0x7fdee40b4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:24.856 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.853+0000 7fdeebb4e640 1 -- 172.21.15.104:0/2354146403 shutdown_connections 2023-09-13T02:12:24.856 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.853+0000 7fdeebb4e640 1 -- 172.21.15.104:0/2354146403 wait complete. 2023-09-13T02:12:24.871 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T02:12:24.977 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.976+0000 7f7d9953e640 1 -- 172.21.15.104:0/3484116125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d940b5ba0 msgr2=0x7f7d9414ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:24.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.976+0000 7f7d9953e640 1 --2- 172.21.15.104:0/3484116125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d940b5ba0 0x7f7d9414ec50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7d940b5690 tx=0x7f7d8c02c1d0 comp rx=0 tx=0).stop 2023-09-13T02:12:24.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.976+0000 7f7d9953e640 1 -- 172.21.15.104:0/3484116125 shutdown_connections 2023-09-13T02:12:24.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.976+0000 7f7d9953e640 1 --2- 172.21.15.104:0/3484116125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d940b5ba0 0x7f7d9414ec50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:24.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.976+0000 7f7d9953e640 1 --2- 172.21.15.104:0/3484116125 >> v2:172.21.15.119:3300/0 conn(0x7f7d940b1820 0x7f7d941482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:24.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.976+0000 7f7d9953e640 1 -- 172.21.15.104:0/3484116125 >> 172.21.15.104:0/3484116125 conn(0x7f7d940708b0 msgr2=0x7f7d94070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:24.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.976+0000 7f7d9953e640 1 -- 172.21.15.104:0/3484116125 shutdown_connections 2023-09-13T02:12:24.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.976+0000 7f7d9953e640 1 -- 172.21.15.104:0/3484116125 wait complete. 2023-09-13T02:12:24.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.977+0000 7f7d9953e640 1 Processor -- start 2023-09-13T02:12:24.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.977+0000 7f7d9953e640 1 -- start start 2023-09-13T02:12:24.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.978+0000 7f7d9953e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d940b5ba0 0x7f7d94143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:24.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.978+0000 7f7d9953e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d94147b90 0x7f7d941da7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:24.983 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.978+0000 7f7d9953e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d941dad10 0x7f7d941dd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:24.983 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.978+0000 7f7d9953e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d941db1c0 con 0x7f7d940b5ba0 2023-09-13T02:12:24.983 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.978+0000 7f7d9953e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9413ee30 con 0x7f7d941dad10 2023-09-13T02:12:24.983 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.978+0000 7f7d9953e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940ba410 con 0x7f7d94147b90 2023-09-13T02:12:24.983 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.978+0000 7f7d92ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d940b5ba0 0x7f7d94143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:24.984 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.978+0000 7f7d92ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d940b5ba0 0x7f7d94143e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52032/0 (socket says 172.21.15.104:52032) 2023-09-13T02:12:24.984 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.978+0000 7f7d92ffd640 1 -- 172.21.15.104:0/1849962319 learned_addr learned my addr 172.21.15.104:0/1849962319 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:24.984 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.978+0000 7f7d92ffd640 1 -- 172.21.15.104:0/1849962319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d94147b90 msgr2=0x7f7d941da7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:24.984 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.978+0000 7f7d92ffd640 1 --2- 172.21.15.104:0/1849962319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d94147b90 0x7f7d941da7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:24.984 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.978+0000 7f7d92ffd640 1 -- 172.21.15.104:0/1849962319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d941dad10 msgr2=0x7f7d941dd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:24.985 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.978+0000 7f7d92ffd640 1 --2- 172.21.15.104:0/1849962319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d941dad10 0x7f7d941dd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:24.985 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.978+0000 7f7d92ffd640 1 -- 172.21.15.104:0/1849962319 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c009900 con 0x7f7d940b5ba0 2023-09-13T02:12:24.985 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.978+0000 7f7d92ffd640 1 --2- 172.21.15.104:0/1849962319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d940b5ba0 0x7f7d94143e70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400b420 tx=0x7f7d8400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:24.985 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.979+0000 7f7d7b7fe640 1 -- 172.21.15.104:0/1849962319 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84011830 con 0x7f7d940b5ba0 2023-09-13T02:12:24.985 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.979+0000 7f7d7b7fe640 1 -- 172.21.15.104:0/1849962319 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7d84011a80 con 0x7f7d940b5ba0 2023-09-13T02:12:24.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.979+0000 7f7d7b7fe640 1 -- 172.21.15.104:0/1849962319 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84011e90 con 0x7f7d940b5ba0 2023-09-13T02:12:24.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.979+0000 7f7d9953e640 1 -- 172.21.15.104:0/1849962319 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d940b1000 con 0x7f7d940b5ba0 2023-09-13T02:12:24.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.979+0000 7f7d9953e640 1 -- 172.21.15.104:0/1849962319 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d94142220 con 0x7f7d940b5ba0 2023-09-13T02:12:24.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.980+0000 7f7d9953e640 1 -- 172.21.15.104:0/1849962319 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d94142c50 con 0x7f7d940b5ba0 2023-09-13T02:12:24.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.980+0000 7f7d7b7fe640 1 -- 172.21.15.104:0/1849962319 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f7d8401b460 con 0x7f7d940b5ba0 2023-09-13T02:12:24.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.980+0000 7f7d7b7fe640 1 --2- 172.21.15.104:0/1849962319 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f7d8006a4f0 0x7f7d8006c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:24.987 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.981+0000 7f7d927fc640 1 --2- 172.21.15.104:0/1849962319 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f7d8006a4f0 0x7f7d8006c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:24.987 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.981+0000 7f7d7b7fe640 1 -- 172.21.15.104:0/1849962319 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d84088840 con 0x7f7d940b5ba0 2023-09-13T02:12:24.987 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.981+0000 7f7d927fc640 1 --2- 172.21.15.104:0/1849962319 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f7d8006a4f0 0x7f7d8006c9b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7d9406bb90 tx=0x7f7d88005c90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:24.988 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:24.985+0000 7f7d7b7fe640 1 -- 172.21.15.104:0/1849962319 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7d84053e50 con 0x7f7d940b5ba0 2023-09-13T02:12:25.154 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.153+0000 7f7d9953e640 1 -- 172.21.15.104:0/1849962319 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d9404e100 con 0x7f7d940b5ba0 2023-09-13T02:12:25.155 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.154+0000 7f7d7b7fe640 1 -- 172.21.15.104:0/1849962319 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16554 (secure 0 0 0) 0x7f7d84057470 con 0x7f7d940b5ba0 2023-09-13T02:12:25.156 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:25.156 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":19,"fsid":"ac1f5a95-0d3a-406e-b4ca-c8ea43282cab","created":"2023-09-13T02:11:59.067178+0000","modified":"2023-09-13T02:12:23.916017+0000","last_up_change":"2023-09-13T02:12:11.207888+0000","last_in_change":"2023-09-13T02:12:02.278796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T02:12:12.071023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T02:12:22.114609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T02:12:22.880593+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67190066-4851-4b1f-aae8-bad59e79ebb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6801","nonce":3271772377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6803","nonce":3271772377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6807","nonce":3271772377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6805","nonce":3271772377}]},"public_addr":"172.21.15.104:6801/3271772377","cluster_addr":"172.21.15.104:6803/3271772377","heartbeat_back_addr":"172.21.15.104:6807/3271772377","heartbeat_front_addr":"172.21.15.104:6805/3271772377","state":["exists","up"]},{"osd":1,"uuid":"f1907075-bb97-4a19-8dd6-322232caaf4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6809","nonce":3786698894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6811","nonce":3786698894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6815","nonce":3786698894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6813","nonce":3786698894}]},"public_addr":"172.21.15.104:6809/3786698894","cluster_addr":"172.21.15.104:6811/3786698894","heartbeat_back_addr":"172.21.15.104:6815/3786698894","heartbeat_front_addr":"172.21.15.104:6813/3786698894","state":["exists","up"]},{"osd":2,"uuid":"8c323c83-330c-4181-b622-10177c81f975","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6819","nonce":2319361072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6822","nonce":2319361072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6827","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6829","nonce":2319361072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6826","nonce":2319361072}]},"public_addr":"172.21.15.104:6819/2319361072","cluster_addr":"172.21.15.104:6822/2319361072","heartbeat_back_addr":"172.21.15.104:6829/2319361072","heartbeat_front_addr":"172.21.15.104:6826/2319361072","state":["exists","up"]},{"osd":3,"uuid":"811457f5-c408-488d-a4ed-b947d1c55e82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6818","nonce":621253853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6823","nonce":621253853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6831","nonce":621253853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6825","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6828","nonce":621253853}]},"public_addr":"172.21.15.104:6818/621253853","cluster_addr":"172.21.15.104:6823/621253853","heartbeat_back_addr":"172.21.15.104:6831/621253853","heartbeat_front_addr":"172.21.15.104:6828/621253853","state":["exists","up"]},{"osd":4,"uuid":"552010ea-7d61-47c7-b4ac-657845e55e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6801","nonce":3049794634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6803","nonce":3049794634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6807","nonce":3049794634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6805","nonce":3049794634}]},"public_addr":"172.21.15.119:6801/3049794634","cluster_addr":"172.21.15.119:6803/3049794634","heartbeat_back_addr":"172.21.15.119:6807/3049794634","heartbeat_front_addr":"172.21.15.119:6805/3049794634","state":["exists","up"]},{"osd":5,"uuid":"41f415b0-6886-44ed-bccc-57c46cc975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6809","nonce":2918159428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6811","nonce":2918159428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6815","nonce":2918159428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6813","nonce":2918159428}]},"public_addr":"172.21.15.119:6809/2918159428","cluster_addr":"172.21.15.119:6811/2918159428","heartbeat_back_addr":"172.21.15.119:6815/2918159428","heartbeat_front_addr":"172.21.15.119:6813/2918159428","state":["exists","up"]},{"osd":6,"uuid":"1f415570-dbcc-4cb9-930a-ad31a96c3ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6825","nonce":3509665357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6827","nonce":3509665357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6831","nonce":3509665357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6829","nonce":3509665357}]},"public_addr":"172.21.15.119:6825/3509665357","cluster_addr":"172.21.15.119:6827/3509665357","heartbeat_back_addr":"172.21.15.119:6831/3509665357","heartbeat_front_addr":"172.21.15.119:6829/3509665357","state":["exists","up"]},{"osd":7,"uuid":"ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6817","nonce":892749725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6819","nonce":892749725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6823","nonce":892749725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6821","nonce":892749725}]},"public_addr":"172.21.15.119:6817/892749725","cluster_addr":"172.21.15.119:6819/892749725","heartbeat_back_addr":"172.21.15.119:6823/892749725","heartbeat_front_addr":"172.21.15.119:6821/892749725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.489481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.468615+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.485958+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.424425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.456308+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.427607+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T02:12:25.157 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.156+0000 7f7d9953e640 1 -- 172.21.15.104:0/1849962319 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f7d8006a4f0 msgr2=0x7f7d8006c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:25.157 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.156+0000 7f7d9953e640 1 --2- 172.21.15.104:0/1849962319 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f7d8006a4f0 0x7f7d8006c9b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7d9406bb90 tx=0x7f7d88005c90 comp rx=0 tx=0).stop 2023-09-13T02:12:25.158 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.156+0000 7f7d9953e640 1 -- 172.21.15.104:0/1849962319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d940b5ba0 msgr2=0x7f7d94143e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:25.158 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.156+0000 7f7d9953e640 1 --2- 172.21.15.104:0/1849962319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d940b5ba0 0x7f7d94143e70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400b420 tx=0x7f7d8400b8e0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.158 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.156+0000 7f7d9953e640 1 -- 172.21.15.104:0/1849962319 shutdown_connections 2023-09-13T02:12:25.158 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.156+0000 7f7d9953e640 1 --2- 172.21.15.104:0/1849962319 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f7d8006a4f0 0x7f7d8006c9b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.158 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.156+0000 7f7d9953e640 1 --2- 172.21.15.104:0/1849962319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d941dad10 0x7f7d941dd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.159 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.156+0000 7f7d9953e640 1 --2- 172.21.15.104:0/1849962319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d94147b90 0x7f7d941da7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.159 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.156+0000 7f7d9953e640 1 --2- 172.21.15.104:0/1849962319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d940b5ba0 0x7f7d94143e70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.159 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.156+0000 7f7d9953e640 1 -- 172.21.15.104:0/1849962319 >> 172.21.15.104:0/1849962319 conn(0x7f7d940708b0 msgr2=0x7f7d940b5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:25.159 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.156+0000 7f7d9953e640 1 -- 172.21.15.104:0/1849962319 shutdown_connections 2023-09-13T02:12:25.159 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.156+0000 7f7d9953e640 1 -- 172.21.15.104:0/1849962319 wait complete. 2023-09-13T02:12:25.168 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T02:12:25.269 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.267+0000 7f31bc565640 1 -- 172.21.15.104:0/875038571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b40b20e0 msgr2=0x7f31b4144a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:25.269 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.267+0000 7f31bc565640 1 --2- 172.21.15.104:0/875038571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b40b20e0 0x7f31b4144a50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f31b4072a10 tx=0x7f31ac02c1d0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.269 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.267+0000 7f31bc565640 1 -- 172.21.15.104:0/875038571 shutdown_connections 2023-09-13T02:12:25.269 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.267+0000 7f31bc565640 1 --2- 172.21.15.104:0/875038571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b40b20e0 0x7f31b4144a50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.270 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.267+0000 7f31bc565640 1 --2- 172.21.15.104:0/875038571 >> v2:172.21.15.119:3300/0 conn(0x7f31b40af4e0 0x7f31b4144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.270 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.267+0000 7f31bc565640 1 --2- 172.21.15.104:0/875038571 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31b40b30d0 0x7f31b4140fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.270 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.267+0000 7f31bc565640 1 -- 172.21.15.104:0/875038571 >> 172.21.15.104:0/875038571 conn(0x7f31b4069570 msgr2=0x7f31b4069980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:25.270 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.267+0000 7f31bc565640 1 -- 172.21.15.104:0/875038571 shutdown_connections 2023-09-13T02:12:25.270 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.267+0000 7f31bc565640 1 -- 172.21.15.104:0/875038571 wait complete. 2023-09-13T02:12:25.273 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.268+0000 7f31bc565640 1 Processor -- start 2023-09-13T02:12:25.273 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.268+0000 7f31bc565640 1 -- start start 2023-09-13T02:12:25.273 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31bc565640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31b40af4e0 0x7f31b41cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:25.273 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31bc565640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31b40b20e0 0x7f31b40b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31bc565640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b40b30d0 0x7f31b41cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31bc565640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b413af60 con 0x7f31b40b30d0 2023-09-13T02:12:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31bc565640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40b4810 con 0x7f31b40af4e0 2023-09-13T02:12:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31bc565640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40b42e0 con 0x7f31b40b20e0 2023-09-13T02:12:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31bab02640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b40b30d0 0x7f31b41cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31bab02640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b40b30d0 0x7f31b41cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52046/0 (socket says 172.21.15.104:52046) 2023-09-13T02:12:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31bab02640 1 -- 172.21.15.104:0/3999314238 learned_addr learned my addr 172.21.15.104:0/3999314238 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31b9b00640 1 --2- 172.21.15.104:0/3999314238 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31b40b20e0 0x7f31b40b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31ba301640 1 --2- 172.21.15.104:0/3999314238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31b40af4e0 0x7f31b41cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:25.276 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31bab02640 1 -- 172.21.15.104:0/3999314238 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31b40b20e0 msgr2=0x7f31b40b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:25.276 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31bab02640 1 --2- 172.21.15.104:0/3999314238 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31b40b20e0 0x7f31b40b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.276 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31bab02640 1 -- 172.21.15.104:0/3999314238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31b40af4e0 msgr2=0x7f31b41cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:25.276 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31bab02640 1 --2- 172.21.15.104:0/3999314238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31b40af4e0 0x7f31b41cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.276 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31bab02640 1 -- 172.21.15.104:0/3999314238 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac009900 con 0x7f31b40b30d0 2023-09-13T02:12:25.277 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31b9b00640 1 --2- 172.21.15.104:0/3999314238 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31b40b20e0 0x7f31b40b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:25.277 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31bab02640 1 --2- 172.21.15.104:0/3999314238 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b40b30d0 0x7f31b41cd610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009d60 tx=0x7f31ac035db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:25.277 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31aaffd640 1 -- 172.21.15.104:0/3999314238 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac034440 con 0x7f31b40b30d0 2023-09-13T02:12:25.277 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31aaffd640 1 -- 172.21.15.104:0/3999314238 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f31ac004540 con 0x7f31b40b30d0 2023-09-13T02:12:25.277 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31bc565640 1 -- 172.21.15.104:0/3999314238 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b41cdb50 con 0x7f31b40b30d0 2023-09-13T02:12:25.278 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31aaffd640 1 -- 172.21.15.104:0/3999314238 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac03d3f0 con 0x7f31b40b30d0 2023-09-13T02:12:25.278 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.269+0000 7f31bc565640 1 -- 172.21.15.104:0/3999314238 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b41d7890 con 0x7f31b40b30d0 2023-09-13T02:12:25.278 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.270+0000 7f31bc565640 1 -- 172.21.15.104:0/3999314238 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b41d7ab0 con 0x7f31b40b30d0 2023-09-13T02:12:25.278 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.271+0000 7f31aaffd640 1 -- 172.21.15.104:0/3999314238 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f31ac03b040 con 0x7f31b40b30d0 2023-09-13T02:12:25.278 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.271+0000 7f31aaffd640 1 --2- 172.21.15.104:0/3999314238 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f319806a4f0 0x7f319806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:25.279 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.271+0000 7f31ba301640 1 --2- 172.21.15.104:0/3999314238 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f319806a4f0 0x7f319806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:25.279 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.271+0000 7f31aaffd640 1 -- 172.21.15.104:0/3999314238 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31ac0ab560 con 0x7f31b40b30d0 2023-09-13T02:12:25.279 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.271+0000 7f31ba301640 1 --2- 172.21.15.104:0/3999314238 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f319806a4f0 0x7f319806c9b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f31a4005fd0 tx=0x7f31a4005850 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:25.279 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.275+0000 7f31aaffd640 1 -- 172.21.15.104:0/3999314238 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f31ac076b70 con 0x7f31b40b30d0 2023-09-13T02:12:25.442 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.441+0000 7f31bc565640 1 -- 172.21.15.104:0/3999314238 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31b404e100 con 0x7f31b40b30d0 2023-09-13T02:12:25.443 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.442+0000 7f31aaffd640 1 -- 172.21.15.104:0/3999314238 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16554 (secure 0 0 0) 0x7f31ac07a190 con 0x7f31b40b30d0 2023-09-13T02:12:25.443 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:25.443 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":19,"fsid":"ac1f5a95-0d3a-406e-b4ca-c8ea43282cab","created":"2023-09-13T02:11:59.067178+0000","modified":"2023-09-13T02:12:23.916017+0000","last_up_change":"2023-09-13T02:12:11.207888+0000","last_in_change":"2023-09-13T02:12:02.278796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T02:12:12.071023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T02:12:22.114609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T02:12:22.880593+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67190066-4851-4b1f-aae8-bad59e79ebb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6801","nonce":3271772377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6803","nonce":3271772377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6807","nonce":3271772377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6805","nonce":3271772377}]},"public_addr":"172.21.15.104:6801/3271772377","cluster_addr":"172.21.15.104:6803/3271772377","heartbeat_back_addr":"172.21.15.104:6807/3271772377","heartbeat_front_addr":"172.21.15.104:6805/3271772377","state":["exists","up"]},{"osd":1,"uuid":"f1907075-bb97-4a19-8dd6-322232caaf4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6809","nonce":3786698894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6811","nonce":3786698894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6815","nonce":3786698894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6813","nonce":3786698894}]},"public_addr":"172.21.15.104:6809/3786698894","cluster_addr":"172.21.15.104:6811/3786698894","heartbeat_back_addr":"172.21.15.104:6815/3786698894","heartbeat_front_addr":"172.21.15.104:6813/3786698894","state":["exists","up"]},{"osd":2,"uuid":"8c323c83-330c-4181-b622-10177c81f975","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6819","nonce":2319361072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6822","nonce":2319361072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6827","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6829","nonce":2319361072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6826","nonce":2319361072}]},"public_addr":"172.21.15.104:6819/2319361072","cluster_addr":"172.21.15.104:6822/2319361072","heartbeat_back_addr":"172.21.15.104:6829/2319361072","heartbeat_front_addr":"172.21.15.104:6826/2319361072","state":["exists","up"]},{"osd":3,"uuid":"811457f5-c408-488d-a4ed-b947d1c55e82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6818","nonce":621253853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6823","nonce":621253853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6831","nonce":621253853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6825","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6828","nonce":621253853}]},"public_addr":"172.21.15.104:6818/621253853","cluster_addr":"172.21.15.104:6823/621253853","heartbeat_back_addr":"172.21.15.104:6831/621253853","heartbeat_front_addr":"172.21.15.104:6828/621253853","state":["exists","up"]},{"osd":4,"uuid":"552010ea-7d61-47c7-b4ac-657845e55e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6801","nonce":3049794634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6803","nonce":3049794634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6807","nonce":3049794634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6805","nonce":3049794634}]},"public_addr":"172.21.15.119:6801/3049794634","cluster_addr":"172.21.15.119:6803/3049794634","heartbeat_back_addr":"172.21.15.119:6807/3049794634","heartbeat_front_addr":"172.21.15.119:6805/3049794634","state":["exists","up"]},{"osd":5,"uuid":"41f415b0-6886-44ed-bccc-57c46cc975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6809","nonce":2918159428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6811","nonce":2918159428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6815","nonce":2918159428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6813","nonce":2918159428}]},"public_addr":"172.21.15.119:6809/2918159428","cluster_addr":"172.21.15.119:6811/2918159428","heartbeat_back_addr":"172.21.15.119:6815/2918159428","heartbeat_front_addr":"172.21.15.119:6813/2918159428","state":["exists","up"]},{"osd":6,"uuid":"1f415570-dbcc-4cb9-930a-ad31a96c3ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6825","nonce":3509665357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6827","nonce":3509665357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6831","nonce":3509665357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6829","nonce":3509665357}]},"public_addr":"172.21.15.119:6825/3509665357","cluster_addr":"172.21.15.119:6827/3509665357","heartbeat_back_addr":"172.21.15.119:6831/3509665357","heartbeat_front_addr":"172.21.15.119:6829/3509665357","state":["exists","up"]},{"osd":7,"uuid":"ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6817","nonce":892749725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6819","nonce":892749725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6823","nonce":892749725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6821","nonce":892749725}]},"public_addr":"172.21.15.119:6817/892749725","cluster_addr":"172.21.15.119:6819/892749725","heartbeat_back_addr":"172.21.15.119:6823/892749725","heartbeat_front_addr":"172.21.15.119:6821/892749725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.489481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.468615+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.485958+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.424425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.456308+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.427607+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T02:12:25.445 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.443+0000 7f31bc565640 1 -- 172.21.15.104:0/3999314238 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f319806a4f0 msgr2=0x7f319806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:25.445 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.443+0000 7f31bc565640 1 --2- 172.21.15.104:0/3999314238 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f319806a4f0 0x7f319806c9b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f31a4005fd0 tx=0x7f31a4005850 comp rx=0 tx=0).stop 2023-09-13T02:12:25.445 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.443+0000 7f31bc565640 1 -- 172.21.15.104:0/3999314238 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b40b30d0 msgr2=0x7f31b41cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:25.445 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.443+0000 7f31bc565640 1 --2- 172.21.15.104:0/3999314238 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b40b30d0 0x7f31b41cd610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009d60 tx=0x7f31ac035db0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.446 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.443+0000 7f31bc565640 1 -- 172.21.15.104:0/3999314238 shutdown_connections 2023-09-13T02:12:25.446 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.443+0000 7f31bc565640 1 --2- 172.21.15.104:0/3999314238 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f319806a4f0 0x7f319806c9b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.447 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.443+0000 7f31bc565640 1 --2- 172.21.15.104:0/3999314238 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b40b30d0 0x7f31b41cd610 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.447 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.443+0000 7f31bc565640 1 --2- 172.21.15.104:0/3999314238 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31b40b20e0 0x7f31b40b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.447 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.443+0000 7f31bc565640 1 --2- 172.21.15.104:0/3999314238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31b40af4e0 0x7f31b41cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.447 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.444+0000 7f31bc565640 1 -- 172.21.15.104:0/3999314238 >> 172.21.15.104:0/3999314238 conn(0x7f31b4069570 msgr2=0x7f31b413d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:25.447 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.444+0000 7f31bc565640 1 -- 172.21.15.104:0/3999314238 shutdown_connections 2023-09-13T02:12:25.448 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.444+0000 7f31bc565640 1 -- 172.21.15.104:0/3999314238 wait complete. 2023-09-13T02:12:25.455 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-13T02:12:25.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.558+0000 7fd5c961f640 1 -- 172.21.15.104:0/126442700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5c406def0 msgr2=0x7fd5c413bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:25.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.558+0000 7fd5c961f640 1 --2- 172.21.15.104:0/126442700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5c406def0 0x7fd5c413bdb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac009830 tx=0x7fd5ac02bc30 comp rx=0 tx=0).stop 2023-09-13T02:12:25.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.558+0000 7fd5c961f640 1 -- 172.21.15.104:0/126442700 shutdown_connections 2023-09-13T02:12:25.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.558+0000 7fd5c961f640 1 --2- 172.21.15.104:0/126442700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5c406def0 0x7fd5c413bdb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.558+0000 7fd5c961f640 1 --2- 172.21.15.104:0/126442700 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5c4145ec0 0x7fd5c413c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.558+0000 7fd5c961f640 1 -- 172.21.15.104:0/126442700 >> 172.21.15.104:0/126442700 conn(0x7fd5c40b56f0 msgr2=0x7fd5c40b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:25.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.558+0000 7fd5c961f640 1 -- 172.21.15.104:0/126442700 shutdown_connections 2023-09-13T02:12:25.566 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.558+0000 7fd5c961f640 1 -- 172.21.15.104:0/126442700 wait complete. 2023-09-13T02:12:25.566 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.559+0000 7fd5c961f640 1 Processor -- start 2023-09-13T02:12:25.566 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.559+0000 7fd5c961f640 1 -- start start 2023-09-13T02:12:25.567 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5c961f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5c406def0 0x7fd5c4143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:25.567 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5c961f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5c40aefb0 0x7fd5c4144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:25.567 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5c961f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5c4145ec0 0x7fd5c41343f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:25.567 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5c961f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c4133f60 con 0x7fd5c4145ec0 2023-09-13T02:12:25.568 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5c961f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c4133c50 con 0x7fd5c406def0 2023-09-13T02:12:25.568 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5c961f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c406f900 con 0x7fd5c40aefb0 2023-09-13T02:12:25.568 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5c37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5c4145ec0 0x7fd5c41343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:25.569 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5c37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5c4145ec0 0x7fd5c41343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52060/0 (socket says 172.21.15.104:52060) 2023-09-13T02:12:25.569 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5c37fe640 1 -- 172.21.15.104:0/1061362490 learned_addr learned my addr 172.21.15.104:0/1061362490 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:25.569 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5bbfff640 1 --2- 172.21.15.104:0/1061362490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5c40aefb0 0x7fd5c4144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:25.570 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5c2ffd640 1 --2- 172.21.15.104:0/1061362490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5c406def0 0x7fd5c4143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:25.570 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5c37fe640 1 -- 172.21.15.104:0/1061362490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5c40aefb0 msgr2=0x7fd5c4144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:25.571 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5c37fe640 1 --2- 172.21.15.104:0/1061362490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5c40aefb0 0x7fd5c4144000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.571 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5c37fe640 1 -- 172.21.15.104:0/1061362490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5c406def0 msgr2=0x7fd5c4143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:25.571 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5c37fe640 1 --2- 172.21.15.104:0/1061362490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5c406def0 0x7fd5c4143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.572 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5c37fe640 1 -- 172.21.15.104:0/1061362490 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac009490 con 0x7fd5c4145ec0 2023-09-13T02:12:25.572 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5c37fe640 1 --2- 172.21.15.104:0/1061362490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5c4145ec0 0x7fd5c41343f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00cad0 tx=0x7fd5bc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:25.572 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5bb7fe640 1 -- 172.21.15.104:0/1061362490 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00ae20 con 0x7fd5c4145ec0 2023-09-13T02:12:25.573 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.560+0000 7fd5bb7fe640 1 -- 172.21.15.104:0/1061362490 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd5bc00f450 con 0x7fd5c4145ec0 2023-09-13T02:12:25.573 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.561+0000 7fd5bb7fe640 1 -- 172.21.15.104:0/1061362490 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00f8c0 con 0x7fd5c4145ec0 2023-09-13T02:12:25.573 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.561+0000 7fd5c961f640 1 -- 172.21.15.104:0/1061362490 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c4144a50 con 0x7fd5c4145ec0 2023-09-13T02:12:25.574 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.561+0000 7fd5c961f640 1 -- 172.21.15.104:0/1061362490 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c4143aa0 con 0x7fd5c4145ec0 2023-09-13T02:12:25.574 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.561+0000 7fd5c961f640 1 -- 172.21.15.104:0/1061362490 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c41340d0 con 0x7fd5c4145ec0 2023-09-13T02:12:25.575 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.562+0000 7fd5bb7fe640 1 -- 172.21.15.104:0/1061362490 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd5bc00fa20 con 0x7fd5c4145ec0 2023-09-13T02:12:25.575 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.562+0000 7fd5bb7fe640 1 --2- 172.21.15.104:0/1061362490 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd5a406a4f0 0x7fd5a406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:25.575 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.562+0000 7fd5c2ffd640 1 --2- 172.21.15.104:0/1061362490 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd5a406a4f0 0x7fd5a406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:25.576 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.562+0000 7fd5bb7fe640 1 -- 172.21.15.104:0/1061362490 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5bc0894a0 con 0x7fd5c4145ec0 2023-09-13T02:12:25.576 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.563+0000 7fd5c2ffd640 1 --2- 172.21.15.104:0/1061362490 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd5a406a4f0 0x7fd5a406c9b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4000f60 tx=0x7fd5b4009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:25.577 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.566+0000 7fd5bb7fe640 1 -- 172.21.15.104:0/1061362490 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd5bc054b60 con 0x7fd5c4145ec0 2023-09-13T02:12:25.773 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.772+0000 7fd5c961f640 1 -- 172.21.15.104:0/1061362490 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd5c404e100 con 0x7fd5c4145ec0 2023-09-13T02:12:25.851 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.850+0000 7fd5bb7fe640 1 -- 172.21.15.104:0/1061362490 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd5bc058180 con 0x7fd5c4145ec0 2023-09-13T02:12:25.853 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.852+0000 7fd5c961f640 1 -- 172.21.15.104:0/1061362490 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd5a406a4f0 msgr2=0x7fd5a406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:25.853 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.852+0000 7fd5c961f640 1 --2- 172.21.15.104:0/1061362490 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd5a406a4f0 0x7fd5a406c9b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4000f60 tx=0x7fd5b4009040 comp rx=0 tx=0).stop 2023-09-13T02:12:25.854 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.852+0000 7fd5c961f640 1 -- 172.21.15.104:0/1061362490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5c4145ec0 msgr2=0x7fd5c41343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:25.854 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.852+0000 7fd5c961f640 1 --2- 172.21.15.104:0/1061362490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5c4145ec0 0x7fd5c41343f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00cad0 tx=0x7fd5bc00cf90 comp rx=0 tx=0).stop 2023-09-13T02:12:25.854 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.852+0000 7fd5c961f640 1 -- 172.21.15.104:0/1061362490 shutdown_connections 2023-09-13T02:12:25.854 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.852+0000 7fd5c961f640 1 --2- 172.21.15.104:0/1061362490 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd5a406a4f0 0x7fd5a406c9b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.854 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.852+0000 7fd5c961f640 1 --2- 172.21.15.104:0/1061362490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5c4145ec0 0x7fd5c41343f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.852+0000 7fd5c961f640 1 --2- 172.21.15.104:0/1061362490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5c40aefb0 0x7fd5c4144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.852+0000 7fd5c961f640 1 --2- 172.21.15.104:0/1061362490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5c406def0 0x7fd5c4143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.852+0000 7fd5c961f640 1 -- 172.21.15.104:0/1061362490 >> 172.21.15.104:0/1061362490 conn(0x7fd5c40b56f0 msgr2=0x7fd5c41401a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:25.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.852+0000 7fd5c961f640 1 -- 172.21.15.104:0/1061362490 shutdown_connections 2023-09-13T02:12:25.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.852+0000 7fd5c961f640 1 -- 172.21.15.104:0/1061362490 wait complete. 2023-09-13T02:12:25.863 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-13T02:12:25.864 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-13T02:12:25.972 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.966+0000 7f949bf3b640 1 -- 172.21.15.104:0/3055860449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94940b08c0 msgr2=0x7f9494141f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:25.973 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.966+0000 7f949bf3b640 1 --2- 172.21.15.104:0/3055860449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94940b08c0 0x7f9494141f50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f94940b0610 tx=0x7f949002bc80 comp rx=0 tx=0).stop 2023-09-13T02:12:25.973 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.966+0000 7f949bf3b640 1 -- 172.21.15.104:0/3055860449 shutdown_connections 2023-09-13T02:12:25.973 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.966+0000 7f949bf3b640 1 --2- 172.21.15.104:0/3055860449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94940b08c0 0x7f9494141f50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.974 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.966+0000 7f949bf3b640 1 --2- 172.21.15.104:0/3055860449 >> v2:172.21.15.119:3300/0 conn(0x7f94940b1810 0x7f949413c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.974 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.966+0000 7f949bf3b640 1 -- 172.21.15.104:0/3055860449 >> 172.21.15.104:0/3055860449 conn(0x7f9494069360 msgr2=0x7f9494069740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:25.974 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.966+0000 7f949bf3b640 1 -- 172.21.15.104:0/3055860449 shutdown_connections 2023-09-13T02:12:25.974 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.966+0000 7f949bf3b640 1 -- 172.21.15.104:0/3055860449 wait complete. 2023-09-13T02:12:25.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.967+0000 7f949bf3b640 1 Processor -- start 2023-09-13T02:12:25.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.967+0000 7f949bf3b640 1 -- start start 2023-09-13T02:12:25.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.967+0000 7f949bf3b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f949406d4f0 0x7f94940b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:25.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.967+0000 7f949bf3b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94940b1810 0x7f94941ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:25.976 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.967+0000 7f949bf3b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94941cbdd0 0x7f94941ddf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:25.976 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.967+0000 7f949bf3b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94940b5190 con 0x7f94941cbdd0 2023-09-13T02:12:25.976 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.967+0000 7f949bf3b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94940b4610 con 0x7f94940b1810 2023-09-13T02:12:25.976 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.967+0000 7f949bf3b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94940b48f0 con 0x7f949406d4f0 2023-09-13T02:12:25.976 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.968+0000 7f949a4d8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94941cbdd0 0x7f94941ddf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:25.977 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.968+0000 7f949a4d8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94941cbdd0 0x7f94941ddf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52070/0 (socket says 172.21.15.104:52070) 2023-09-13T02:12:25.977 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.968+0000 7f949a4d8640 1 -- 172.21.15.104:0/4043471065 learned_addr learned my addr 172.21.15.104:0/4043471065 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:25.977 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.968+0000 7f9499cd7640 1 --2- 172.21.15.104:0/4043471065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f949406d4f0 0x7f94940b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:25.977 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.968+0000 7f94994d6640 1 --2- 172.21.15.104:0/4043471065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94940b1810 0x7f94941ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:25.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.968+0000 7f949a4d8640 1 -- 172.21.15.104:0/4043471065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f949406d4f0 msgr2=0x7f94940b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:25.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.968+0000 7f949a4d8640 1 --2- 172.21.15.104:0/4043471065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f949406d4f0 0x7f94940b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.968+0000 7f949a4d8640 1 -- 172.21.15.104:0/4043471065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94940b1810 msgr2=0x7f94941ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:25.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.968+0000 7f949a4d8640 1 --2- 172.21.15.104:0/4043471065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94940b1810 0x7f94941ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:25.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.968+0000 7f949a4d8640 1 -- 172.21.15.104:0/4043471065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9490009560 con 0x7f94941cbdd0 2023-09-13T02:12:25.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.968+0000 7f94994d6640 1 --2- 172.21.15.104:0/4043471065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94940b1810 0x7f94941ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:25.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.968+0000 7f949a4d8640 1 --2- 172.21.15.104:0/4043471065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94941cbdd0 0x7f94941ddf70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f948c00c780 tx=0x7f948c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:25.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.968+0000 7f948a7fc640 1 -- 172.21.15.104:0/4043471065 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c003d80 con 0x7f94941cbdd0 2023-09-13T02:12:25.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.968+0000 7f948a7fc640 1 -- 172.21.15.104:0/4043471065 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f948c00ce30 con 0x7f94941cbdd0 2023-09-13T02:12:25.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.968+0000 7f949bf3b640 1 -- 172.21.15.104:0/4043471065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94941cd170 con 0x7f94941cbdd0 2023-09-13T02:12:25.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.968+0000 7f948a7fc640 1 -- 172.21.15.104:0/4043471065 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c0052d0 con 0x7f94941cbdd0 2023-09-13T02:12:25.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.968+0000 7f949bf3b640 1 -- 172.21.15.104:0/4043471065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94941dd930 con 0x7f94941cbdd0 2023-09-13T02:12:25.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.969+0000 7f949bf3b640 1 -- 172.21.15.104:0/4043471065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949404e100 con 0x7f94941cbdd0 2023-09-13T02:12:25.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.970+0000 7f948a7fc640 1 -- 172.21.15.104:0/4043471065 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f948c005430 con 0x7f94941cbdd0 2023-09-13T02:12:25.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.970+0000 7f948a7fc640 1 --2- 172.21.15.104:0/4043471065 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f947806a520 0x7f947806c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:25.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.970+0000 7f9499cd7640 1 --2- 172.21.15.104:0/4043471065 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f947806a520 0x7f947806c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:25.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.970+0000 7f948a7fc640 1 -- 172.21.15.104:0/4043471065 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f948c087fc0 con 0x7f94941cbdd0 2023-09-13T02:12:25.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.970+0000 7f9499cd7640 1 --2- 172.21.15.104:0/4043471065 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f947806a520 0x7f947806c9e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f948400b810 tx=0x7f9484008040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:25.983 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:25.974+0000 7f948a7fc640 1 -- 172.21.15.104:0/4043471065 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f948c0ba9b0 con 0x7f94941cbdd0 2023-09-13T02:12:26.178 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.177+0000 7f949bf3b640 1 -- 172.21.15.104:0/4043471065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f949413a460 con 0x7f94941cbdd0 2023-09-13T02:12:26.858 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.857+0000 7f948a7fc640 1 -- 172.21.15.104:0/4043471065 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f948c0535d0 con 0x7f94941cbdd0 2023-09-13T02:12:26.860 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.859+0000 7f949bf3b640 1 -- 172.21.15.104:0/4043471065 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f947806a520 msgr2=0x7f947806c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:26.861 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.859+0000 7f949bf3b640 1 --2- 172.21.15.104:0/4043471065 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f947806a520 0x7f947806c9e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f948400b810 tx=0x7f9484008040 comp rx=0 tx=0).stop 2023-09-13T02:12:26.861 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.859+0000 7f949bf3b640 1 -- 172.21.15.104:0/4043471065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94941cbdd0 msgr2=0x7f94941ddf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:26.861 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.859+0000 7f949bf3b640 1 --2- 172.21.15.104:0/4043471065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94941cbdd0 0x7f94941ddf70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f948c00c780 tx=0x7f948c00cc40 comp rx=0 tx=0).stop 2023-09-13T02:12:26.861 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.859+0000 7f949bf3b640 1 -- 172.21.15.104:0/4043471065 shutdown_connections 2023-09-13T02:12:26.861 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.859+0000 7f949bf3b640 1 --2- 172.21.15.104:0/4043471065 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f947806a520 0x7f947806c9e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:26.862 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.859+0000 7f949bf3b640 1 --2- 172.21.15.104:0/4043471065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94941cbdd0 0x7f94941ddf70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:26.862 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.859+0000 7f949bf3b640 1 --2- 172.21.15.104:0/4043471065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94940b1810 0x7f94941ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:26.862 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.859+0000 7f949bf3b640 1 --2- 172.21.15.104:0/4043471065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f949406d4f0 0x7f94940b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:26.862 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.859+0000 7f949bf3b640 1 -- 172.21.15.104:0/4043471065 >> 172.21.15.104:0/4043471065 conn(0x7f9494069360 msgr2=0x7f94940b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:26.862 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.859+0000 7f949bf3b640 1 -- 172.21.15.104:0/4043471065 shutdown_connections 2023-09-13T02:12:26.863 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.859+0000 7f949bf3b640 1 -- 172.21.15.104:0/4043471065 wait complete. 2023-09-13T02:12:26.873 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-13T02:12:26.874 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T02:12:26.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.980+0000 7f650887c640 1 -- 172.21.15.104:0/198082109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65040ae750 msgr2=0x7f650414c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:26.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.980+0000 7f650887c640 1 --2- 172.21.15.104:0/198082109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65040ae750 0x7f650414c8b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f64fc005fd0 tx=0x7f64fc02c050 comp rx=0 tx=0).stop 2023-09-13T02:12:26.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.980+0000 7f650887c640 1 -- 172.21.15.104:0/198082109 shutdown_connections 2023-09-13T02:12:26.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.980+0000 7f650887c640 1 --2- 172.21.15.104:0/198082109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65040ae750 0x7f650414c8b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:26.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.980+0000 7f650887c640 1 -- 172.21.15.104:0/198082109 >> 172.21.15.104:0/198082109 conn(0x7f65040b67f0 msgr2=0x7f65040b6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:26.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.980+0000 7f650887c640 1 -- 172.21.15.104:0/198082109 shutdown_connections 2023-09-13T02:12:26.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.980+0000 7f650887c640 1 -- 172.21.15.104:0/198082109 wait complete. 2023-09-13T02:12:26.985 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.981+0000 7f650887c640 1 Processor -- start 2023-09-13T02:12:26.985 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.981+0000 7f650887c640 1 -- start start 2023-09-13T02:12:26.985 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.981+0000 7f650887c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65040ae750 0x7f65041342c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:26.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.981+0000 7f650887c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65040af880 0x7f6504140c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:26.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.981+0000 7f650887c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6504144780 0x7f6504141150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:26.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.981+0000 7f650887c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650413ed90 con 0x7f65040ae750 2023-09-13T02:12:26.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.981+0000 7f650887c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650413efe0 con 0x7f6504144780 2023-09-13T02:12:26.987 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.981+0000 7f650887c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650413fde0 con 0x7f65040af880 2023-09-13T02:12:26.987 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f650259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65040ae750 0x7f65041342c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:26.987 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f650259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65040ae750 0x7f65041342c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46974/0 (socket says 172.21.15.104:46974) 2023-09-13T02:12:26.987 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f650259c640 1 -- 172.21.15.104:0/3252564382 learned_addr learned my addr 172.21.15.104:0/3252564382 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:26.989 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f6501d9b640 1 --2- 172.21.15.104:0/3252564382 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65040af880 0x7f6504140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:26.989 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f650259c640 1 -- 172.21.15.104:0/3252564382 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65040af880 msgr2=0x7f6504140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:26.989 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f6502d9d640 1 --2- 172.21.15.104:0/3252564382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6504144780 0x7f6504141150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:26.989 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f650259c640 1 --2- 172.21.15.104:0/3252564382 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65040af880 0x7f6504140c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:26.990 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f650259c640 1 -- 172.21.15.104:0/3252564382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6504144780 msgr2=0x7f6504141150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:26.990 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f650259c640 1 --2- 172.21.15.104:0/3252564382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6504144780 0x7f6504141150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:26.990 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f650259c640 1 -- 172.21.15.104:0/3252564382 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc009840 con 0x7f65040ae750 2023-09-13T02:12:26.990 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f6501d9b640 1 --2- 172.21.15.104:0/3252564382 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65040af880 0x7f6504140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:12:26.990 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f6502d9d640 1 --2- 172.21.15.104:0/3252564382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6504144780 0x7f6504141150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:12:26.991 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f650259c640 1 --2- 172.21.15.104:0/3252564382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65040ae750 0x7f65041342c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f64f400b410 tx=0x7f64f400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:26.991 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f64f2ffd640 1 -- 172.21.15.104:0/3252564382 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f4011830 con 0x7f65040ae750 2023-09-13T02:12:26.991 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f64f2ffd640 1 -- 172.21.15.104:0/3252564382 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f64f4011a80 con 0x7f65040ae750 2023-09-13T02:12:26.991 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f650887c640 1 -- 172.21.15.104:0/3252564382 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65041406f0 con 0x7f65040ae750 2023-09-13T02:12:26.992 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f64f2ffd640 1 -- 172.21.15.104:0/3252564382 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f4011e90 con 0x7f65040ae750 2023-09-13T02:12:26.992 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.982+0000 7f650887c640 1 -- 172.21.15.104:0/3252564382 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65041330f0 con 0x7f65040ae750 2023-09-13T02:12:26.992 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.983+0000 7f650887c640 1 -- 172.21.15.104:0/3252564382 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6504140550 con 0x7f65040ae750 2023-09-13T02:12:26.992 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.983+0000 7f64f2ffd640 1 -- 172.21.15.104:0/3252564382 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f64f401a400 con 0x7f65040ae750 2023-09-13T02:12:26.992 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.984+0000 7f64f2ffd640 1 --2- 172.21.15.104:0/3252564382 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f64e406a4f0 0x7f64e406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:26.993 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.984+0000 7f6501d9b640 1 --2- 172.21.15.104:0/3252564382 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f64e406a4f0 0x7f64e406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:26.993 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.984+0000 7f64f2ffd640 1 -- 172.21.15.104:0/3252564382 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64f4088e60 con 0x7f65040ae750 2023-09-13T02:12:26.993 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.984+0000 7f6501d9b640 1 --2- 172.21.15.104:0/3252564382 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f64e406a4f0 0x7f64e406c9b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f64f8007fd0 tx=0x7f64f8009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:26.993 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:26.988+0000 7f64f2ffd640 1 -- 172.21.15.104:0/3252564382 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6504140550 con 0x7f65040ae750 2023-09-13T02:12:27.194 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.191+0000 7f650887c640 1 -- 172.21.15.104:0/3252564382 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6504140550 con 0x7f65040ae750 2023-09-13T02:12:27.195 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.191+0000 7f64f2ffd640 1 -- 172.21.15.104:0/3252564382 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3330 (secure 0 0 0) 0x7f6504140550 con 0x7f65040ae750 2023-09-13T02:12:27.195 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:27.195 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/811188307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":811188307},{"type":"v1","addr":"172.21.15.119:6833","nonce":811188307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T02:12:23.916322+0000","modified":"2023-09-13T02:12:26.178874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1426622388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1426622388},{"type":"v1","addr":"172.21.15.104:6835","nonce":1426622388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T02:12:27.196 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 6 2023-09-13T02:12:27.197 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.193+0000 7f650887c640 1 -- 172.21.15.104:0/3252564382 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f64e406a4f0 msgr2=0x7f64e406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:27.197 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.193+0000 7f650887c640 1 --2- 172.21.15.104:0/3252564382 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f64e406a4f0 0x7f64e406c9b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f64f8007fd0 tx=0x7f64f8009040 comp rx=0 tx=0).stop 2023-09-13T02:12:27.197 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.193+0000 7f650887c640 1 -- 172.21.15.104:0/3252564382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65040ae750 msgr2=0x7f65041342c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:27.197 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.193+0000 7f650887c640 1 --2- 172.21.15.104:0/3252564382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65040ae750 0x7f65041342c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f64f400b410 tx=0x7f64f400b8d0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.198 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.193+0000 7f650887c640 1 -- 172.21.15.104:0/3252564382 shutdown_connections 2023-09-13T02:12:27.198 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.193+0000 7f650887c640 1 --2- 172.21.15.104:0/3252564382 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f64e406a4f0 0x7f64e406c9b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.198 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.193+0000 7f650887c640 1 --2- 172.21.15.104:0/3252564382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6504144780 0x7f6504141150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.198 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.193+0000 7f650887c640 1 --2- 172.21.15.104:0/3252564382 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65040af880 0x7f6504140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.199 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.193+0000 7f650887c640 1 --2- 172.21.15.104:0/3252564382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65040ae750 0x7f65041342c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.199 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.193+0000 7f650887c640 1 -- 172.21.15.104:0/3252564382 >> 172.21.15.104:0/3252564382 conn(0x7f65040b67f0 msgr2=0x7f6504143130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:27.199 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.193+0000 7f650887c640 1 -- 172.21.15.104:0/3252564382 shutdown_connections 2023-09-13T02:12:27.199 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.193+0000 7f650887c640 1 -- 172.21.15.104:0/3252564382 wait complete. 2023-09-13T02:12:27.205 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T02:12:27.306 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.305+0000 7f0a5cd73640 1 -- 172.21.15.104:0/4106084431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a580b00f0 msgr2=0x7f0a580b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:27.307 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.305+0000 7f0a5cd73640 1 --2- 172.21.15.104:0/4106084431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a580b00f0 0x7f0a580b13d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009830 tx=0x7f0a4c02bcd0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.307 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.305+0000 7f0a5cd73640 1 -- 172.21.15.104:0/4106084431 shutdown_connections 2023-09-13T02:12:27.307 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.305+0000 7f0a5cd73640 1 --2- 172.21.15.104:0/4106084431 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a5813c0f0 0x7f0a58145b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.307 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.305+0000 7f0a5cd73640 1 --2- 172.21.15.104:0/4106084431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a580b00f0 0x7f0a580b13d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.308 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.305+0000 7f0a5cd73640 1 -- 172.21.15.104:0/4106084431 >> 172.21.15.104:0/4106084431 conn(0x7f0a580b67f0 msgr2=0x7f0a580b6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:27.308 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.305+0000 7f0a5cd73640 1 -- 172.21.15.104:0/4106084431 shutdown_connections 2023-09-13T02:12:27.308 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.305+0000 7f0a5cd73640 1 -- 172.21.15.104:0/4106084431 wait complete. 2023-09-13T02:12:27.311 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.306+0000 7f0a5cd73640 1 Processor -- start 2023-09-13T02:12:27.311 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.306+0000 7f0a5cd73640 1 -- start start 2023-09-13T02:12:27.311 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a5cd73640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a580b00f0 0x7f0a581db880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:27.312 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a5cd73640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a5813c0f0 0x7f0a581dc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:27.312 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a5cd73640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a58145650 0x7f0a580b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:27.312 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a5cd73640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a58145380 con 0x7f0a58145650 2023-09-13T02:12:27.312 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a5cd73640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580b66a0 con 0x7f0a5813c0f0 2023-09-13T02:12:27.312 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a5cd73640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a58144400 con 0x7f0a580b00f0 2023-09-13T02:12:27.313 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a56d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a58145650 0x7f0a580b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:27.313 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a56d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a58145650 0x7f0a580b5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47004/0 (socket says 172.21.15.104:47004) 2023-09-13T02:12:27.313 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a56d9d640 1 -- 172.21.15.104:0/764674957 learned_addr learned my addr 172.21.15.104:0/764674957 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:27.313 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a5659c640 1 --2- 172.21.15.104:0/764674957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a580b00f0 0x7f0a581db880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:27.313 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a56d9d640 1 -- 172.21.15.104:0/764674957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a580b00f0 msgr2=0x7f0a581db880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:27.313 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a55d9b640 1 --2- 172.21.15.104:0/764674957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a5813c0f0 0x7f0a581dc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:27.314 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a56d9d640 1 --2- 172.21.15.104:0/764674957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a580b00f0 0x7f0a581db880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.314 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a56d9d640 1 -- 172.21.15.104:0/764674957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a5813c0f0 msgr2=0x7f0a581dc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:27.314 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a56d9d640 1 --2- 172.21.15.104:0/764674957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a5813c0f0 0x7f0a581dc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.314 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a56d9d640 1 -- 172.21.15.104:0/764674957 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c009490 con 0x7f0a58145650 2023-09-13T02:12:27.314 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a5659c640 1 --2- 172.21.15.104:0/764674957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a580b00f0 0x7f0a581db880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:12:27.315 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a55d9b640 1 --2- 172.21.15.104:0/764674957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a5813c0f0 0x7f0a581dc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:12:27.315 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a56d9d640 1 --2- 172.21.15.104:0/764674957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a58145650 0x7f0a580b5390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000eb10 tx=0x7f0a5000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:27.315 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a46ffd640 1 -- 172.21.15.104:0/764674957 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50004b20 con 0x7f0a58145650 2023-09-13T02:12:27.315 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a46ffd640 1 -- 172.21.15.104:0/764674957 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0a50004ca0 con 0x7f0a58145650 2023-09-13T02:12:27.316 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a5cd73640 1 -- 172.21.15.104:0/764674957 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a58144d70 con 0x7f0a58145650 2023-09-13T02:12:27.316 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a46ffd640 1 -- 172.21.15.104:0/764674957 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50005280 con 0x7f0a58145650 2023-09-13T02:12:27.316 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.307+0000 7f0a5cd73640 1 -- 172.21.15.104:0/764674957 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a58144fa0 con 0x7f0a58145650 2023-09-13T02:12:27.316 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.308+0000 7f0a5cd73640 1 -- 172.21.15.104:0/764674957 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a58144660 con 0x7f0a58145650 2023-09-13T02:12:27.316 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.309+0000 7f0a46ffd640 1 -- 172.21.15.104:0/764674957 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f0a500053e0 con 0x7f0a58145650 2023-09-13T02:12:27.317 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.309+0000 7f0a46ffd640 1 --2- 172.21.15.104:0/764674957 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0a3806a4f0 0x7f0a3806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:27.317 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.309+0000 7f0a46ffd640 1 -- 172.21.15.104:0/764674957 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a50014070 con 0x7f0a58145650 2023-09-13T02:12:27.317 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.309+0000 7f0a5659c640 1 --2- 172.21.15.104:0/764674957 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0a3806a4f0 0x7f0a3806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:27.317 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.309+0000 7f0a5659c640 1 --2- 172.21.15.104:0/764674957 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0a3806a4f0 0x7f0a3806c9b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c036000 tx=0x7f0a4c004730 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:27.318 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.313+0000 7f0a46ffd640 1 -- 172.21.15.104:0/764674957 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0a50054d50 con 0x7f0a58145650 2023-09-13T02:12:27.482 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.481+0000 7f0a5cd73640 1 -- 172.21.15.104:0/764674957 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a5804e100 con 0x7f0a58145650 2023-09-13T02:12:27.483 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.482+0000 7f0a46ffd640 1 -- 172.21.15.104:0/764674957 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f0a50058370 con 0x7f0a58145650 2023-09-13T02:12:27.483 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:27.484 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"ac1f5a95-0d3a-406e-b4ca-c8ea43282cab","created":"2023-09-13T02:11:59.067178+0000","modified":"2023-09-13T02:12:25.572652+0000","last_up_change":"2023-09-13T02:12:11.207888+0000","last_in_change":"2023-09-13T02:12:02.278796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T02:12:12.071023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T02:12:22.114609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T02:12:22.880593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67190066-4851-4b1f-aae8-bad59e79ebb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6801","nonce":3271772377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6803","nonce":3271772377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6807","nonce":3271772377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6805","nonce":3271772377}]},"public_addr":"172.21.15.104:6801/3271772377","cluster_addr":"172.21.15.104:6803/3271772377","heartbeat_back_addr":"172.21.15.104:6807/3271772377","heartbeat_front_addr":"172.21.15.104:6805/3271772377","state":["exists","up"]},{"osd":1,"uuid":"f1907075-bb97-4a19-8dd6-322232caaf4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6809","nonce":3786698894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6811","nonce":3786698894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6815","nonce":3786698894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6813","nonce":3786698894}]},"public_addr":"172.21.15.104:6809/3786698894","cluster_addr":"172.21.15.104:6811/3786698894","heartbeat_back_addr":"172.21.15.104:6815/3786698894","heartbeat_front_addr":"172.21.15.104:6813/3786698894","state":["exists","up"]},{"osd":2,"uuid":"8c323c83-330c-4181-b622-10177c81f975","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6819","nonce":2319361072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6822","nonce":2319361072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6827","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6829","nonce":2319361072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6826","nonce":2319361072}]},"public_addr":"172.21.15.104:6819/2319361072","cluster_addr":"172.21.15.104:6822/2319361072","heartbeat_back_addr":"172.21.15.104:6829/2319361072","heartbeat_front_addr":"172.21.15.104:6826/2319361072","state":["exists","up"]},{"osd":3,"uuid":"811457f5-c408-488d-a4ed-b947d1c55e82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6818","nonce":621253853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6823","nonce":621253853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6831","nonce":621253853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6825","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6828","nonce":621253853}]},"public_addr":"172.21.15.104:6818/621253853","cluster_addr":"172.21.15.104:6823/621253853","heartbeat_back_addr":"172.21.15.104:6831/621253853","heartbeat_front_addr":"172.21.15.104:6828/621253853","state":["exists","up"]},{"osd":4,"uuid":"552010ea-7d61-47c7-b4ac-657845e55e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6801","nonce":3049794634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6803","nonce":3049794634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6807","nonce":3049794634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6805","nonce":3049794634}]},"public_addr":"172.21.15.119:6801/3049794634","cluster_addr":"172.21.15.119:6803/3049794634","heartbeat_back_addr":"172.21.15.119:6807/3049794634","heartbeat_front_addr":"172.21.15.119:6805/3049794634","state":["exists","up"]},{"osd":5,"uuid":"41f415b0-6886-44ed-bccc-57c46cc975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6809","nonce":2918159428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6811","nonce":2918159428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6815","nonce":2918159428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6813","nonce":2918159428}]},"public_addr":"172.21.15.119:6809/2918159428","cluster_addr":"172.21.15.119:6811/2918159428","heartbeat_back_addr":"172.21.15.119:6815/2918159428","heartbeat_front_addr":"172.21.15.119:6813/2918159428","state":["exists","up"]},{"osd":6,"uuid":"1f415570-dbcc-4cb9-930a-ad31a96c3ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6825","nonce":3509665357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6827","nonce":3509665357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6831","nonce":3509665357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6829","nonce":3509665357}]},"public_addr":"172.21.15.119:6825/3509665357","cluster_addr":"172.21.15.119:6827/3509665357","heartbeat_back_addr":"172.21.15.119:6831/3509665357","heartbeat_front_addr":"172.21.15.119:6829/3509665357","state":["exists","up"]},{"osd":7,"uuid":"ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6817","nonce":892749725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6819","nonce":892749725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6823","nonce":892749725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6821","nonce":892749725}]},"public_addr":"172.21.15.119:6817/892749725","cluster_addr":"172.21.15.119:6819/892749725","heartbeat_back_addr":"172.21.15.119:6823/892749725","heartbeat_front_addr":"172.21.15.119:6821/892749725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.489481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.468615+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.485958+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.424425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.456308+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.427607+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T02:12:27.486 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.484+0000 7f0a5cd73640 1 -- 172.21.15.104:0/764674957 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0a3806a4f0 msgr2=0x7f0a3806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:27.486 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.484+0000 7f0a5cd73640 1 --2- 172.21.15.104:0/764674957 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0a3806a4f0 0x7f0a3806c9b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c036000 tx=0x7f0a4c004730 comp rx=0 tx=0).stop 2023-09-13T02:12:27.486 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.484+0000 7f0a5cd73640 1 -- 172.21.15.104:0/764674957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a58145650 msgr2=0x7f0a580b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:27.486 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.484+0000 7f0a5cd73640 1 --2- 172.21.15.104:0/764674957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a58145650 0x7f0a580b5390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000eb10 tx=0x7f0a5000c2d0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.487 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.484+0000 7f0a5cd73640 1 -- 172.21.15.104:0/764674957 shutdown_connections 2023-09-13T02:12:27.487 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.484+0000 7f0a5cd73640 1 --2- 172.21.15.104:0/764674957 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0a3806a4f0 0x7f0a3806c9b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.487 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.484+0000 7f0a5cd73640 1 --2- 172.21.15.104:0/764674957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a58145650 0x7f0a580b5390 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.487 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.484+0000 7f0a5cd73640 1 --2- 172.21.15.104:0/764674957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a5813c0f0 0x7f0a581dc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.487 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.484+0000 7f0a5cd73640 1 --2- 172.21.15.104:0/764674957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a580b00f0 0x7f0a581db880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.488 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.484+0000 7f0a5cd73640 1 -- 172.21.15.104:0/764674957 >> 172.21.15.104:0/764674957 conn(0x7f0a580b67f0 msgr2=0x7f0a5813ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:27.488 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.484+0000 7f0a5cd73640 1 -- 172.21.15.104:0/764674957 shutdown_connections 2023-09-13T02:12:27.488 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.484+0000 7f0a5cd73640 1 -- 172.21.15.104:0/764674957 wait complete. 2023-09-13T02:12:27.496 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-13T02:12:27.496 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T02:12:27.598 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.596+0000 7fed3c832640 1 -- 172.21.15.104:0/3674800892 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed38144ea0 msgr2=0x7fed38145310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:27.598 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.596+0000 7fed3c832640 1 --2- 172.21.15.104:0/3674800892 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed38144ea0 0x7fed38145310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fed30005fd0 tx=0x7fed3002c240 comp rx=0 tx=0).stop 2023-09-13T02:12:27.598 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.596+0000 7fed3c832640 1 -- 172.21.15.104:0/3674800892 shutdown_connections 2023-09-13T02:12:27.599 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.596+0000 7fed3c832640 1 --2- 172.21.15.104:0/3674800892 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed38144ea0 0x7fed38145310 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.599 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.596+0000 7fed3c832640 1 --2- 172.21.15.104:0/3674800892 >> v2:172.21.15.119:3300/0 conn(0x7fed380b66c0 0x7fed380acc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.599 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.596+0000 7fed3c832640 1 -- 172.21.15.104:0/3674800892 >> 172.21.15.104:0/3674800892 conn(0x7fed380708b0 msgr2=0x7fed38070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:27.601 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.596+0000 7fed3c832640 1 -- 172.21.15.104:0/3674800892 shutdown_connections 2023-09-13T02:12:27.601 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.596+0000 7fed3c832640 1 -- 172.21.15.104:0/3674800892 wait complete. 2023-09-13T02:12:27.604 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.598+0000 7fed3c832640 1 Processor -- start 2023-09-13T02:12:27.604 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.598+0000 7fed3c832640 1 -- start start 2023-09-13T02:12:27.604 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.598+0000 7fed3c832640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed380ad140 0x7fed380b8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:27.604 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.598+0000 7fed3c832640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed380b66c0 0x7fed381dd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:27.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.598+0000 7fed3c832640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed38144ea0 0x7fed38134000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:27.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.598+0000 7fed3c832640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed38136d20 con 0x7fed380ad140 2023-09-13T02:12:27.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.598+0000 7fed3c832640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed38135490 con 0x7fed38144ea0 2023-09-13T02:12:27.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.598+0000 7fed3c832640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed38135730 con 0x7fed380b66c0 2023-09-13T02:12:27.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.598+0000 7fed3659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed380ad140 0x7fed380b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:27.606 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.598+0000 7fed3659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed380ad140 0x7fed380b8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47018/0 (socket says 172.21.15.104:47018) 2023-09-13T02:12:27.606 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.598+0000 7fed3659c640 1 -- 172.21.15.104:0/2790609834 learned_addr learned my addr 172.21.15.104:0/2790609834 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:27.606 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.598+0000 7fed35d9b640 1 --2- 172.21.15.104:0/2790609834 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed380b66c0 0x7fed381dd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:27.606 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.598+0000 7fed36d9d640 1 --2- 172.21.15.104:0/2790609834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed38144ea0 0x7fed38134000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:27.607 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.599+0000 7fed3659c640 1 -- 172.21.15.104:0/2790609834 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed380b66c0 msgr2=0x7fed381dd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:27.607 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.599+0000 7fed3659c640 1 --2- 172.21.15.104:0/2790609834 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed380b66c0 0x7fed381dd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.607 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.599+0000 7fed3659c640 1 -- 172.21.15.104:0/2790609834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed38144ea0 msgr2=0x7fed38134000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:27.607 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.599+0000 7fed3659c640 1 --2- 172.21.15.104:0/2790609834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed38144ea0 0x7fed38134000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.607 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.599+0000 7fed3659c640 1 -- 172.21.15.104:0/2790609834 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed30009900 con 0x7fed380ad140 2023-09-13T02:12:27.608 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.599+0000 7fed3659c640 1 --2- 172.21.15.104:0/2790609834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed380ad140 0x7fed380b8260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00e9f0 tx=0x7fed2c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:27.608 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.599+0000 7fed26ffd640 1 -- 172.21.15.104:0/2790609834 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c009700 con 0x7fed380ad140 2023-09-13T02:12:27.608 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.599+0000 7fed26ffd640 1 -- 172.21.15.104:0/2790609834 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fed2c00ce70 con 0x7fed380ad140 2023-09-13T02:12:27.608 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.599+0000 7fed3c832640 1 -- 172.21.15.104:0/2790609834 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed38136f70 con 0x7fed380ad140 2023-09-13T02:12:27.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.599+0000 7fed26ffd640 1 -- 172.21.15.104:0/2790609834 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c010670 con 0x7fed380ad140 2023-09-13T02:12:27.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.599+0000 7fed3c832640 1 -- 172.21.15.104:0/2790609834 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3813be90 con 0x7fed380ad140 2023-09-13T02:12:27.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.600+0000 7fed3c832640 1 -- 172.21.15.104:0/2790609834 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed381358f0 con 0x7fed380ad140 2023-09-13T02:12:27.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.600+0000 7fed26ffd640 1 -- 172.21.15.104:0/2790609834 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fed2c0107d0 con 0x7fed380ad140 2023-09-13T02:12:27.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.601+0000 7fed26ffd640 1 --2- 172.21.15.104:0/2790609834 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fed1806a520 0x7fed1806c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:27.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.601+0000 7fed35d9b640 1 --2- 172.21.15.104:0/2790609834 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fed1806a520 0x7fed1806c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:27.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.601+0000 7fed26ffd640 1 -- 172.21.15.104:0/2790609834 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed2c014070 con 0x7fed380ad140 2023-09-13T02:12:27.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.601+0000 7fed35d9b640 1 --2- 172.21.15.104:0/2790609834 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fed1806a520 0x7fed1806c9e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed3812e950 tx=0x7fed28009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:27.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.605+0000 7fed26ffd640 1 -- 172.21.15.104:0/2790609834 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fed2c0519b0 con 0x7fed380ad140 2023-09-13T02:12:27.767 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.766+0000 7fed3c832640 1 -- 172.21.15.104:0/2790609834 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed3804e100 con 0x7fed1806a520 2023-09-13T02:12:27.773 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.773+0000 7fed26ffd640 1 -- 172.21.15.104:0/2790609834 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249835 (secure 0 0 0) 0x7fed3804e100 con 0x7fed1806a520 2023-09-13T02:12:27.777 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:27.778 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2023-09-13T02:12:27.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.776+0000 7fed3c832640 1 -- 172.21.15.104:0/2790609834 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fed1806a520 msgr2=0x7fed1806c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:27.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.776+0000 7fed3c832640 1 --2- 172.21.15.104:0/2790609834 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fed1806a520 0x7fed1806c9e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed3812e950 tx=0x7fed28009040 comp rx=0 tx=0).stop 2023-09-13T02:12:27.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.776+0000 7fed3c832640 1 -- 172.21.15.104:0/2790609834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed380ad140 msgr2=0x7fed380b8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:27.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.776+0000 7fed3c832640 1 --2- 172.21.15.104:0/2790609834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed380ad140 0x7fed380b8260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00e9f0 tx=0x7fed2c00eeb0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.781 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.776+0000 7fed3c832640 1 -- 172.21.15.104:0/2790609834 shutdown_connections 2023-09-13T02:12:27.781 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.776+0000 7fed3c832640 1 --2- 172.21.15.104:0/2790609834 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fed1806a520 0x7fed1806c9e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.781 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.776+0000 7fed3c832640 1 --2- 172.21.15.104:0/2790609834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed38144ea0 0x7fed38134000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.781 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.776+0000 7fed3c832640 1 --2- 172.21.15.104:0/2790609834 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed380b66c0 0x7fed381dd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.781 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.776+0000 7fed3c832640 1 --2- 172.21.15.104:0/2790609834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed380ad140 0x7fed380b8260 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.782 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.776+0000 7fed3c832640 1 -- 172.21.15.104:0/2790609834 >> 172.21.15.104:0/2790609834 conn(0x7fed380708b0 msgr2=0x7fed380ba170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:27.782 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.776+0000 7fed3c832640 1 -- 172.21.15.104:0/2790609834 shutdown_connections 2023-09-13T02:12:27.782 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.776+0000 7fed3c832640 1 -- 172.21.15.104:0/2790609834 wait complete. 2023-09-13T02:12:27.785 INFO:tasks.ceph.mds.a.smithi104.stderr:2023-09-13T02:12:27.784+0000 7f34e78e7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T02:12:27.787 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-09-13T02:12:26.030790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218548,"kb_used_data":2372,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756172,"statfs":{"total":773094113280,"available":772870320128,"internally_reserved":0,"allocated":2428928,"data_stored":1545565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000671"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-13T02:12:14.562379+0000","last_change":"2023-09-13T02:12:13.261542+0000","last_active":"2023-09-13T02:12:14.562379+0000","last_peered":"2023-09-13T02:12:14.562379+0000","last_clean":"2023-09-13T02:12:14.562379+0000","last_became_active":"2023-09-13T02:12:13.260630+0000","last_became_peered":"2023-09-13T02:12:13.260630+0000","last_unstale":"2023-09-13T02:12:14.562379+0000","last_undegraded":"2023-09-13T02:12:14.562379+0000","last_fullsized":"2023-09-13T02:12:14.562379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:12.209844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:12.209844+0000","last_clean_scrub_stamp":"2023-09-13T02:12:12.209844+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:07:47.139624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:23.560171+0000","last_change":"2023-09-13T02:12:23.560171+0000","last_active":"2023-09-13T02:12:23.560171+0000","last_peered":"2023-09-13T02:12:23.560171+0000","last_clean":"2023-09-13T02:12:23.560171+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:23.560171+0000","last_undegraded":"2023-09-13T02:12:23.560171+0000","last_fullsized":"2023-09-13T02:12:23.560171+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T02:12:22.556293+0000","last_change":"2023-09-13T02:12:22.556293+0000","last_active":"2023-09-13T02:12:22.556293+0000","last_peered":"2023-09-13T02:12:22.556293+0000","last_clean":"2023-09-13T02:12:22.556293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T02:12:22.556293+0000","last_undegraded":"2023-09-13T02:12:22.556293+0000","last_fullsized":"2023-09-13T02:12:22.556293+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":745472,"data_stored":635080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T02:12:27.792 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T02:12:27.928 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.927+0000 7fdb0c53c640 1 -- 172.21.15.104:0/597143910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb040b30d0 msgr2=0x7fdb0406d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:27.929 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.927+0000 7fdb0c53c640 1 --2- 172.21.15.104:0/597143910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb040b30d0 0x7fdb0406d950 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdb00009830 tx=0x7fdb0002bc50 comp rx=0 tx=0).stop 2023-09-13T02:12:27.929 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.927+0000 7fdb0c53c640 1 -- 172.21.15.104:0/597143910 shutdown_connections 2023-09-13T02:12:27.929 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.927+0000 7fdb0c53c640 1 --2- 172.21.15.104:0/597143910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb040b30d0 0x7fdb0406d950 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.929 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.927+0000 7fdb0c53c640 1 -- 172.21.15.104:0/597143910 >> 172.21.15.104:0/597143910 conn(0x7fdb04069570 msgr2=0x7fdb04069980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:27.930 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.927+0000 7fdb0c53c640 1 -- 172.21.15.104:0/597143910 shutdown_connections 2023-09-13T02:12:27.930 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.927+0000 7fdb0c53c640 1 -- 172.21.15.104:0/597143910 wait complete. 2023-09-13T02:12:27.933 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.928+0000 7fdb0c53c640 1 Processor -- start 2023-09-13T02:12:27.933 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.928+0000 7fdb0c53c640 1 -- start start 2023-09-13T02:12:27.933 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.928+0000 7fdb0c53c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb040acea0 0x7fdb041417c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:27.933 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.928+0000 7fdb0c53c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb040b30d0 0x7fdb04141d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:27.934 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.928+0000 7fdb0c53c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb041456c0 0x7fdb041437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:27.934 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.928+0000 7fdb0c53c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb041433b0 con 0x7fdb040acea0 2023-09-13T02:12:27.934 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.928+0000 7fdb0c53c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0413baa0 con 0x7fdb040b30d0 2023-09-13T02:12:27.934 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.928+0000 7fdb0c53c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04140b30 con 0x7fdb041456c0 2023-09-13T02:12:27.934 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.929+0000 7fdb0a2d8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb040acea0 0x7fdb041417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:27.935 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.929+0000 7fdb0a2d8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb040acea0 0x7fdb041417c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47050/0 (socket says 172.21.15.104:47050) 2023-09-13T02:12:27.935 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.929+0000 7fdb0a2d8640 1 -- 172.21.15.104:0/2450881 learned_addr learned my addr 172.21.15.104:0/2450881 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:27.935 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.929+0000 7fdb0aad9640 1 --2- 172.21.15.104:0/2450881 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb041456c0 0x7fdb041437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:27.935 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.929+0000 7fdb09ad7640 1 --2- 172.21.15.104:0/2450881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb040b30d0 0x7fdb04141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:27.936 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.929+0000 7fdb0a2d8640 1 -- 172.21.15.104:0/2450881 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb041456c0 msgr2=0x7fdb041437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:27.936 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.929+0000 7fdb0a2d8640 1 --2- 172.21.15.104:0/2450881 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb041456c0 0x7fdb041437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.936 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.929+0000 7fdb0a2d8640 1 -- 172.21.15.104:0/2450881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb040b30d0 msgr2=0x7fdb04141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:27.936 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.929+0000 7fdb0a2d8640 1 --2- 172.21.15.104:0/2450881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb040b30d0 0x7fdb04141d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:27.937 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.929+0000 7fdb0a2d8640 1 -- 172.21.15.104:0/2450881 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb00009490 con 0x7fdb040acea0 2023-09-13T02:12:27.937 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.929+0000 7fdb0a2d8640 1 --2- 172.21.15.104:0/2450881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb040acea0 0x7fdb041417c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdb00009950 tx=0x7fdb0002c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:27.938 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.929+0000 7fdafaffd640 1 -- 172.21.15.104:0/2450881 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00003a80 con 0x7fdb040acea0 2023-09-13T02:12:27.938 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.929+0000 7fdafaffd640 1 -- 172.21.15.104:0/2450881 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdb00003cd0 con 0x7fdb040acea0 2023-09-13T02:12:27.938 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.929+0000 7fdb0c53c640 1 -- 172.21.15.104:0/2450881 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb04140e10 con 0x7fdb040acea0 2023-09-13T02:12:27.938 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.929+0000 7fdafaffd640 1 -- 172.21.15.104:0/2450881 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00034660 con 0x7fdb040acea0 2023-09-13T02:12:27.938 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.929+0000 7fdb0c53c640 1 -- 172.21.15.104:0/2450881 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb041407b0 con 0x7fdb040acea0 2023-09-13T02:12:27.939 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.930+0000 7fdb0c53c640 1 -- 172.21.15.104:0/2450881 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0406e7e0 con 0x7fdb040acea0 2023-09-13T02:12:27.939 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.930+0000 7fdafaffd640 1 -- 172.21.15.104:0/2450881 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fdb000347c0 con 0x7fdb040acea0 2023-09-13T02:12:27.939 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.931+0000 7fdafaffd640 1 --2- 172.21.15.104:0/2450881 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdae806a4f0 0x7fdae806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:27.939 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.931+0000 7fdafaffd640 1 -- 172.21.15.104:0/2450881 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb000ab520 con 0x7fdb040acea0 2023-09-13T02:12:27.939 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.931+0000 7fdb09ad7640 1 --2- 172.21.15.104:0/2450881 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdae806a4f0 0x7fdae806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:27.940 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.931+0000 7fdb09ad7640 1 --2- 172.21.15.104:0/2450881 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdae806a4f0 0x7fdae806c9b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4007fd0 tx=0x7fdaf4009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:27.940 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:27.935+0000 7fdafaffd640 1 -- 172.21.15.104:0/2450881 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdb00076c50 con 0x7fdb040acea0 2023-09-13T02:12:28.099 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.098+0000 7fdb0c53c640 1 -- 172.21.15.104:0/2450881 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb041434f0 con 0x7fdae806a4f0 2023-09-13T02:12:28.105 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.104+0000 7fdafaffd640 1 -- 172.21.15.104:0/2450881 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264729 (secure 0 0 0) 0x7fdb041434f0 con 0x7fdae806a4f0 2023-09-13T02:12:28.108 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:28.109 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2023-09-13T02:12:28.111 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.107+0000 7fdb0c53c640 1 -- 172.21.15.104:0/2450881 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdae806a4f0 msgr2=0x7fdae806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:28.112 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.107+0000 7fdb0c53c640 1 --2- 172.21.15.104:0/2450881 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdae806a4f0 0x7fdae806c9b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4007fd0 tx=0x7fdaf4009040 comp rx=0 tx=0).stop 2023-09-13T02:12:28.112 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.107+0000 7fdb0c53c640 1 -- 172.21.15.104:0/2450881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb040acea0 msgr2=0x7fdb041417c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:28.112 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.107+0000 7fdb0c53c640 1 --2- 172.21.15.104:0/2450881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb040acea0 0x7fdb041417c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdb00009950 tx=0x7fdb0002c750 comp rx=0 tx=0).stop 2023-09-13T02:12:28.112 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.107+0000 7fdb0c53c640 1 -- 172.21.15.104:0/2450881 shutdown_connections 2023-09-13T02:12:28.112 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.107+0000 7fdb0c53c640 1 --2- 172.21.15.104:0/2450881 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdae806a4f0 0x7fdae806c9b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.113 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.107+0000 7fdb0c53c640 1 --2- 172.21.15.104:0/2450881 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb041456c0 0x7fdb041437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.113 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.107+0000 7fdb0c53c640 1 --2- 172.21.15.104:0/2450881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb040b30d0 0x7fdb04141d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.113 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.107+0000 7fdb0c53c640 1 --2- 172.21.15.104:0/2450881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb040acea0 0x7fdb041417c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.113 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.107+0000 7fdb0c53c640 1 -- 172.21.15.104:0/2450881 >> 172.21.15.104:0/2450881 conn(0x7fdb04069570 msgr2=0x7fdb04145c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:28.113 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.107+0000 7fdb0c53c640 1 -- 172.21.15.104:0/2450881 shutdown_connections 2023-09-13T02:12:28.114 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.107+0000 7fdb0c53c640 1 -- 172.21.15.104:0/2450881 wait complete. 2023-09-13T02:12:28.118 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-09-13T02:12:28.031135+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2887680,"data_stored":1751721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.468238"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258274+0000","last_change":"2023-09-13T02:12:24.593673+0000","last_active":"2023-09-13T02:12:26.258274+0000","last_peered":"2023-09-13T02:12:26.258274+0000","last_clean":"2023-09-13T02:12:26.258274+0000","last_became_active":"2023-09-13T02:12:24.592754+0000","last_became_peered":"2023-09-13T02:12:24.592754+0000","last_unstale":"2023-09-13T02:12:26.258274+0000","last_undegraded":"2023-09-13T02:12:26.258274+0000","last_fullsized":"2023-09-13T02:12:26.258274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:43:34.341442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578839+0000","last_change":"2023-09-13T02:12:24.580108+0000","last_active":"2023-09-13T02:12:25.578839+0000","last_peered":"2023-09-13T02:12:25.578839+0000","last_clean":"2023-09-13T02:12:25.578839+0000","last_became_active":"2023-09-13T02:12:24.579873+0000","last_became_peered":"2023-09-13T02:12:24.579873+0000","last_unstale":"2023-09-13T02:12:25.578839+0000","last_undegraded":"2023-09-13T02:12:25.578839+0000","last_fullsized":"2023-09-13T02:12:25.578839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607687+0000","last_change":"2023-09-13T02:12:24.584533+0000","last_active":"2023-09-13T02:12:25.607687+0000","last_peered":"2023-09-13T02:12:25.607687+0000","last_clean":"2023-09-13T02:12:25.607687+0000","last_became_active":"2023-09-13T02:12:24.584249+0000","last_became_peered":"2023-09-13T02:12:24.584249+0000","last_unstale":"2023-09-13T02:12:25.607687+0000","last_undegraded":"2023-09-13T02:12:25.607687+0000","last_fullsized":"2023-09-13T02:12:25.607687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658105+0000","last_change":"2023-09-13T02:12:24.596092+0000","last_active":"2023-09-13T02:12:25.658105+0000","last_peered":"2023-09-13T02:12:25.658105+0000","last_clean":"2023-09-13T02:12:25.658105+0000","last_became_active":"2023-09-13T02:12:24.595817+0000","last_became_peered":"2023-09-13T02:12:24.595817+0000","last_unstale":"2023-09-13T02:12:25.658105+0000","last_undegraded":"2023-09-13T02:12:25.658105+0000","last_fullsized":"2023-09-13T02:12:25.658105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:15.246952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257924+0000","last_change":"2023-09-13T02:12:24.592410+0000","last_active":"2023-09-13T02:12:26.257924+0000","last_peered":"2023-09-13T02:12:26.257924+0000","last_clean":"2023-09-13T02:12:26.257924+0000","last_became_active":"2023-09-13T02:12:24.591503+0000","last_became_peered":"2023-09-13T02:12:24.591503+0000","last_unstale":"2023-09-13T02:12:26.257924+0000","last_undegraded":"2023-09-13T02:12:26.257924+0000","last_fullsized":"2023-09-13T02:12:26.257924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:43:26.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657920+0000","last_change":"2023-09-13T02:12:24.594084+0000","last_active":"2023-09-13T02:12:25.657920+0000","last_peered":"2023-09-13T02:12:25.657920+0000","last_clean":"2023-09-13T02:12:25.657920+0000","last_became_active":"2023-09-13T02:12:24.592530+0000","last_became_peered":"2023-09-13T02:12:24.592530+0000","last_unstale":"2023-09-13T02:12:25.657920+0000","last_undegraded":"2023-09-13T02:12:25.657920+0000","last_fullsized":"2023-09-13T02:12:25.657920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257688+0000","last_change":"2023-09-13T02:12:24.591304+0000","last_active":"2023-09-13T02:12:26.257688+0000","last_peered":"2023-09-13T02:12:26.257688+0000","last_clean":"2023-09-13T02:12:26.257688+0000","last_became_active":"2023-09-13T02:12:24.590654+0000","last_became_peered":"2023-09-13T02:12:24.590654+0000","last_unstale":"2023-09-13T02:12:26.257688+0000","last_undegraded":"2023-09-13T02:12:26.257688+0000","last_fullsized":"2023-09-13T02:12:26.257688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:15.246952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.758902+0000","last_change":"2023-09-13T02:12:24.588844+0000","last_active":"2023-09-13T02:12:25.758902+0000","last_peered":"2023-09-13T02:12:25.758902+0000","last_clean":"2023-09-13T02:12:25.758902+0000","last_became_active":"2023-09-13T02:12:24.588438+0000","last_became_peered":"2023-09-13T02:12:24.588438+0000","last_unstale":"2023-09-13T02:12:25.758902+0000","last_undegraded":"2023-09-13T02:12:25.758902+0000","last_fullsized":"2023-09-13T02:12:25.758902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:37.796406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258329+0000","last_change":"2023-09-13T02:12:24.589946+0000","last_active":"2023-09-13T02:12:26.258329+0000","last_peered":"2023-09-13T02:12:26.258329+0000","last_clean":"2023-09-13T02:12:26.258329+0000","last_became_active":"2023-09-13T02:12:24.589606+0000","last_became_peered":"2023-09-13T02:12:24.589606+0000","last_unstale":"2023-09-13T02:12:26.258329+0000","last_undegraded":"2023-09-13T02:12:26.258329+0000","last_fullsized":"2023-09-13T02:12:26.258329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:41.609166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757491+0000","last_change":"2023-09-13T02:12:24.588874+0000","last_active":"2023-09-13T02:12:25.757491+0000","last_peered":"2023-09-13T02:12:25.757491+0000","last_clean":"2023-09-13T02:12:25.757491+0000","last_became_active":"2023-09-13T02:12:24.588522+0000","last_became_peered":"2023-09-13T02:12:24.588522+0000","last_unstale":"2023-09-13T02:12:25.757491+0000","last_undegraded":"2023-09-13T02:12:25.757491+0000","last_fullsized":"2023-09-13T02:12:25.757491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757356+0000","last_change":"2023-09-13T02:12:24.589173+0000","last_active":"2023-09-13T02:12:25.757356+0000","last_peered":"2023-09-13T02:12:25.757356+0000","last_clean":"2023-09-13T02:12:25.757356+0000","last_became_active":"2023-09-13T02:12:24.588891+0000","last_became_peered":"2023-09-13T02:12:24.588891+0000","last_unstale":"2023-09-13T02:12:25.757356+0000","last_undegraded":"2023-09-13T02:12:25.757356+0000","last_fullsized":"2023-09-13T02:12:25.757356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579243+0000","last_change":"2023-09-13T02:12:24.587494+0000","last_active":"2023-09-13T02:12:25.579243+0000","last_peered":"2023-09-13T02:12:25.579243+0000","last_clean":"2023-09-13T02:12:25.579243+0000","last_became_active":"2023-09-13T02:12:24.587023+0000","last_became_peered":"2023-09-13T02:12:24.587023+0000","last_unstale":"2023-09-13T02:12:25.579243+0000","last_undegraded":"2023-09-13T02:12:25.579243+0000","last_fullsized":"2023-09-13T02:12:25.579243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:41.175280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759132+0000","last_change":"2023-09-13T02:12:24.588000+0000","last_active":"2023-09-13T02:12:25.759132+0000","last_peered":"2023-09-13T02:12:25.759132+0000","last_clean":"2023-09-13T02:12:25.759132+0000","last_became_active":"2023-09-13T02:12:24.587730+0000","last_became_peered":"2023-09-13T02:12:24.587730+0000","last_unstale":"2023-09-13T02:12:25.759132+0000","last_undegraded":"2023-09-13T02:12:25.759132+0000","last_fullsized":"2023-09-13T02:12:25.759132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607517+0000","last_change":"2023-09-13T02:12:24.584985+0000","last_active":"2023-09-13T02:12:25.607517+0000","last_peered":"2023-09-13T02:12:25.607517+0000","last_clean":"2023-09-13T02:12:25.607517+0000","last_became_active":"2023-09-13T02:12:24.584734+0000","last_became_peered":"2023-09-13T02:12:24.584734+0000","last_unstale":"2023-09-13T02:12:25.607517+0000","last_undegraded":"2023-09-13T02:12:25.607517+0000","last_fullsized":"2023-09-13T02:12:25.607517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:37.796406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578570+0000","last_change":"2023-09-13T02:12:24.578832+0000","last_active":"2023-09-13T02:12:25.578570+0000","last_peered":"2023-09-13T02:12:25.578570+0000","last_clean":"2023-09-13T02:12:25.578570+0000","last_became_active":"2023-09-13T02:12:24.578553+0000","last_became_peered":"2023-09-13T02:12:24.578553+0000","last_unstale":"2023-09-13T02:12:25.578570+0000","last_undegraded":"2023-09-13T02:12:25.578570+0000","last_fullsized":"2023-09-13T02:12:25.578570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657829+0000","last_change":"2023-09-13T02:12:24.591151+0000","last_active":"2023-09-13T02:12:25.657829+0000","last_peered":"2023-09-13T02:12:25.657829+0000","last_clean":"2023-09-13T02:12:25.657829+0000","last_became_active":"2023-09-13T02:12:24.590871+0000","last_became_peered":"2023-09-13T02:12:24.590871+0000","last_unstale":"2023-09-13T02:12:25.657829+0000","last_undegraded":"2023-09-13T02:12:25.657829+0000","last_fullsized":"2023-09-13T02:12:25.657829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658468+0000","last_change":"2023-09-13T02:12:24.592615+0000","last_active":"2023-09-13T02:12:25.658468+0000","last_peered":"2023-09-13T02:12:25.658468+0000","last_clean":"2023-09-13T02:12:25.658468+0000","last_became_active":"2023-09-13T02:12:24.592325+0000","last_became_peered":"2023-09-13T02:12:24.592325+0000","last_unstale":"2023-09-13T02:12:25.658468+0000","last_undegraded":"2023-09-13T02:12:25.658468+0000","last_fullsized":"2023-09-13T02:12:25.658468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:19:41.872878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575609+0000","last_change":"2023-09-13T02:12:24.587859+0000","last_active":"2023-09-13T02:12:25.575609+0000","last_peered":"2023-09-13T02:12:25.575609+0000","last_clean":"2023-09-13T02:12:25.575609+0000","last_became_active":"2023-09-13T02:12:24.587552+0000","last_became_peered":"2023-09-13T02:12:24.587552+0000","last_unstale":"2023-09-13T02:12:25.575609+0000","last_undegraded":"2023-09-13T02:12:25.575609+0000","last_fullsized":"2023-09-13T02:12:25.575609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:39.029452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258196+0000","last_change":"2023-09-13T02:12:24.591593+0000","last_active":"2023-09-13T02:12:26.258196+0000","last_peered":"2023-09-13T02:12:26.258196+0000","last_clean":"2023-09-13T02:12:26.258196+0000","last_became_active":"2023-09-13T02:12:24.590670+0000","last_became_peered":"2023-09-13T02:12:24.590670+0000","last_unstale":"2023-09-13T02:12:26.258196+0000","last_undegraded":"2023-09-13T02:12:26.258196+0000","last_fullsized":"2023-09-13T02:12:26.258196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:19:41.872878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757332+0000","last_change":"2023-09-13T02:12:24.593278+0000","last_active":"2023-09-13T02:12:25.757332+0000","last_peered":"2023-09-13T02:12:25.757332+0000","last_clean":"2023-09-13T02:12:25.757332+0000","last_became_active":"2023-09-13T02:12:24.591065+0000","last_became_peered":"2023-09-13T02:12:24.591065+0000","last_unstale":"2023-09-13T02:12:25.757332+0000","last_undegraded":"2023-09-13T02:12:25.757332+0000","last_fullsized":"2023-09-13T02:12:25.757332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607717+0000","last_change":"2023-09-13T02:12:24.587352+0000","last_active":"2023-09-13T02:12:25.607717+0000","last_peered":"2023-09-13T02:12:25.607717+0000","last_clean":"2023-09-13T02:12:25.607717+0000","last_became_active":"2023-09-13T02:12:24.586981+0000","last_became_peered":"2023-09-13T02:12:24.586981+0000","last_unstale":"2023-09-13T02:12:25.607717+0000","last_undegraded":"2023-09-13T02:12:25.607717+0000","last_fullsized":"2023-09-13T02:12:25.607717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657949+0000","last_change":"2023-09-13T02:12:24.595423+0000","last_active":"2023-09-13T02:12:25.657949+0000","last_peered":"2023-09-13T02:12:25.657949+0000","last_clean":"2023-09-13T02:12:25.657949+0000","last_became_active":"2023-09-13T02:12:24.594351+0000","last_became_peered":"2023-09-13T02:12:24.594351+0000","last_unstale":"2023-09-13T02:12:25.657949+0000","last_undegraded":"2023-09-13T02:12:25.657949+0000","last_fullsized":"2023-09-13T02:12:25.657949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:18.256464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.758931+0000","last_change":"2023-09-13T02:12:24.590553+0000","last_active":"2023-09-13T02:12:25.758931+0000","last_peered":"2023-09-13T02:12:25.758931+0000","last_clean":"2023-09-13T02:12:25.758931+0000","last_became_active":"2023-09-13T02:12:24.590295+0000","last_became_peered":"2023-09-13T02:12:24.590295+0000","last_unstale":"2023-09-13T02:12:25.758931+0000","last_undegraded":"2023-09-13T02:12:25.758931+0000","last_fullsized":"2023-09-13T02:12:25.758931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657922+0000","last_change":"2023-09-13T02:12:24.593925+0000","last_active":"2023-09-13T02:12:25.657922+0000","last_peered":"2023-09-13T02:12:25.657922+0000","last_clean":"2023-09-13T02:12:25.657922+0000","last_became_active":"2023-09-13T02:12:24.593673+0000","last_became_peered":"2023-09-13T02:12:24.593673+0000","last_unstale":"2023-09-13T02:12:25.657922+0000","last_undegraded":"2023-09-13T02:12:25.657922+0000","last_fullsized":"2023-09-13T02:12:25.657922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759249+0000","last_change":"2023-09-13T02:12:24.590496+0000","last_active":"2023-09-13T02:12:25.759249+0000","last_peered":"2023-09-13T02:12:25.759249+0000","last_clean":"2023-09-13T02:12:25.759249+0000","last_became_active":"2023-09-13T02:12:24.590231+0000","last_became_peered":"2023-09-13T02:12:24.590231+0000","last_unstale":"2023-09-13T02:12:25.759249+0000","last_undegraded":"2023-09-13T02:12:25.759249+0000","last_fullsized":"2023-09-13T02:12:25.759249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757555+0000","last_change":"2023-09-13T02:12:24.590251+0000","last_active":"2023-09-13T02:12:25.757555+0000","last_peered":"2023-09-13T02:12:25.757555+0000","last_clean":"2023-09-13T02:12:25.757555+0000","last_became_active":"2023-09-13T02:12:24.589975+0000","last_became_peered":"2023-09-13T02:12:24.589975+0000","last_unstale":"2023-09-13T02:12:25.757555+0000","last_undegraded":"2023-09-13T02:12:25.757555+0000","last_fullsized":"2023-09-13T02:12:25.757555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578681+0000","last_change":"2023-09-13T02:12:24.584028+0000","last_active":"2023-09-13T02:12:25.578681+0000","last_peered":"2023-09-13T02:12:25.578681+0000","last_clean":"2023-09-13T02:12:25.578681+0000","last_became_active":"2023-09-13T02:12:24.583782+0000","last_became_peered":"2023-09-13T02:12:24.583782+0000","last_unstale":"2023-09-13T02:12:25.578681+0000","last_undegraded":"2023-09-13T02:12:25.578681+0000","last_fullsized":"2023-09-13T02:12:25.578681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759313+0000","last_change":"2023-09-13T02:12:24.590548+0000","last_active":"2023-09-13T02:12:25.759313+0000","last_peered":"2023-09-13T02:12:25.759313+0000","last_clean":"2023-09-13T02:12:25.759313+0000","last_became_active":"2023-09-13T02:12:24.590189+0000","last_became_peered":"2023-09-13T02:12:24.590189+0000","last_unstale":"2023-09-13T02:12:25.759313+0000","last_undegraded":"2023-09-13T02:12:25.759313+0000","last_fullsized":"2023-09-13T02:12:25.759313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607812+0000","last_change":"2023-09-13T02:12:24.583749+0000","last_active":"2023-09-13T02:12:25.607812+0000","last_peered":"2023-09-13T02:12:25.607812+0000","last_clean":"2023-09-13T02:12:25.607812+0000","last_became_active":"2023-09-13T02:12:24.583453+0000","last_became_peered":"2023-09-13T02:12:24.583453+0000","last_unstale":"2023-09-13T02:12:25.607812+0000","last_undegraded":"2023-09-13T02:12:25.607812+0000","last_fullsized":"2023-09-13T02:12:25.607812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658110+0000","last_change":"2023-09-13T02:12:24.595007+0000","last_active":"2023-09-13T02:12:25.658110+0000","last_peered":"2023-09-13T02:12:25.658110+0000","last_clean":"2023-09-13T02:12:25.658110+0000","last_became_active":"2023-09-13T02:12:24.592875+0000","last_became_peered":"2023-09-13T02:12:24.592875+0000","last_unstale":"2023-09-13T02:12:25.658110+0000","last_undegraded":"2023-09-13T02:12:25.658110+0000","last_fullsized":"2023-09-13T02:12:25.658110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575574+0000","last_change":"2023-09-13T02:12:24.588586+0000","last_active":"2023-09-13T02:12:25.575574+0000","last_peered":"2023-09-13T02:12:25.575574+0000","last_clean":"2023-09-13T02:12:25.575574+0000","last_became_active":"2023-09-13T02:12:24.588173+0000","last_became_peered":"2023-09-13T02:12:24.588173+0000","last_unstale":"2023-09-13T02:12:25.575574+0000","last_undegraded":"2023-09-13T02:12:25.575574+0000","last_fullsized":"2023-09-13T02:12:25.575574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:50.824236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757216+0000","last_change":"2023-09-13T02:12:24.590981+0000","last_active":"2023-09-13T02:12:25.757216+0000","last_peered":"2023-09-13T02:12:25.757216+0000","last_clean":"2023-09-13T02:12:25.757216+0000","last_became_active":"2023-09-13T02:12:24.590677+0000","last_became_peered":"2023-09-13T02:12:24.590677+0000","last_unstale":"2023-09-13T02:12:25.757216+0000","last_undegraded":"2023-09-13T02:12:25.757216+0000","last_fullsized":"2023-09-13T02:12:25.757216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579025+0000","last_change":"2023-09-13T02:12:24.586738+0000","last_active":"2023-09-13T02:12:25.579025+0000","last_peered":"2023-09-13T02:12:25.579025+0000","last_clean":"2023-09-13T02:12:25.579025+0000","last_became_active":"2023-09-13T02:12:24.586251+0000","last_became_peered":"2023-09-13T02:12:24.586251+0000","last_unstale":"2023-09-13T02:12:25.579025+0000","last_undegraded":"2023-09-13T02:12:25.579025+0000","last_fullsized":"2023-09-13T02:12:25.579025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:25.830036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759212+0000","last_change":"2023-09-13T02:12:23.579164+0000","last_active":"2023-09-13T02:12:25.759212+0000","last_peered":"2023-09-13T02:12:25.759212+0000","last_clean":"2023-09-13T02:12:25.759212+0000","last_became_active":"2023-09-13T02:12:23.578889+0000","last_became_peered":"2023-09-13T02:12:23.578889+0000","last_unstale":"2023-09-13T02:12:25.759212+0000","last_undegraded":"2023-09-13T02:12:25.759212+0000","last_fullsized":"2023-09-13T02:12:25.759212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607827+0000","last_change":"2023-09-13T02:12:24.579559+0000","last_active":"2023-09-13T02:12:25.607827+0000","last_peered":"2023-09-13T02:12:25.607827+0000","last_clean":"2023-09-13T02:12:25.607827+0000","last_became_active":"2023-09-13T02:12:24.579243+0000","last_became_peered":"2023-09-13T02:12:24.579243+0000","last_unstale":"2023-09-13T02:12:25.607827+0000","last_undegraded":"2023-09-13T02:12:25.607827+0000","last_fullsized":"2023-09-13T02:12:25.607827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757122+0000","last_change":"2023-09-13T02:12:23.577022+0000","last_active":"2023-09-13T02:12:25.757122+0000","last_peered":"2023-09-13T02:12:25.757122+0000","last_clean":"2023-09-13T02:12:25.757122+0000","last_became_active":"2023-09-13T02:12:23.576754+0000","last_became_peered":"2023-09-13T02:12:23.576754+0000","last_unstale":"2023-09-13T02:12:25.757122+0000","last_undegraded":"2023-09-13T02:12:25.757122+0000","last_fullsized":"2023-09-13T02:12:25.757122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:49.820358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.758996+0000","last_change":"2023-09-13T02:12:23.579634+0000","last_active":"2023-09-13T02:12:25.758996+0000","last_peered":"2023-09-13T02:12:25.758996+0000","last_clean":"2023-09-13T02:12:25.758996+0000","last_became_active":"2023-09-13T02:12:23.579351+0000","last_became_peered":"2023-09-13T02:12:23.579351+0000","last_unstale":"2023-09-13T02:12:25.758996+0000","last_undegraded":"2023-09-13T02:12:25.758996+0000","last_fullsized":"2023-09-13T02:12:25.758996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:24.826159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.758949+0000","last_change":"2023-09-13T02:12:24.590474+0000","last_active":"2023-09-13T02:12:25.758949+0000","last_peered":"2023-09-13T02:12:25.758949+0000","last_clean":"2023-09-13T02:12:25.758949+0000","last_became_active":"2023-09-13T02:12:24.590126+0000","last_became_peered":"2023-09-13T02:12:24.590126+0000","last_unstale":"2023-09-13T02:12:25.758949+0000","last_undegraded":"2023-09-13T02:12:25.758949+0000","last_fullsized":"2023-09-13T02:12:25.758949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657959+0000","last_change":"2023-09-13T02:12:23.586264+0000","last_active":"2023-09-13T02:12:25.657959+0000","last_peered":"2023-09-13T02:12:25.657959+0000","last_clean":"2023-09-13T02:12:25.657959+0000","last_became_active":"2023-09-13T02:12:23.585953+0000","last_became_peered":"2023-09-13T02:12:23.585953+0000","last_unstale":"2023-09-13T02:12:25.657959+0000","last_undegraded":"2023-09-13T02:12:25.657959+0000","last_fullsized":"2023-09-13T02:12:25.657959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:27.359818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578575+0000","last_change":"2023-09-13T02:12:24.585138+0000","last_active":"2023-09-13T02:12:25.578575+0000","last_peered":"2023-09-13T02:12:25.578575+0000","last_clean":"2023-09-13T02:12:25.578575+0000","last_became_active":"2023-09-13T02:12:24.584901+0000","last_became_peered":"2023-09-13T02:12:24.584901+0000","last_unstale":"2023-09-13T02:12:25.578575+0000","last_undegraded":"2023-09-13T02:12:25.578575+0000","last_fullsized":"2023-09-13T02:12:25.578575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757459+0000","last_change":"2023-09-13T02:12:23.583663+0000","last_active":"2023-09-13T02:12:25.757459+0000","last_peered":"2023-09-13T02:12:25.757459+0000","last_clean":"2023-09-13T02:12:25.757459+0000","last_became_active":"2023-09-13T02:12:23.583305+0000","last_became_peered":"2023-09-13T02:12:23.583305+0000","last_unstale":"2023-09-13T02:12:25.757459+0000","last_undegraded":"2023-09-13T02:12:25.757459+0000","last_fullsized":"2023-09-13T02:12:25.757459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:32.660244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658293+0000","last_change":"2023-09-13T02:12:24.595264+0000","last_active":"2023-09-13T02:12:25.658293+0000","last_peered":"2023-09-13T02:12:25.658293+0000","last_clean":"2023-09-13T02:12:25.658293+0000","last_became_active":"2023-09-13T02:12:24.594434+0000","last_became_peered":"2023-09-13T02:12:24.594434+0000","last_unstale":"2023-09-13T02:12:25.658293+0000","last_undegraded":"2023-09-13T02:12:25.658293+0000","last_fullsized":"2023-09-13T02:12:25.658293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:17:30.897344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658326+0000","last_change":"2023-09-13T02:12:23.584935+0000","last_active":"2023-09-13T02:12:25.658326+0000","last_peered":"2023-09-13T02:12:25.658326+0000","last_clean":"2023-09-13T02:12:25.658326+0000","last_became_active":"2023-09-13T02:12:23.584657+0000","last_became_peered":"2023-09-13T02:12:23.584657+0000","last_unstale":"2023-09-13T02:12:25.658326+0000","last_undegraded":"2023-09-13T02:12:25.658326+0000","last_fullsized":"2023-09-13T02:12:25.658326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:36.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607761+0000","last_change":"2023-09-13T02:12:24.588694+0000","last_active":"2023-09-13T02:12:25.607761+0000","last_peered":"2023-09-13T02:12:25.607761+0000","last_clean":"2023-09-13T02:12:25.607761+0000","last_became_active":"2023-09-13T02:12:24.588455+0000","last_became_peered":"2023-09-13T02:12:24.588455+0000","last_unstale":"2023-09-13T02:12:25.607761+0000","last_undegraded":"2023-09-13T02:12:25.607761+0000","last_fullsized":"2023-09-13T02:12:25.607761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578696+0000","last_change":"2023-09-13T02:12:23.582781+0000","last_active":"2023-09-13T02:12:25.578696+0000","last_peered":"2023-09-13T02:12:25.578696+0000","last_clean":"2023-09-13T02:12:25.578696+0000","last_became_active":"2023-09-13T02:12:23.582506+0000","last_became_peered":"2023-09-13T02:12:23.582506+0000","last_unstale":"2023-09-13T02:12:25.578696+0000","last_undegraded":"2023-09-13T02:12:25.578696+0000","last_fullsized":"2023-09-13T02:12:25.578696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:03.890491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579403+0000","last_change":"2023-09-13T02:12:24.594514+0000","last_active":"2023-09-13T02:12:25.579403+0000","last_peered":"2023-09-13T02:12:25.579403+0000","last_clean":"2023-09-13T02:12:25.579403+0000","last_became_active":"2023-09-13T02:12:24.592367+0000","last_became_peered":"2023-09-13T02:12:24.592367+0000","last_unstale":"2023-09-13T02:12:25.579403+0000","last_undegraded":"2023-09-13T02:12:25.579403+0000","last_fullsized":"2023-09-13T02:12:25.579403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:08.045218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757371+0000","last_change":"2023-09-13T02:12:23.579000+0000","last_active":"2023-09-13T02:12:25.757371+0000","last_peered":"2023-09-13T02:12:25.757371+0000","last_clean":"2023-09-13T02:12:25.757371+0000","last_became_active":"2023-09-13T02:12:23.578748+0000","last_became_peered":"2023-09-13T02:12:23.578748+0000","last_unstale":"2023-09-13T02:12:25.757371+0000","last_undegraded":"2023-09-13T02:12:25.757371+0000","last_fullsized":"2023-09-13T02:12:25.757371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:38.025574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257924+0000","last_change":"2023-09-13T02:12:24.593514+0000","last_active":"2023-09-13T02:12:26.257924+0000","last_peered":"2023-09-13T02:12:26.257924+0000","last_clean":"2023-09-13T02:12:26.257924+0000","last_became_active":"2023-09-13T02:12:24.593092+0000","last_became_peered":"2023-09-13T02:12:24.593092+0000","last_unstale":"2023-09-13T02:12:26.257924+0000","last_undegraded":"2023-09-13T02:12:26.257924+0000","last_fullsized":"2023-09-13T02:12:26.257924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:18:08.378805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607886+0000","last_change":"2023-09-13T02:12:23.579348+0000","last_active":"2023-09-13T02:12:25.607886+0000","last_peered":"2023-09-13T02:12:25.607886+0000","last_clean":"2023-09-13T02:12:25.607886+0000","last_became_active":"2023-09-13T02:12:23.579079+0000","last_became_peered":"2023-09-13T02:12:23.579079+0000","last_unstale":"2023-09-13T02:12:25.607886+0000","last_undegraded":"2023-09-13T02:12:25.607886+0000","last_fullsized":"2023-09-13T02:12:25.607886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:07.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607669+0000","last_change":"2023-09-13T02:12:24.587235+0000","last_active":"2023-09-13T02:12:25.607669+0000","last_peered":"2023-09-13T02:12:25.607669+0000","last_clean":"2023-09-13T02:12:25.607669+0000","last_became_active":"2023-09-13T02:12:24.586930+0000","last_became_peered":"2023-09-13T02:12:24.586930+0000","last_unstale":"2023-09-13T02:12:25.607669+0000","last_undegraded":"2023-09-13T02:12:25.607669+0000","last_fullsized":"2023-09-13T02:12:25.607669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658035+0000","last_change":"2023-09-13T02:12:23.585680+0000","last_active":"2023-09-13T02:12:25.658035+0000","last_peered":"2023-09-13T02:12:25.658035+0000","last_clean":"2023-09-13T02:12:25.658035+0000","last_became_active":"2023-09-13T02:12:23.585417+0000","last_became_peered":"2023-09-13T02:12:23.585417+0000","last_unstale":"2023-09-13T02:12:25.658035+0000","last_undegraded":"2023-09-13T02:12:25.658035+0000","last_fullsized":"2023-09-13T02:12:25.658035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:03.890491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257950+0000","last_change":"2023-09-13T02:12:24.592703+0000","last_active":"2023-09-13T02:12:26.257950+0000","last_peered":"2023-09-13T02:12:26.257950+0000","last_clean":"2023-09-13T02:12:26.257950+0000","last_became_active":"2023-09-13T02:12:24.591849+0000","last_became_peered":"2023-09-13T02:12:24.591849+0000","last_unstale":"2023-09-13T02:12:26.257950+0000","last_undegraded":"2023-09-13T02:12:26.257950+0000","last_fullsized":"2023-09-13T02:12:26.257950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:17:30.897344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757127+0000","last_change":"2023-09-13T02:12:23.576659+0000","last_active":"2023-09-13T02:12:25.757127+0000","last_peered":"2023-09-13T02:12:25.757127+0000","last_clean":"2023-09-13T02:12:25.757127+0000","last_became_active":"2023-09-13T02:12:23.576022+0000","last_became_peered":"2023-09-13T02:12:23.576022+0000","last_unstale":"2023-09-13T02:12:25.757127+0000","last_undegraded":"2023-09-13T02:12:25.757127+0000","last_fullsized":"2023-09-13T02:12:25.757127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:51.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757259+0000","last_change":"2023-09-13T02:12:24.591552+0000","last_active":"2023-09-13T02:12:25.757259+0000","last_peered":"2023-09-13T02:12:25.757259+0000","last_clean":"2023-09-13T02:12:25.757259+0000","last_became_active":"2023-09-13T02:12:24.591247+0000","last_became_peered":"2023-09-13T02:12:24.591247+0000","last_unstale":"2023-09-13T02:12:25.757259+0000","last_undegraded":"2023-09-13T02:12:25.757259+0000","last_fullsized":"2023-09-13T02:12:25.757259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575456+0000","last_change":"2023-09-13T02:12:23.570753+0000","last_active":"2023-09-13T02:12:25.575456+0000","last_peered":"2023-09-13T02:12:25.575456+0000","last_clean":"2023-09-13T02:12:25.575456+0000","last_became_active":"2023-09-13T02:12:23.570461+0000","last_became_peered":"2023-09-13T02:12:23.570461+0000","last_unstale":"2023-09-13T02:12:25.575456+0000","last_undegraded":"2023-09-13T02:12:25.575456+0000","last_fullsized":"2023-09-13T02:12:25.575456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257684+0000","last_change":"2023-09-13T02:12:24.591474+0000","last_active":"2023-09-13T02:12:26.257684+0000","last_peered":"2023-09-13T02:12:26.257684+0000","last_clean":"2023-09-13T02:12:26.257684+0000","last_became_active":"2023-09-13T02:12:24.591036+0000","last_became_peered":"2023-09-13T02:12:24.591036+0000","last_unstale":"2023-09-13T02:12:26.257684+0000","last_undegraded":"2023-09-13T02:12:26.257684+0000","last_fullsized":"2023-09-13T02:12:26.257684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579539+0000","last_change":"2023-09-13T02:12:23.584508+0000","last_active":"2023-09-13T02:12:25.579539+0000","last_peered":"2023-09-13T02:12:25.579539+0000","last_clean":"2023-09-13T02:12:25.579539+0000","last_became_active":"2023-09-13T02:12:23.584235+0000","last_became_peered":"2023-09-13T02:12:23.584235+0000","last_unstale":"2023-09-13T02:12:25.579539+0000","last_undegraded":"2023-09-13T02:12:25.579539+0000","last_fullsized":"2023-09-13T02:12:25.579539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258168+0000","last_change":"2023-09-13T02:12:24.593312+0000","last_active":"2023-09-13T02:12:26.258168+0000","last_peered":"2023-09-13T02:12:26.258168+0000","last_clean":"2023-09-13T02:12:26.258168+0000","last_became_active":"2023-09-13T02:12:24.592242+0000","last_became_peered":"2023-09-13T02:12:24.592242+0000","last_unstale":"2023-09-13T02:12:26.258168+0000","last_undegraded":"2023-09-13T02:12:26.258168+0000","last_fullsized":"2023-09-13T02:12:26.258168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:03:12.365120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575647+0000","last_change":"2023-09-13T02:12:23.578204+0000","last_active":"2023-09-13T02:12:25.575647+0000","last_peered":"2023-09-13T02:12:25.575647+0000","last_clean":"2023-09-13T02:12:25.575647+0000","last_became_active":"2023-09-13T02:12:23.577918+0000","last_became_peered":"2023-09-13T02:12:23.577918+0000","last_unstale":"2023-09-13T02:12:25.575647+0000","last_undegraded":"2023-09-13T02:12:25.575647+0000","last_fullsized":"2023-09-13T02:12:25.575647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:24.826159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258382+0000","last_change":"2023-09-13T02:12:24.595748+0000","last_active":"2023-09-13T02:12:26.258382+0000","last_peered":"2023-09-13T02:12:26.258382+0000","last_clean":"2023-09-13T02:12:26.258382+0000","last_became_active":"2023-09-13T02:12:24.595462+0000","last_became_peered":"2023-09-13T02:12:24.595462+0000","last_unstale":"2023-09-13T02:12:26.258382+0000","last_undegraded":"2023-09-13T02:12:26.258382+0000","last_fullsized":"2023-09-13T02:12:26.258382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:52:10.210519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578762+0000","last_change":"2023-09-13T02:12:23.570346+0000","last_active":"2023-09-13T02:12:25.578762+0000","last_peered":"2023-09-13T02:12:25.578762+0000","last_clean":"2023-09-13T02:12:25.578762+0000","last_became_active":"2023-09-13T02:12:23.570066+0000","last_became_peered":"2023-09-13T02:12:23.570066+0000","last_unstale":"2023-09-13T02:12:25.578762+0000","last_undegraded":"2023-09-13T02:12:25.578762+0000","last_fullsized":"2023-09-13T02:12:25.578762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:36.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658261+0000","last_change":"2023-09-13T02:12:24.595650+0000","last_active":"2023-09-13T02:12:25.658261+0000","last_peered":"2023-09-13T02:12:25.658261+0000","last_clean":"2023-09-13T02:12:25.658261+0000","last_became_active":"2023-09-13T02:12:24.595327+0000","last_became_peered":"2023-09-13T02:12:24.595327+0000","last_unstale":"2023-09-13T02:12:25.658261+0000","last_undegraded":"2023-09-13T02:12:25.658261+0000","last_fullsized":"2023-09-13T02:12:25.658261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:43:26.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575622+0000","last_change":"2023-09-13T02:12:23.583113+0000","last_active":"2023-09-13T02:12:25.575622+0000","last_peered":"2023-09-13T02:12:25.575622+0000","last_clean":"2023-09-13T02:12:25.575622+0000","last_became_active":"2023-09-13T02:12:23.582841+0000","last_became_peered":"2023-09-13T02:12:23.582841+0000","last_unstale":"2023-09-13T02:12:25.575622+0000","last_undegraded":"2023-09-13T02:12:25.575622+0000","last_fullsized":"2023-09-13T02:12:25.575622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257997+0000","last_change":"2023-09-13T02:12:24.590616+0000","last_active":"2023-09-13T02:12:26.257997+0000","last_peered":"2023-09-13T02:12:26.257997+0000","last_clean":"2023-09-13T02:12:26.257997+0000","last_became_active":"2023-09-13T02:12:24.590343+0000","last_became_peered":"2023-09-13T02:12:24.590343+0000","last_unstale":"2023-09-13T02:12:26.257997+0000","last_undegraded":"2023-09-13T02:12:26.257997+0000","last_fullsized":"2023-09-13T02:12:26.257997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:15.126313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-13T02:12:24.581028+0000","last_change":"2023-09-13T02:12:13.261542+0000","last_active":"2023-09-13T02:12:24.581028+0000","last_peered":"2023-09-13T02:12:24.581028+0000","last_clean":"2023-09-13T02:12:24.581028+0000","last_became_active":"2023-09-13T02:12:13.260630+0000","last_became_peered":"2023-09-13T02:12:13.260630+0000","last_unstale":"2023-09-13T02:12:24.581028+0000","last_undegraded":"2023-09-13T02:12:24.581028+0000","last_fullsized":"2023-09-13T02:12:24.581028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:12.209844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:12.209844+0000","last_clean_scrub_stamp":"2023-09-13T02:12:12.209844+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:07:47.139624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657930+0000","last_change":"2023-09-13T02:12:23.584227+0000","last_active":"2023-09-13T02:12:25.657930+0000","last_peered":"2023-09-13T02:12:25.657930+0000","last_clean":"2023-09-13T02:12:25.657930+0000","last_became_active":"2023-09-13T02:12:23.583874+0000","last_became_peered":"2023-09-13T02:12:23.583874+0000","last_unstale":"2023-09-13T02:12:25.657930+0000","last_undegraded":"2023-09-13T02:12:25.657930+0000","last_fullsized":"2023-09-13T02:12:25.657930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759254+0000","last_change":"2023-09-13T02:12:24.588833+0000","last_active":"2023-09-13T02:12:25.759254+0000","last_peered":"2023-09-13T02:12:25.759254+0000","last_clean":"2023-09-13T02:12:25.759254+0000","last_became_active":"2023-09-13T02:12:24.588586+0000","last_became_peered":"2023-09-13T02:12:24.588586+0000","last_unstale":"2023-09-13T02:12:25.759254+0000","last_undegraded":"2023-09-13T02:12:25.759254+0000","last_fullsized":"2023-09-13T02:12:25.759254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257567+0000","last_change":"2023-09-13T02:12:23.580928+0000","last_active":"2023-09-13T02:12:26.257567+0000","last_peered":"2023-09-13T02:12:26.257567+0000","last_clean":"2023-09-13T02:12:26.257567+0000","last_became_active":"2023-09-13T02:12:23.580670+0000","last_became_peered":"2023-09-13T02:12:23.580670+0000","last_unstale":"2023-09-13T02:12:26.257567+0000","last_undegraded":"2023-09-13T02:12:26.257567+0000","last_fullsized":"2023-09-13T02:12:26.257567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607517+0000","last_change":"2023-09-13T02:12:24.579008+0000","last_active":"2023-09-13T02:12:25.607517+0000","last_peered":"2023-09-13T02:12:25.607517+0000","last_clean":"2023-09-13T02:12:25.607517+0000","last_became_active":"2023-09-13T02:12:24.578715+0000","last_became_peered":"2023-09-13T02:12:24.578715+0000","last_unstale":"2023-09-13T02:12:25.607517+0000","last_undegraded":"2023-09-13T02:12:25.607517+0000","last_fullsized":"2023-09-13T02:12:25.607517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:04.894368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575647+0000","last_change":"2023-09-13T02:12:23.578080+0000","last_active":"2023-09-13T02:12:25.575647+0000","last_peered":"2023-09-13T02:12:25.575647+0000","last_clean":"2023-09-13T02:12:25.575647+0000","last_became_active":"2023-09-13T02:12:23.577786+0000","last_became_peered":"2023-09-13T02:12:23.577786+0000","last_unstale":"2023-09-13T02:12:25.575647+0000","last_undegraded":"2023-09-13T02:12:25.575647+0000","last_fullsized":"2023-09-13T02:12:25.575647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:51.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578694+0000","last_change":"2023-09-13T02:12:24.582717+0000","last_active":"2023-09-13T02:12:25.578694+0000","last_peered":"2023-09-13T02:12:25.578694+0000","last_clean":"2023-09-13T02:12:25.578694+0000","last_became_active":"2023-09-13T02:12:24.582439+0000","last_became_peered":"2023-09-13T02:12:24.582439+0000","last_unstale":"2023-09-13T02:12:25.578694+0000","last_undegraded":"2023-09-13T02:12:25.578694+0000","last_fullsized":"2023-09-13T02:12:25.578694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658155+0000","last_change":"2023-09-13T02:12:23.585601+0000","last_active":"2023-09-13T02:12:25.658155+0000","last_peered":"2023-09-13T02:12:25.658155+0000","last_clean":"2023-09-13T02:12:25.658155+0000","last_became_active":"2023-09-13T02:12:23.585349+0000","last_became_peered":"2023-09-13T02:12:23.585349+0000","last_unstale":"2023-09-13T02:12:25.658155+0000","last_undegraded":"2023-09-13T02:12:25.658155+0000","last_fullsized":"2023-09-13T02:12:25.658155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:38.820251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579475+0000","last_change":"2023-09-13T02:12:24.586175+0000","last_active":"2023-09-13T02:12:25.579475+0000","last_peered":"2023-09-13T02:12:25.579475+0000","last_clean":"2023-09-13T02:12:25.579475+0000","last_became_active":"2023-09-13T02:12:24.585054+0000","last_became_peered":"2023-09-13T02:12:24.585054+0000","last_unstale":"2023-09-13T02:12:25.579475+0000","last_undegraded":"2023-09-13T02:12:25.579475+0000","last_fullsized":"2023-09-13T02:12:25.579475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:39.029452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578671+0000","last_change":"2023-09-13T02:12:23.580143+0000","last_active":"2023-09-13T02:12:25.578671+0000","last_peered":"2023-09-13T02:12:25.578671+0000","last_clean":"2023-09-13T02:12:25.578671+0000","last_became_active":"2023-09-13T02:12:23.579844+0000","last_became_peered":"2023-09-13T02:12:23.579844+0000","last_unstale":"2023-09-13T02:12:25.578671+0000","last_undegraded":"2023-09-13T02:12:25.578671+0000","last_fullsized":"2023-09-13T02:12:25.578671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:21:49.468231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658375+0000","last_change":"2023-09-13T02:12:24.592756+0000","last_active":"2023-09-13T02:12:25.658375+0000","last_peered":"2023-09-13T02:12:25.658375+0000","last_clean":"2023-09-13T02:12:25.658375+0000","last_became_active":"2023-09-13T02:12:24.592436+0000","last_became_peered":"2023-09-13T02:12:24.592436+0000","last_unstale":"2023-09-13T02:12:25.658375+0000","last_undegraded":"2023-09-13T02:12:25.658375+0000","last_fullsized":"2023-09-13T02:12:25.658375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:03:12.365120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258168+0000","last_change":"2023-09-13T02:12:23.585605+0000","last_active":"2023-09-13T02:12:26.258168+0000","last_peered":"2023-09-13T02:12:26.258168+0000","last_clean":"2023-09-13T02:12:26.258168+0000","last_became_active":"2023-09-13T02:12:23.585411+0000","last_became_peered":"2023-09-13T02:12:23.585411+0000","last_unstale":"2023-09-13T02:12:26.258168+0000","last_undegraded":"2023-09-13T02:12:26.258168+0000","last_fullsized":"2023-09-13T02:12:26.258168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:40.286050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578716+0000","last_change":"2023-09-13T02:12:24.582796+0000","last_active":"2023-09-13T02:12:25.578716+0000","last_peered":"2023-09-13T02:12:25.578716+0000","last_clean":"2023-09-13T02:12:25.578716+0000","last_became_active":"2023-09-13T02:12:24.582517+0000","last_became_peered":"2023-09-13T02:12:24.582517+0000","last_unstale":"2023-09-13T02:12:25.578716+0000","last_undegraded":"2023-09-13T02:12:25.578716+0000","last_fullsized":"2023-09-13T02:12:25.578716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578813+0000","last_change":"2023-09-13T02:12:23.576140+0000","last_active":"2023-09-13T02:12:25.578813+0000","last_peered":"2023-09-13T02:12:25.578813+0000","last_clean":"2023-09-13T02:12:25.578813+0000","last_became_active":"2023-09-13T02:12:23.575875+0000","last_became_peered":"2023-09-13T02:12:23.575875+0000","last_unstale":"2023-09-13T02:12:25.578813+0000","last_undegraded":"2023-09-13T02:12:25.578813+0000","last_fullsized":"2023-09-13T02:12:25.578813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:07.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759378+0000","last_change":"2023-09-13T02:12:24.592556+0000","last_active":"2023-09-13T02:12:25.759378+0000","last_peered":"2023-09-13T02:12:25.759378+0000","last_clean":"2023-09-13T02:12:25.759378+0000","last_became_active":"2023-09-13T02:12:24.592247+0000","last_became_peered":"2023-09-13T02:12:24.592247+0000","last_unstale":"2023-09-13T02:12:25.759378+0000","last_undegraded":"2023-09-13T02:12:25.759378+0000","last_fullsized":"2023-09-13T02:12:25.759378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757473+0000","last_change":"2023-09-13T02:12:23.579687+0000","last_active":"2023-09-13T02:12:25.757473+0000","last_peered":"2023-09-13T02:12:25.757473+0000","last_clean":"2023-09-13T02:12:25.757473+0000","last_became_active":"2023-09-13T02:12:23.579389+0000","last_became_peered":"2023-09-13T02:12:23.579389+0000","last_unstale":"2023-09-13T02:12:25.757473+0000","last_undegraded":"2023-09-13T02:12:25.757473+0000","last_fullsized":"2023-09-13T02:12:25.757473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607754+0000","last_change":"2023-09-13T02:12:24.585029+0000","last_active":"2023-09-13T02:12:25.607754+0000","last_peered":"2023-09-13T02:12:25.607754+0000","last_clean":"2023-09-13T02:12:25.607754+0000","last_became_active":"2023-09-13T02:12:24.584791+0000","last_became_peered":"2023-09-13T02:12:24.584791+0000","last_unstale":"2023-09-13T02:12:25.607754+0000","last_undegraded":"2023-09-13T02:12:25.607754+0000","last_fullsized":"2023-09-13T02:12:25.607754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257573+0000","last_change":"2023-09-13T02:12:23.585601+0000","last_active":"2023-09-13T02:12:26.257573+0000","last_peered":"2023-09-13T02:12:26.257573+0000","last_clean":"2023-09-13T02:12:26.257573+0000","last_became_active":"2023-09-13T02:12:23.585321+0000","last_became_peered":"2023-09-13T02:12:23.585321+0000","last_unstale":"2023-09-13T02:12:26.257573+0000","last_undegraded":"2023-09-13T02:12:26.257573+0000","last_fullsized":"2023-09-13T02:12:26.257573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579437+0000","last_change":"2023-09-13T02:12:24.586947+0000","last_active":"2023-09-13T02:12:25.579437+0000","last_peered":"2023-09-13T02:12:25.579437+0000","last_clean":"2023-09-13T02:12:25.579437+0000","last_became_active":"2023-09-13T02:12:24.586072+0000","last_became_peered":"2023-09-13T02:12:24.586072+0000","last_unstale":"2023-09-13T02:12:25.579437+0000","last_undegraded":"2023-09-13T02:12:25.579437+0000","last_fullsized":"2023-09-13T02:12:25.579437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:50.824236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578663+0000","last_change":"2023-09-13T02:12:23.578914+0000","last_active":"2023-09-13T02:12:25.578663+0000","last_peered":"2023-09-13T02:12:25.578663+0000","last_clean":"2023-09-13T02:12:25.578663+0000","last_became_active":"2023-09-13T02:12:23.578649+0000","last_became_peered":"2023-09-13T02:12:23.578649+0000","last_unstale":"2023-09-13T02:12:25.578663+0000","last_undegraded":"2023-09-13T02:12:25.578663+0000","last_fullsized":"2023-09-13T02:12:25.578663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759041+0000","last_change":"2023-09-13T02:12:24.585743+0000","last_active":"2023-09-13T02:12:25.759041+0000","last_peered":"2023-09-13T02:12:25.759041+0000","last_clean":"2023-09-13T02:12:25.759041+0000","last_became_active":"2023-09-13T02:12:24.585508+0000","last_became_peered":"2023-09-13T02:12:24.585508+0000","last_unstale":"2023-09-13T02:12:25.759041+0000","last_undegraded":"2023-09-13T02:12:25.759041+0000","last_fullsized":"2023-09-13T02:12:25.759041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578790+0000","last_change":"2023-09-13T02:12:23.578387+0000","last_active":"2023-09-13T02:12:25.578790+0000","last_peered":"2023-09-13T02:12:25.578790+0000","last_clean":"2023-09-13T02:12:25.578790+0000","last_became_active":"2023-09-13T02:12:23.578121+0000","last_became_peered":"2023-09-13T02:12:23.578121+0000","last_unstale":"2023-09-13T02:12:25.578790+0000","last_undegraded":"2023-09-13T02:12:25.578790+0000","last_fullsized":"2023-09-13T02:12:25.578790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:32.660244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759336+0000","last_change":"2023-09-13T02:12:24.587304+0000","last_active":"2023-09-13T02:12:25.759336+0000","last_peered":"2023-09-13T02:12:25.759336+0000","last_clean":"2023-09-13T02:12:25.759336+0000","last_became_active":"2023-09-13T02:12:24.587040+0000","last_became_peered":"2023-09-13T02:12:24.587040+0000","last_unstale":"2023-09-13T02:12:25.759336+0000","last_undegraded":"2023-09-13T02:12:25.759336+0000","last_fullsized":"2023-09-13T02:12:25.759336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:18.256464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258112+0000","last_change":"2023-09-13T02:12:23.578623+0000","last_active":"2023-09-13T02:12:26.258112+0000","last_peered":"2023-09-13T02:12:26.258112+0000","last_clean":"2023-09-13T02:12:26.258112+0000","last_became_active":"2023-09-13T02:12:23.578258+0000","last_became_peered":"2023-09-13T02:12:23.578258+0000","last_unstale":"2023-09-13T02:12:26.258112+0000","last_undegraded":"2023-09-13T02:12:26.258112+0000","last_fullsized":"2023-09-13T02:12:26.258112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:18:54.951761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757225+0000","last_change":"2023-09-13T02:12:24.590763+0000","last_active":"2023-09-13T02:12:25.757225+0000","last_peered":"2023-09-13T02:12:25.757225+0000","last_clean":"2023-09-13T02:12:25.757225+0000","last_became_active":"2023-09-13T02:12:24.590494+0000","last_became_peered":"2023-09-13T02:12:24.590494+0000","last_unstale":"2023-09-13T02:12:25.757225+0000","last_undegraded":"2023-09-13T02:12:25.757225+0000","last_fullsized":"2023-09-13T02:12:25.757225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658298+0000","last_change":"2023-09-13T02:12:24.597290+0000","last_active":"2023-09-13T02:12:25.658298+0000","last_peered":"2023-09-13T02:12:25.658298+0000","last_clean":"2023-09-13T02:12:25.658298+0000","last_became_active":"2023-09-13T02:12:24.597024+0000","last_became_peered":"2023-09-13T02:12:24.597024+0000","last_unstale":"2023-09-13T02:12:25.658298+0000","last_undegraded":"2023-09-13T02:12:25.658298+0000","last_fullsized":"2023-09-13T02:12:25.658298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:15.126313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257895+0000","last_change":"2023-09-13T02:12:23.584941+0000","last_active":"2023-09-13T02:12:26.257895+0000","last_peered":"2023-09-13T02:12:26.257895+0000","last_clean":"2023-09-13T02:12:26.257895+0000","last_became_active":"2023-09-13T02:12:23.584671+0000","last_became_peered":"2023-09-13T02:12:23.584671+0000","last_unstale":"2023-09-13T02:12:26.257895+0000","last_undegraded":"2023-09-13T02:12:26.257895+0000","last_fullsized":"2023-09-13T02:12:26.257895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:38.089400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658128+0000","last_change":"2023-09-13T02:12:24.596615+0000","last_active":"2023-09-13T02:12:25.658128+0000","last_peered":"2023-09-13T02:12:25.658128+0000","last_clean":"2023-09-13T02:12:25.658128+0000","last_became_active":"2023-09-13T02:12:24.595918+0000","last_became_peered":"2023-09-13T02:12:24.595918+0000","last_unstale":"2023-09-13T02:12:25.658128+0000","last_undegraded":"2023-09-13T02:12:25.658128+0000","last_fullsized":"2023-09-13T02:12:25.658128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:18:08.378805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258039+0000","last_change":"2023-09-13T02:12:23.579507+0000","last_active":"2023-09-13T02:12:26.258039+0000","last_peered":"2023-09-13T02:12:26.258039+0000","last_clean":"2023-09-13T02:12:26.258039+0000","last_became_active":"2023-09-13T02:12:23.579239+0000","last_became_peered":"2023-09-13T02:12:23.579239+0000","last_unstale":"2023-09-13T02:12:26.258039+0000","last_undegraded":"2023-09-13T02:12:26.258039+0000","last_fullsized":"2023-09-13T02:12:26.258039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:11.224076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607799+0000","last_change":"2023-09-13T02:12:24.589292+0000","last_active":"2023-09-13T02:12:25.607799+0000","last_peered":"2023-09-13T02:12:25.607799+0000","last_clean":"2023-09-13T02:12:25.607799+0000","last_became_active":"2023-09-13T02:12:24.589039+0000","last_became_peered":"2023-09-13T02:12:24.589039+0000","last_unstale":"2023-09-13T02:12:25.607799+0000","last_undegraded":"2023-09-13T02:12:25.607799+0000","last_fullsized":"2023-09-13T02:12:25.607799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759226+0000","last_change":"2023-09-13T02:12:23.584177+0000","last_active":"2023-09-13T02:12:25.759226+0000","last_peered":"2023-09-13T02:12:25.759226+0000","last_clean":"2023-09-13T02:12:25.759226+0000","last_became_active":"2023-09-13T02:12:23.583920+0000","last_became_peered":"2023-09-13T02:12:23.583920+0000","last_unstale":"2023-09-13T02:12:25.759226+0000","last_undegraded":"2023-09-13T02:12:25.759226+0000","last_fullsized":"2023-09-13T02:12:25.759226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:21:49.468231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759093+0000","last_change":"2023-09-13T02:12:24.588205+0000","last_active":"2023-09-13T02:12:25.759093+0000","last_peered":"2023-09-13T02:12:25.759093+0000","last_clean":"2023-09-13T02:12:25.759093+0000","last_became_active":"2023-09-13T02:12:24.587697+0000","last_became_peered":"2023-09-13T02:12:24.587697+0000","last_unstale":"2023-09-13T02:12:25.759093+0000","last_undegraded":"2023-09-13T02:12:25.759093+0000","last_fullsized":"2023-09-13T02:12:25.759093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607876+0000","last_change":"2023-09-13T02:12:23.583748+0000","last_active":"2023-09-13T02:12:25.607876+0000","last_peered":"2023-09-13T02:12:25.607876+0000","last_clean":"2023-09-13T02:12:25.607876+0000","last_became_active":"2023-09-13T02:12:23.583443+0000","last_became_peered":"2023-09-13T02:12:23.583443+0000","last_unstale":"2023-09-13T02:12:25.607876+0000","last_undegraded":"2023-09-13T02:12:25.607876+0000","last_fullsized":"2023-09-13T02:12:25.607876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T02:12:28.124 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-13T02:12:28.125 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2023-09-13T02:12:28.125 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-13T02:12:28.261 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.260+0000 7fbee9df5640 1 -- 172.21.15.104:0/3314745683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbecc005180 msgr2=0x7fbecc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:28.262 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.260+0000 7fbee9df5640 1 --2- 172.21.15.104:0/3314745683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbecc005180 0x7fbecc00b980 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbedc001d80 tx=0x7fbecc0057f0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.262 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.260+0000 7fbee9df5640 1 -- 172.21.15.104:0/3314745683 shutdown_connections 2023-09-13T02:12:28.262 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.260+0000 7fbee9df5640 1 --2- 172.21.15.104:0/3314745683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbecc005180 0x7fbecc00b980 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.263 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.260+0000 7fbee9df5640 1 -- 172.21.15.104:0/3314745683 >> 172.21.15.104:0/3314745683 conn(0x7fbee40708b0 msgr2=0x7fbee4070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:28.263 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.260+0000 7fbee9df5640 1 -- 172.21.15.104:0/3314745683 shutdown_connections 2023-09-13T02:12:28.263 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.260+0000 7fbee9df5640 1 -- 172.21.15.104:0/3314745683 wait complete. 2023-09-13T02:12:28.265 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.261+0000 7fbee9df5640 1 Processor -- start 2023-09-13T02:12:28.266 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.261+0000 7fbee9df5640 1 -- start start 2023-09-13T02:12:28.266 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.262+0000 7fbee9df5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbecc005180 0x7fbee413c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:28.266 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.262+0000 7fbee9df5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbee413d150 0x7fbee41cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:28.266 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.262+0000 7fbee9df5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbee41d0350 0x7fbee41da810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:28.267 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.262+0000 7fbee9df5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee41458c0 con 0x7fbecc005180 2023-09-13T02:12:28.267 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.262+0000 7fbee9df5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee413d950 con 0x7fbee41d0350 2023-09-13T02:12:28.267 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.262+0000 7fbee9df5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee413dc30 con 0x7fbee413d150 2023-09-13T02:12:28.267 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.262+0000 7fbee37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbecc005180 0x7fbee413c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:28.267 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.262+0000 7fbee37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbecc005180 0x7fbee413c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47078/0 (socket says 172.21.15.104:47078) 2023-09-13T02:12:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.262+0000 7fbee37fe640 1 -- 172.21.15.104:0/567319106 learned_addr learned my addr 172.21.15.104:0/567319106 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.262+0000 7fbee2ffd640 1 --2- 172.21.15.104:0/567319106 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbee413d150 0x7fbee41cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.262+0000 7fbee3fff640 1 --2- 172.21.15.104:0/567319106 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbee41d0350 0x7fbee41da810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.262+0000 7fbee37fe640 1 -- 172.21.15.104:0/567319106 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbee413d150 msgr2=0x7fbee41cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.262+0000 7fbee37fe640 1 --2- 172.21.15.104:0/567319106 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbee413d150 0x7fbee41cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.269 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.262+0000 7fbee37fe640 1 -- 172.21.15.104:0/567319106 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbee41d0350 msgr2=0x7fbee41da810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:28.269 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.262+0000 7fbee37fe640 1 --2- 172.21.15.104:0/567319106 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbee41d0350 0x7fbee41da810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.269 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.262+0000 7fbee37fe640 1 -- 172.21.15.104:0/567319106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee413ed60 con 0x7fbecc005180 2023-09-13T02:12:28.269 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.263+0000 7fbee37fe640 1 --2- 172.21.15.104:0/567319106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbecc005180 0x7fbee413c420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbed4011ab0 tx=0x7fbed4011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:28.269 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.263+0000 7fbecbfff640 1 -- 172.21.15.104:0/567319106 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4004460 con 0x7fbecc005180 2023-09-13T02:12:28.270 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.263+0000 7fbecbfff640 1 -- 172.21.15.104:0/567319106 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbed400f9a0 con 0x7fbecc005180 2023-09-13T02:12:28.270 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.263+0000 7fbee9df5640 1 -- 172.21.15.104:0/567319106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee413dfa0 con 0x7fbecc005180 2023-09-13T02:12:28.270 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.263+0000 7fbecbfff640 1 -- 172.21.15.104:0/567319106 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed400fd90 con 0x7fbecc005180 2023-09-13T02:12:28.270 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.263+0000 7fbee9df5640 1 -- 172.21.15.104:0/567319106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee41dad50 con 0x7fbecc005180 2023-09-13T02:12:28.270 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.264+0000 7fbee9df5640 1 -- 172.21.15.104:0/567319106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee413d7b0 con 0x7fbecc005180 2023-09-13T02:12:28.271 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.264+0000 7fbecbfff640 1 -- 172.21.15.104:0/567319106 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fbed40035f0 con 0x7fbecc005180 2023-09-13T02:12:28.271 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.264+0000 7fbecbfff640 1 --2- 172.21.15.104:0/567319106 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fbed006a4f0 0x7fbed006c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:28.271 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.264+0000 7fbecbfff640 1 -- 172.21.15.104:0/567319106 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbed40896c0 con 0x7fbecc005180 2023-09-13T02:12:28.271 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.265+0000 7fbee2ffd640 1 --2- 172.21.15.104:0/567319106 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fbed006a4f0 0x7fbed006c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:28.271 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.265+0000 7fbee2ffd640 1 --2- 172.21.15.104:0/567319106 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fbed006a4f0 0x7fbed006c9b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbed8001050 tx=0x7fbed8000fe0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:28.272 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.269+0000 7fbecbfff640 1 -- 172.21.15.104:0/567319106 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fbee413d7b0 con 0x7fbecc005180 2023-09-13T02:12:28.435 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.434+0000 7fbee9df5640 1 -- 172.21.15.104:0/567319106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7fbee413d7b0 con 0x7fbecc005180 2023-09-13T02:12:28.436 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.435+0000 7fbecbfff640 1 -- 172.21.15.104:0/567319106 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v30) v1 ==== 86+0+160 (secure 0 0 0) 0x7fbee413d7b0 con 0x7fbecc005180 2023-09-13T02:12:28.436 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:28.438 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.437+0000 7fbee9df5640 1 -- 172.21.15.104:0/567319106 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fbed006a4f0 msgr2=0x7fbed006c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:28.438 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.437+0000 7fbee9df5640 1 --2- 172.21.15.104:0/567319106 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fbed006a4f0 0x7fbed006c9b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbed8001050 tx=0x7fbed8000fe0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.438 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.437+0000 7fbee9df5640 1 -- 172.21.15.104:0/567319106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbecc005180 msgr2=0x7fbee413c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:28.439 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.437+0000 7fbee9df5640 1 --2- 172.21.15.104:0/567319106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbecc005180 0x7fbee413c420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbed4011ab0 tx=0x7fbed4011eb0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.439 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.437+0000 7fbee9df5640 1 -- 172.21.15.104:0/567319106 shutdown_connections 2023-09-13T02:12:28.439 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.437+0000 7fbee9df5640 1 --2- 172.21.15.104:0/567319106 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fbed006a4f0 0x7fbed006c9b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.439 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.437+0000 7fbee9df5640 1 --2- 172.21.15.104:0/567319106 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbee41d0350 0x7fbee41da810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.440 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.437+0000 7fbee9df5640 1 --2- 172.21.15.104:0/567319106 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbee413d150 0x7fbee41cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.440 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.437+0000 7fbee9df5640 1 --2- 172.21.15.104:0/567319106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbecc005180 0x7fbee413c420 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.440 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.437+0000 7fbee9df5640 1 -- 172.21.15.104:0/567319106 >> 172.21.15.104:0/567319106 conn(0x7fbee40708b0 msgr2=0x7fbee40653e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:28.440 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.437+0000 7fbee9df5640 1 -- 172.21.15.104:0/567319106 shutdown_connections 2023-09-13T02:12:28.440 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.437+0000 7fbee9df5640 1 -- 172.21.15.104:0/567319106 wait complete. 2023-09-13T02:12:28.448 INFO:teuthology.orchestra.run.smithi104.stdout:[{"version":30,"timestamp":"2023-09-13T02:12:10.241704+0000","name":"","changes":[{"name":"osd.7/osd_mclock_max_capacity_iops_ssd","new_value":"5512.668293"}]}] 2023-09-13T02:12:28.448 INFO:tasks.ceph_manager:config epoch is 30 2023-09-13T02:12:28.449 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-13T02:12:28.449 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-13T02:12:28.449 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-13T02:12:28.551 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.550+0000 7fdf85fa9640 1 -- 172.21.15.104:0/2892213206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf680052a0 msgr2=0x7fdf6800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:28.551 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.550+0000 7fdf85fa9640 1 --2- 172.21.15.104:0/2892213206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf680052a0 0x7fdf6800b980 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdf78001d50 tx=0x7fdf680057f0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.552 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.550+0000 7fdf85fa9640 1 -- 172.21.15.104:0/2892213206 shutdown_connections 2023-09-13T02:12:28.552 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.550+0000 7fdf85fa9640 1 --2- 172.21.15.104:0/2892213206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf680052a0 0x7fdf6800b980 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.552 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.550+0000 7fdf85fa9640 1 -- 172.21.15.104:0/2892213206 >> 172.21.15.104:0/2892213206 conn(0x7fdf80069570 msgr2=0x7fdf80069980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:28.552 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.550+0000 7fdf85fa9640 1 -- 172.21.15.104:0/2892213206 shutdown_connections 2023-09-13T02:12:28.553 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.550+0000 7fdf85fa9640 1 -- 172.21.15.104:0/2892213206 wait complete. 2023-09-13T02:12:28.555 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.551+0000 7fdf85fa9640 1 Processor -- start 2023-09-13T02:12:28.555 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.551+0000 7fdf85fa9640 1 -- start start 2023-09-13T02:12:28.555 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf85fa9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf680052a0 0x7fdf801437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:28.556 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf85fa9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8006e310 0x7fdf8013dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:28.556 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf85fa9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf801db260 0x7fdf80137ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:28.556 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf85fa9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf800b18a0 con 0x7fdf8006e310 2023-09-13T02:12:28.556 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf85fa9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8013db50 con 0x7fdf801db260 2023-09-13T02:12:28.556 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf85fa9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf800b0a70 con 0x7fdf680052a0 2023-09-13T02:12:28.557 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf7effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8006e310 0x7fdf8013dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:28.557 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf7effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8006e310 0x7fdf8013dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47092/0 (socket says 172.21.15.104:47092) 2023-09-13T02:12:28.557 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf7effd640 1 -- 172.21.15.104:0/711928260 learned_addr learned my addr 172.21.15.104:0/711928260 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:28.557 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf7f7fe640 1 --2- 172.21.15.104:0/711928260 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf680052a0 0x7fdf801437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:28.557 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf7ffff640 1 --2- 172.21.15.104:0/711928260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf801db260 0x7fdf80137ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:28.557 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf7effd640 1 -- 172.21.15.104:0/711928260 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf680052a0 msgr2=0x7fdf801437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:28.558 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf7effd640 1 --2- 172.21.15.104:0/711928260 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf680052a0 0x7fdf801437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.558 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf7effd640 1 -- 172.21.15.104:0/711928260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf801db260 msgr2=0x7fdf80137ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:28.558 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf7effd640 1 --2- 172.21.15.104:0/711928260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf801db260 0x7fdf80137ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.558 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf7effd640 1 -- 172.21.15.104:0/711928260 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8006e820 con 0x7fdf8006e310 2023-09-13T02:12:28.558 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf7f7fe640 1 --2- 172.21.15.104:0/711928260 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf680052a0 0x7fdf801437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:28.559 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf7effd640 1 --2- 172.21.15.104:0/711928260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8006e310 0x7fdf8013dfe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdf74006630 tx=0x7fdf740039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:28.559 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf67fff640 1 -- 172.21.15.104:0/711928260 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74011840 con 0x7fdf8006e310 2023-09-13T02:12:28.559 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf67fff640 1 -- 172.21.15.104:0/711928260 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdf740119a0 con 0x7fdf8006e310 2023-09-13T02:12:28.559 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf67fff640 1 -- 172.21.15.104:0/711928260 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74011db0 con 0x7fdf8006e310 2023-09-13T02:12:28.559 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf85fa9640 1 -- 172.21.15.104:0/711928260 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8006eb00 con 0x7fdf8006e310 2023-09-13T02:12:28.560 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.552+0000 7fdf85fa9640 1 -- 172.21.15.104:0/711928260 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf80138400 con 0x7fdf8006e310 2023-09-13T02:12:28.560 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.553+0000 7fdf85fa9640 1 -- 172.21.15.104:0/711928260 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf800b1700 con 0x7fdf8006e310 2023-09-13T02:12:28.560 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.554+0000 7fdf67fff640 1 -- 172.21.15.104:0/711928260 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fdf740103c0 con 0x7fdf8006e310 2023-09-13T02:12:28.560 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.554+0000 7fdf67fff640 1 --2- 172.21.15.104:0/711928260 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdf6c06a520 0x7fdf6c06c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:28.560 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.554+0000 7fdf7f7fe640 1 --2- 172.21.15.104:0/711928260 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdf6c06a520 0x7fdf6c06c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:28.561 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.554+0000 7fdf67fff640 1 -- 172.21.15.104:0/711928260 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf74089bc0 con 0x7fdf8006e310 2023-09-13T02:12:28.561 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.555+0000 7fdf7f7fe640 1 --2- 172.21.15.104:0/711928260 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdf6c06a520 0x7fdf6c06c9e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf8013d7e0 tx=0x7fdf70005f90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:28.561 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.558+0000 7fdf67fff640 1 -- 172.21.15.104:0/711928260 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdf800b1700 con 0x7fdf8006e310 2023-09-13T02:12:28.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.770+0000 7fdf85fa9640 1 -- 172.21.15.104:0/711928260 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fdf800b1700 con 0x7fdf8006e310 2023-09-13T02:12:28.774 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.773+0000 7fdf67fff640 1 -- 172.21.15.104:0/711928260 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170110 (secure 0 0 0) 0x7fdf800b1700 con 0x7fdf8006e310 2023-09-13T02:12:28.776 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:28.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.776+0000 7fdf85fa9640 1 -- 172.21.15.104:0/711928260 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdf6c06a520 msgr2=0x7fdf6c06c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:28.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.776+0000 7fdf85fa9640 1 --2- 172.21.15.104:0/711928260 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdf6c06a520 0x7fdf6c06c9e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf8013d7e0 tx=0x7fdf70005f90 comp rx=0 tx=0).stop 2023-09-13T02:12:28.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.776+0000 7fdf85fa9640 1 -- 172.21.15.104:0/711928260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8006e310 msgr2=0x7fdf8013dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:28.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.776+0000 7fdf85fa9640 1 --2- 172.21.15.104:0/711928260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8006e310 0x7fdf8013dfe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdf74006630 tx=0x7fdf740039c0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.776+0000 7fdf85fa9640 1 -- 172.21.15.104:0/711928260 shutdown_connections 2023-09-13T02:12:28.779 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.776+0000 7fdf85fa9640 1 --2- 172.21.15.104:0/711928260 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdf6c06a520 0x7fdf6c06c9e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.779 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.776+0000 7fdf85fa9640 1 --2- 172.21.15.104:0/711928260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf801db260 0x7fdf80137ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.779 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.776+0000 7fdf85fa9640 1 --2- 172.21.15.104:0/711928260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8006e310 0x7fdf8013dfe0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.779 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.776+0000 7fdf85fa9640 1 --2- 172.21.15.104:0/711928260 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf680052a0 0x7fdf801437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.776+0000 7fdf85fa9640 1 -- 172.21.15.104:0/711928260 >> 172.21.15.104:0/711928260 conn(0x7fdf80069570 msgr2=0x7fdf80140560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:28.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.776+0000 7fdf85fa9640 1 -- 172.21.15.104:0/711928260 shutdown_connections 2023-09-13T02:12:28.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.776+0000 7fdf85fa9640 1 -- 172.21.15.104:0/711928260 wait complete. 2023-09-13T02:12:28.787 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":5,"active_gid":4182,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3152101627},{"type":"v1","addr":"172.21.15.104:6833","nonce":3152101627}]},"active_addr":"172.21.15.104:6833/3152101627","active_change":"2023-09-13T02:12:04.023273+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4183,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":2562040007}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":1749108648}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":3733870027}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":129785235}]}]} 2023-09-13T02:12:28.791 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-13T02:12:28.791 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-13T02:12:28.792 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T02:12:28.894 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.893+0000 7fd05c0e1640 1 -- 172.21.15.104:0/393956992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0540af820 msgr2=0x7fd0540b2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:28.895 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.893+0000 7fd05c0e1640 1 --2- 172.21.15.104:0/393956992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0540af820 0x7fd0540b2c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd04c005fd0 tx=0x7fd04c02c1b0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.895 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.893+0000 7fd05c0e1640 1 -- 172.21.15.104:0/393956992 shutdown_connections 2023-09-13T02:12:28.895 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.893+0000 7fd05c0e1640 1 --2- 172.21.15.104:0/393956992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0540af820 0x7fd0540b2c20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.895 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.893+0000 7fd05c0e1640 1 --2- 172.21.15.104:0/393956992 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0540b1800 0x7fd0540aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.895 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.893+0000 7fd05c0e1640 1 -- 172.21.15.104:0/393956992 >> 172.21.15.104:0/393956992 conn(0x7fd054069360 msgr2=0x7fd054069740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:28.895 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.893+0000 7fd05c0e1640 1 -- 172.21.15.104:0/393956992 shutdown_connections 2023-09-13T02:12:28.896 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.893+0000 7fd05c0e1640 1 -- 172.21.15.104:0/393956992 wait complete. 2023-09-13T02:12:28.898 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.894+0000 7fd05c0e1640 1 Processor -- start 2023-09-13T02:12:28.898 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.894+0000 7fd05c0e1640 1 -- start start 2023-09-13T02:12:28.899 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.894+0000 7fd05c0e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0540af820 0x7fd05413d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:28.899 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.894+0000 7fd05c0e1640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0540b1800 0x7fd054139e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:28.899 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.894+0000 7fd05c0e1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd054144420 0x7fd054133c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:28.899 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.894+0000 7fd05c0e1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd054142110 con 0x7fd0540af820 2023-09-13T02:12:28.899 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.894+0000 7fd05c0e1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05413a360 con 0x7fd054144420 2023-09-13T02:12:28.900 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.894+0000 7fd05c0e1640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd054139640 con 0x7fd0540b1800 2023-09-13T02:12:28.900 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.894+0000 7fd059e7d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0540af820 0x7fd05413d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:28.900 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.895+0000 7fd059e7d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0540af820 0x7fd05413d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47100/0 (socket says 172.21.15.104:47100) 2023-09-13T02:12:28.900 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.895+0000 7fd059e7d640 1 -- 172.21.15.104:0/1297789144 learned_addr learned my addr 172.21.15.104:0/1297789144 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:28.900 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.895+0000 7fd05967c640 1 --2- 172.21.15.104:0/1297789144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0540b1800 0x7fd054139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:28.901 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.895+0000 7fd05a67e640 1 --2- 172.21.15.104:0/1297789144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd054144420 0x7fd054133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:28.901 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.895+0000 7fd059e7d640 1 -- 172.21.15.104:0/1297789144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0540b1800 msgr2=0x7fd054139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:28.901 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.895+0000 7fd059e7d640 1 --2- 172.21.15.104:0/1297789144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0540b1800 0x7fd054139e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.901 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.895+0000 7fd059e7d640 1 -- 172.21.15.104:0/1297789144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd054144420 msgr2=0x7fd054133c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:28.901 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.895+0000 7fd059e7d640 1 --2- 172.21.15.104:0/1297789144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd054144420 0x7fd054133c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:28.902 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.895+0000 7fd059e7d640 1 -- 172.21.15.104:0/1297789144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd050009490 con 0x7fd0540af820 2023-09-13T02:12:28.902 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.895+0000 7fd05a67e640 1 --2- 172.21.15.104:0/1297789144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd054144420 0x7fd054133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:28.902 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.895+0000 7fd059e7d640 1 --2- 172.21.15.104:0/1297789144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0540af820 0x7fd05413d200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd05000ea60 tx=0x7fd05000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:28.902 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.895+0000 7fd04a7fc640 1 -- 172.21.15.104:0/1297789144 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05000cde0 con 0x7fd0540af820 2023-09-13T02:12:28.902 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.895+0000 7fd04a7fc640 1 -- 172.21.15.104:0/1297789144 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd050004020 con 0x7fd0540af820 2023-09-13T02:12:28.902 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.895+0000 7fd05c0e1640 1 -- 172.21.15.104:0/1297789144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04c009900 con 0x7fd0540af820 2023-09-13T02:12:28.903 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.895+0000 7fd04a7fc640 1 -- 172.21.15.104:0/1297789144 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050004410 con 0x7fd0540af820 2023-09-13T02:12:28.903 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.895+0000 7fd05c0e1640 1 -- 172.21.15.104:0/1297789144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd054139900 con 0x7fd0540af820 2023-09-13T02:12:28.903 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.896+0000 7fd05c0e1640 1 -- 172.21.15.104:0/1297789144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05404e100 con 0x7fd0540af820 2023-09-13T02:12:28.903 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.897+0000 7fd04a7fc640 1 -- 172.21.15.104:0/1297789144 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd0500035f0 con 0x7fd0540af820 2023-09-13T02:12:28.903 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.897+0000 7fd04a7fc640 1 --2- 172.21.15.104:0/1297789144 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd03806a4f0 0x7fd03806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:28.904 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.897+0000 7fd05967c640 1 --2- 172.21.15.104:0/1297789144 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd03806a4f0 0x7fd03806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:28.904 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.897+0000 7fd04a7fc640 1 -- 172.21.15.104:0/1297789144 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd050014070 con 0x7fd0540af820 2023-09-13T02:12:28.904 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.897+0000 7fd05967c640 1 --2- 172.21.15.104:0/1297789144 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd03806a4f0 0x7fd03806c9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd0541393c0 tx=0x7fd044009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:28.904 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:28.901+0000 7fd04a7fc640 1 -- 172.21.15.104:0/1297789144 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd050054b40 con 0x7fd0540af820 2023-09-13T02:12:29.070 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.069+0000 7fd05c0e1640 1 -- 172.21.15.104:0/1297789144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0540af4d0 con 0x7fd0540af820 2023-09-13T02:12:29.071 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.070+0000 7fd04a7fc640 1 -- 172.21.15.104:0/1297789144 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fd050058160 con 0x7fd0540af820 2023-09-13T02:12:29.071 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:29.072 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"ac1f5a95-0d3a-406e-b4ca-c8ea43282cab","created":"2023-09-13T02:11:59.067178+0000","modified":"2023-09-13T02:12:25.572652+0000","last_up_change":"2023-09-13T02:12:11.207888+0000","last_in_change":"2023-09-13T02:12:02.278796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T02:12:12.071023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T02:12:22.114609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T02:12:22.880593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67190066-4851-4b1f-aae8-bad59e79ebb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6801","nonce":3271772377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6803","nonce":3271772377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6807","nonce":3271772377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6805","nonce":3271772377}]},"public_addr":"172.21.15.104:6801/3271772377","cluster_addr":"172.21.15.104:6803/3271772377","heartbeat_back_addr":"172.21.15.104:6807/3271772377","heartbeat_front_addr":"172.21.15.104:6805/3271772377","state":["exists","up"]},{"osd":1,"uuid":"f1907075-bb97-4a19-8dd6-322232caaf4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6809","nonce":3786698894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6811","nonce":3786698894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6815","nonce":3786698894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6813","nonce":3786698894}]},"public_addr":"172.21.15.104:6809/3786698894","cluster_addr":"172.21.15.104:6811/3786698894","heartbeat_back_addr":"172.21.15.104:6815/3786698894","heartbeat_front_addr":"172.21.15.104:6813/3786698894","state":["exists","up"]},{"osd":2,"uuid":"8c323c83-330c-4181-b622-10177c81f975","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6819","nonce":2319361072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6822","nonce":2319361072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6827","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6829","nonce":2319361072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6826","nonce":2319361072}]},"public_addr":"172.21.15.104:6819/2319361072","cluster_addr":"172.21.15.104:6822/2319361072","heartbeat_back_addr":"172.21.15.104:6829/2319361072","heartbeat_front_addr":"172.21.15.104:6826/2319361072","state":["exists","up"]},{"osd":3,"uuid":"811457f5-c408-488d-a4ed-b947d1c55e82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6818","nonce":621253853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6823","nonce":621253853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6831","nonce":621253853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6825","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6828","nonce":621253853}]},"public_addr":"172.21.15.104:6818/621253853","cluster_addr":"172.21.15.104:6823/621253853","heartbeat_back_addr":"172.21.15.104:6831/621253853","heartbeat_front_addr":"172.21.15.104:6828/621253853","state":["exists","up"]},{"osd":4,"uuid":"552010ea-7d61-47c7-b4ac-657845e55e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6801","nonce":3049794634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6803","nonce":3049794634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6807","nonce":3049794634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6805","nonce":3049794634}]},"public_addr":"172.21.15.119:6801/3049794634","cluster_addr":"172.21.15.119:6803/3049794634","heartbeat_back_addr":"172.21.15.119:6807/3049794634","heartbeat_front_addr":"172.21.15.119:6805/3049794634","state":["exists","up"]},{"osd":5,"uuid":"41f415b0-6886-44ed-bccc-57c46cc975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6809","nonce":2918159428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6811","nonce":2918159428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6815","nonce":2918159428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6813","nonce":2918159428}]},"public_addr":"172.21.15.119:6809/2918159428","cluster_addr":"172.21.15.119:6811/2918159428","heartbeat_back_addr":"172.21.15.119:6815/2918159428","heartbeat_front_addr":"172.21.15.119:6813/2918159428","state":["exists","up"]},{"osd":6,"uuid":"1f415570-dbcc-4cb9-930a-ad31a96c3ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6825","nonce":3509665357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6827","nonce":3509665357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6831","nonce":3509665357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6829","nonce":3509665357}]},"public_addr":"172.21.15.119:6825/3509665357","cluster_addr":"172.21.15.119:6827/3509665357","heartbeat_back_addr":"172.21.15.119:6831/3509665357","heartbeat_front_addr":"172.21.15.119:6829/3509665357","state":["exists","up"]},{"osd":7,"uuid":"ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6817","nonce":892749725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6819","nonce":892749725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6823","nonce":892749725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6821","nonce":892749725}]},"public_addr":"172.21.15.119:6817/892749725","cluster_addr":"172.21.15.119:6819/892749725","heartbeat_back_addr":"172.21.15.119:6823/892749725","heartbeat_front_addr":"172.21.15.119:6821/892749725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.489481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.468615+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.485958+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.424425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.456308+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.427607+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T02:12:29.073 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.072+0000 7fd05c0e1640 1 -- 172.21.15.104:0/1297789144 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd03806a4f0 msgr2=0x7fd03806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.073 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.072+0000 7fd05c0e1640 1 --2- 172.21.15.104:0/1297789144 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd03806a4f0 0x7fd03806c9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd0541393c0 tx=0x7fd044009040 comp rx=0 tx=0).stop 2023-09-13T02:12:29.073 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.072+0000 7fd05c0e1640 1 -- 172.21.15.104:0/1297789144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0540af820 msgr2=0x7fd05413d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.074 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.072+0000 7fd05c0e1640 1 --2- 172.21.15.104:0/1297789144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0540af820 0x7fd05413d200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd05000ea60 tx=0x7fd05000ef20 comp rx=0 tx=0).stop 2023-09-13T02:12:29.074 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.072+0000 7fd05c0e1640 1 -- 172.21.15.104:0/1297789144 shutdown_connections 2023-09-13T02:12:29.074 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.072+0000 7fd05c0e1640 1 --2- 172.21.15.104:0/1297789144 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd03806a4f0 0x7fd03806c9b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.074 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.072+0000 7fd05c0e1640 1 --2- 172.21.15.104:0/1297789144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd054144420 0x7fd054133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.075 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.072+0000 7fd05c0e1640 1 --2- 172.21.15.104:0/1297789144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0540b1800 0x7fd054139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.075 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.072+0000 7fd05c0e1640 1 --2- 172.21.15.104:0/1297789144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0540af820 0x7fd05413d200 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.075 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.072+0000 7fd05c0e1640 1 -- 172.21.15.104:0/1297789144 >> 172.21.15.104:0/1297789144 conn(0x7fd054069360 msgr2=0x7fd054069740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.075 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.072+0000 7fd05c0e1640 1 -- 172.21.15.104:0/1297789144 shutdown_connections 2023-09-13T02:12:29.075 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.072+0000 7fd05c0e1640 1 -- 172.21.15.104:0/1297789144 wait complete. 2023-09-13T02:12:29.084 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-13T02:12:29.084 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T02:12:29.185 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.184+0000 7f73ae190640 1 -- 172.21.15.104:0/1218573337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73a8143dc0 msgr2=0x7f73a8144250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.186 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.184+0000 7f73ae190640 1 --2- 172.21.15.104:0/1218573337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73a8143dc0 0x7f73a8144250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f73a80b17d0 tx=0x7f73a002c1d0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.186 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.184+0000 7f73ae190640 1 -- 172.21.15.104:0/1218573337 shutdown_connections 2023-09-13T02:12:29.186 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.184+0000 7f73ae190640 1 --2- 172.21.15.104:0/1218573337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73a8143dc0 0x7f73a8144250 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.184+0000 7f73ae190640 1 --2- 172.21.15.104:0/1218573337 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73a813a500 0x7f73a813a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.184+0000 7f73ae190640 1 --2- 172.21.15.104:0/1218573337 >> v2:172.21.15.119:3300/0 conn(0x7f73a80b0ae0 0x7f73a8140640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.184+0000 7f73ae190640 1 -- 172.21.15.104:0/1218573337 >> 172.21.15.104:0/1218573337 conn(0x7f73a80b56f0 msgr2=0x7f73a80b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.184+0000 7f73ae190640 1 -- 172.21.15.104:0/1218573337 shutdown_connections 2023-09-13T02:12:29.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.184+0000 7f73ae190640 1 -- 172.21.15.104:0/1218573337 wait complete. 2023-09-13T02:12:29.190 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.185+0000 7f73ae190640 1 Processor -- start 2023-09-13T02:12:29.190 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73ae190640 1 -- start start 2023-09-13T02:12:29.191 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73ae190640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73a80b0ae0 0x7f73a8142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.191 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73ae190640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73a813a500 0x7f73a813c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.191 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73ae190640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73a8143dc0 0x7f73a813cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.191 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73ae190640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a813d060 con 0x7f73a80b0ae0 2023-09-13T02:12:29.191 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73ae190640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a813b960 con 0x7f73a8143dc0 2023-09-13T02:12:29.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73ae190640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a813be40 con 0x7f73a813a500 2023-09-13T02:12:29.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73a77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73a80b0ae0 0x7f73a8142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73a77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73a80b0ae0 0x7f73a8142cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47120/0 (socket says 172.21.15.104:47120) 2023-09-13T02:12:29.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73a77fe640 1 -- 172.21.15.104:0/1311045774 learned_addr learned my addr 172.21.15.104:0/1311045774 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:29.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73a6ffd640 1 --2- 172.21.15.104:0/1311045774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73a813a500 0x7f73a813c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.193 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73a77fe640 1 -- 172.21.15.104:0/1311045774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73a813a500 msgr2=0x7f73a813c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.193 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73a7fff640 1 --2- 172.21.15.104:0/1311045774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73a8143dc0 0x7f73a813cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.193 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73a77fe640 1 --2- 172.21.15.104:0/1311045774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73a813a500 0x7f73a813c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.193 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73a77fe640 1 -- 172.21.15.104:0/1311045774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73a8143dc0 msgr2=0x7f73a813cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.193 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73a77fe640 1 --2- 172.21.15.104:0/1311045774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73a8143dc0 0x7f73a813cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.193 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73a77fe640 1 -- 172.21.15.104:0/1311045774 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a0009900 con 0x7f73a80b0ae0 2023-09-13T02:12:29.194 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73a7fff640 1 --2- 172.21.15.104:0/1311045774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73a8143dc0 0x7f73a813cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:12:29.194 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.186+0000 7f73a6ffd640 1 --2- 172.21.15.104:0/1311045774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73a813a500 0x7f73a813c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:12:29.194 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.187+0000 7f73a77fe640 1 --2- 172.21.15.104:0/1311045774 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73a80b0ae0 0x7f73a8142cb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f739800c890 tx=0x7f739800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.194 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.187+0000 7f738ffff640 1 -- 172.21.15.104:0/1311045774 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398004220 con 0x7f73a80b0ae0 2023-09-13T02:12:29.195 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.187+0000 7f738ffff640 1 -- 172.21.15.104:0/1311045774 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7398004470 con 0x7f73a80b0ae0 2023-09-13T02:12:29.195 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.187+0000 7f73ae190640 1 -- 172.21.15.104:0/1311045774 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a81dbb60 con 0x7f73a80b0ae0 2023-09-13T02:12:29.195 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.187+0000 7f738ffff640 1 -- 172.21.15.104:0/1311045774 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398007c10 con 0x7f73a80b0ae0 2023-09-13T02:12:29.195 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.187+0000 7f73ae190640 1 -- 172.21.15.104:0/1311045774 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a81dc0c0 con 0x7f73a80b0ae0 2023-09-13T02:12:29.195 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.188+0000 7f73ae190640 1 -- 172.21.15.104:0/1311045774 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a804e100 con 0x7f73a80b0ae0 2023-09-13T02:12:29.195 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.188+0000 7f738ffff640 1 -- 172.21.15.104:0/1311045774 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f7398005020 con 0x7f73a80b0ae0 2023-09-13T02:12:29.196 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.188+0000 7f738ffff640 1 --2- 172.21.15.104:0/1311045774 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f739406a4f0 0x7f739406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.196 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.189+0000 7f738ffff640 1 -- 172.21.15.104:0/1311045774 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7398088ef0 con 0x7f73a80b0ae0 2023-09-13T02:12:29.196 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.189+0000 7f73a6ffd640 1 --2- 172.21.15.104:0/1311045774 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f739406a4f0 0x7f739406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.196 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.189+0000 7f73a6ffd640 1 --2- 172.21.15.104:0/1311045774 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f739406a4f0 0x7f739406c9b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f73a80acb30 tx=0x7f739c005cb0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.197 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.193+0000 7f738ffff640 1 -- 172.21.15.104:0/1311045774 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7398054500 con 0x7f73a80b0ae0 2023-09-13T02:12:29.360 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.359+0000 7f73ae190640 1 -- 172.21.15.104:0/1311045774 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73a80b5460 con 0x7f73a80b0ae0 2023-09-13T02:12:29.361 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.360+0000 7f738ffff640 1 -- 172.21.15.104:0/1311045774 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f739801d020 con 0x7f73a80b0ae0 2023-09-13T02:12:29.361 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:29.362 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"ac1f5a95-0d3a-406e-b4ca-c8ea43282cab","created":"2023-09-13T02:11:59.067178+0000","modified":"2023-09-13T02:12:25.572652+0000","last_up_change":"2023-09-13T02:12:11.207888+0000","last_in_change":"2023-09-13T02:12:02.278796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T02:12:12.071023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T02:12:22.114609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T02:12:22.880593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67190066-4851-4b1f-aae8-bad59e79ebb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6801","nonce":3271772377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6803","nonce":3271772377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6807","nonce":3271772377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6805","nonce":3271772377}]},"public_addr":"172.21.15.104:6801/3271772377","cluster_addr":"172.21.15.104:6803/3271772377","heartbeat_back_addr":"172.21.15.104:6807/3271772377","heartbeat_front_addr":"172.21.15.104:6805/3271772377","state":["exists","up"]},{"osd":1,"uuid":"f1907075-bb97-4a19-8dd6-322232caaf4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6809","nonce":3786698894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6811","nonce":3786698894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6815","nonce":3786698894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6813","nonce":3786698894}]},"public_addr":"172.21.15.104:6809/3786698894","cluster_addr":"172.21.15.104:6811/3786698894","heartbeat_back_addr":"172.21.15.104:6815/3786698894","heartbeat_front_addr":"172.21.15.104:6813/3786698894","state":["exists","up"]},{"osd":2,"uuid":"8c323c83-330c-4181-b622-10177c81f975","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6819","nonce":2319361072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6822","nonce":2319361072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6827","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6829","nonce":2319361072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6826","nonce":2319361072}]},"public_addr":"172.21.15.104:6819/2319361072","cluster_addr":"172.21.15.104:6822/2319361072","heartbeat_back_addr":"172.21.15.104:6829/2319361072","heartbeat_front_addr":"172.21.15.104:6826/2319361072","state":["exists","up"]},{"osd":3,"uuid":"811457f5-c408-488d-a4ed-b947d1c55e82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6818","nonce":621253853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6823","nonce":621253853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6831","nonce":621253853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6825","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6828","nonce":621253853}]},"public_addr":"172.21.15.104:6818/621253853","cluster_addr":"172.21.15.104:6823/621253853","heartbeat_back_addr":"172.21.15.104:6831/621253853","heartbeat_front_addr":"172.21.15.104:6828/621253853","state":["exists","up"]},{"osd":4,"uuid":"552010ea-7d61-47c7-b4ac-657845e55e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6801","nonce":3049794634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6803","nonce":3049794634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6807","nonce":3049794634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6805","nonce":3049794634}]},"public_addr":"172.21.15.119:6801/3049794634","cluster_addr":"172.21.15.119:6803/3049794634","heartbeat_back_addr":"172.21.15.119:6807/3049794634","heartbeat_front_addr":"172.21.15.119:6805/3049794634","state":["exists","up"]},{"osd":5,"uuid":"41f415b0-6886-44ed-bccc-57c46cc975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6809","nonce":2918159428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6811","nonce":2918159428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6815","nonce":2918159428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6813","nonce":2918159428}]},"public_addr":"172.21.15.119:6809/2918159428","cluster_addr":"172.21.15.119:6811/2918159428","heartbeat_back_addr":"172.21.15.119:6815/2918159428","heartbeat_front_addr":"172.21.15.119:6813/2918159428","state":["exists","up"]},{"osd":6,"uuid":"1f415570-dbcc-4cb9-930a-ad31a96c3ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6825","nonce":3509665357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6827","nonce":3509665357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6831","nonce":3509665357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6829","nonce":3509665357}]},"public_addr":"172.21.15.119:6825/3509665357","cluster_addr":"172.21.15.119:6827/3509665357","heartbeat_back_addr":"172.21.15.119:6831/3509665357","heartbeat_front_addr":"172.21.15.119:6829/3509665357","state":["exists","up"]},{"osd":7,"uuid":"ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6817","nonce":892749725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6819","nonce":892749725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6823","nonce":892749725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6821","nonce":892749725}]},"public_addr":"172.21.15.119:6817/892749725","cluster_addr":"172.21.15.119:6819/892749725","heartbeat_back_addr":"172.21.15.119:6823/892749725","heartbeat_front_addr":"172.21.15.119:6821/892749725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.489481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.468615+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.485958+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.424425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.456308+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.427607+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T02:12:29.363 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.362+0000 7f73ae190640 1 -- 172.21.15.104:0/1311045774 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f739406a4f0 msgr2=0x7f739406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.363 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.362+0000 7f73ae190640 1 --2- 172.21.15.104:0/1311045774 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f739406a4f0 0x7f739406c9b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f73a80acb30 tx=0x7f739c005cb0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.363 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.362+0000 7f73ae190640 1 -- 172.21.15.104:0/1311045774 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73a80b0ae0 msgr2=0x7f73a8142cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.362+0000 7f73ae190640 1 --2- 172.21.15.104:0/1311045774 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73a80b0ae0 0x7f73a8142cb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f739800c890 tx=0x7f739800cd50 comp rx=0 tx=0).stop 2023-09-13T02:12:29.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.362+0000 7f73ae190640 1 -- 172.21.15.104:0/1311045774 shutdown_connections 2023-09-13T02:12:29.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.362+0000 7f73ae190640 1 --2- 172.21.15.104:0/1311045774 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f739406a4f0 0x7f739406c9b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.362+0000 7f73ae190640 1 --2- 172.21.15.104:0/1311045774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73a8143dc0 0x7f73a813cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.362+0000 7f73ae190640 1 --2- 172.21.15.104:0/1311045774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73a813a500 0x7f73a813c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.362+0000 7f73ae190640 1 --2- 172.21.15.104:0/1311045774 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73a80b0ae0 0x7f73a8142cb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.362+0000 7f73ae190640 1 -- 172.21.15.104:0/1311045774 >> 172.21.15.104:0/1311045774 conn(0x7f73a80b56f0 msgr2=0x7f73a80b4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.362+0000 7f73ae190640 1 -- 172.21.15.104:0/1311045774 shutdown_connections 2023-09-13T02:12:29.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.362+0000 7f73ae190640 1 -- 172.21.15.104:0/1311045774 wait complete. 2023-09-13T02:12:29.374 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-13T02:12:29.375 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-13T02:12:29.375 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-13T02:12:29.376 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-13T02:12:29.376 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-09-13T02:12:29.377 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-09-13T02:12:29.377 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-09-13T02:12:29.378 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-09-13T02:12:29.553 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f1408e6d640 1 -- 172.21.15.104:0/3896768460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f140406a4a0 msgr2=0x7f14040b26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.554 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f1408e6d640 1 --2- 172.21.15.104:0/3896768460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f140406a4a0 0x7f14040b26d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f13fc005fd0 tx=0x7f13fc02c260 comp rx=0 tx=0).stop 2023-09-13T02:12:29.554 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f1408e6d640 1 -- 172.21.15.104:0/3896768460 shutdown_connections 2023-09-13T02:12:29.554 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f1408e6d640 1 --2- 172.21.15.104:0/3896768460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f140406a4a0 0x7f14040b26d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.554 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f1408e6d640 1 --2- 172.21.15.104:0/3896768460 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14040707a0 0x7f14040ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.555 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f1408e6d640 1 -- 172.21.15.104:0/3896768460 >> 172.21.15.104:0/3896768460 conn(0x7f14040697b0 msgr2=0x7f14040b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.555 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f90bf14c640 1 -- 172.21.15.104:0/2734251818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b81479e0 msgr2=0x7f90b806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.555 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f90bf14c640 1 --2- 172.21.15.104:0/2734251818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b81479e0 0x7f90b806b0b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f90ac005fd0 tx=0x7f90ac02bd10 comp rx=0 tx=0).stop 2023-09-13T02:12:29.556 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f90bf14c640 1 -- 172.21.15.104:0/2734251818 shutdown_connections 2023-09-13T02:12:29.556 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f90bf14c640 1 --2- 172.21.15.104:0/2734251818 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90b8071240 0x7f90b80716d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.556 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f90bf14c640 1 --2- 172.21.15.104:0/2734251818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b81479e0 0x7f90b806b0b0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f90ac005fd0 tx=0x7f90ac02bd10 comp rx=0 tx=0).stop 2023-09-13T02:12:29.556 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f90bf14c640 1 -- 172.21.15.104:0/2734251818 >> 172.21.15.104:0/2734251818 conn(0x7f90b8069b30 msgr2=0x7f90b80b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.557 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f7f63fff640 1 -- 172.21.15.104:0/4291978891 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c034440 con 0x7f7f6c0af7c0 2023-09-13T02:12:29.557 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f7f721ef640 1 -- 172.21.15.104:0/4291978891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f6c0af7c0 msgr2=0x7f7f6c0afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.557 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f1408e6d640 1 -- 172.21.15.104:0/3896768460 shutdown_connections 2023-09-13T02:12:29.558 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f7f721ef640 1 --2- 172.21.15.104:0/4291978891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f6c0af7c0 0x7f7f6c0afc10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0aaee0 tx=0x7f7f5c02bcd0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.558 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f7f721ef640 1 -- 172.21.15.104:0/4291978891 shutdown_connections 2023-09-13T02:12:29.558 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f7f721ef640 1 --2- 172.21.15.104:0/4291978891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f6c0af7c0 0x7f7f6c0afc10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.558 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f7f721ef640 1 --2- 172.21.15.104:0/4291978891 >> v2:172.21.15.119:3300/0 conn(0x7f7f6c144200 0x7f7f6c0ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.559 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f7f721ef640 1 --2- 172.21.15.104:0/4291978891 >> v2:172.21.15.104:3300/0 conn(0x7f7f6c072420 0x7f7f6c0b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.559 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f7f721ef640 1 -- 172.21.15.104:0/4291978891 >> 172.21.15.104:0/4291978891 conn(0x7f7f6c0b5e20 msgr2=0x7f7f6c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.559 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f1408e6d640 1 -- 172.21.15.104:0/3896768460 wait complete. 2023-09-13T02:12:29.560 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f90bf14c640 1 -- 172.21.15.104:0/2734251818 shutdown_connections 2023-09-13T02:12:29.560 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f7f721ef640 1 -- 172.21.15.104:0/4291978891 shutdown_connections 2023-09-13T02:12:29.560 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7f7f721ef640 1 -- 172.21.15.104:0/4291978891 wait complete. 2023-09-13T02:12:29.561 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7f50a7fff640 1 -- 172.21.15.104:0/2537238989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50a0038920 msgr2=0x7f50a00c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.561 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7f50a7fff640 1 --2- 172.21.15.104:0/2537238989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50a0038920 0x7f50a00c90f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f50a80772b0 tx=0x7f50a80a4bb0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.562 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7f90bf14c640 1 -- 172.21.15.104:0/2734251818 wait complete. 2023-09-13T02:12:29.562 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7f50a7fff640 1 -- 172.21.15.104:0/2537238989 shutdown_connections 2023-09-13T02:12:29.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7f50a7fff640 1 --2- 172.21.15.104:0/2537238989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50a0038920 0x7f50a00c90f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7f50a7fff640 1 --2- 172.21.15.104:0/2537238989 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50a00c2aa0 0x7f50a0036f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7f50a7fff640 1 -- 172.21.15.104:0/2537238989 >> 172.21.15.104:0/2537238989 conn(0x7f50a003ae40 msgr2=0x7f50a003b250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/3600706102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb380acee0 msgr2=0x7fcb3814e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.552+0000 7fcb3cc1f640 1 --2- 172.21.15.104:0/3600706102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb380acee0 0x7fcb3814e900 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcb380b71e0 tx=0x7fcb300346d0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/3600706102 shutdown_connections 2023-09-13T02:12:29.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7fcb3cc1f640 1 --2- 172.21.15.104:0/3600706102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb380acee0 0x7fcb3814e900 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7fcb3cc1f640 1 --2- 172.21.15.104:0/3600706102 >> v2:172.21.15.119:3300/0 conn(0x7fcb3813e5d0 0x7fcb380b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/3600706102 >> 172.21.15.104:0/3600706102 conn(0x7fcb3806bfb0 msgr2=0x7fcb380708b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/3600706102 shutdown_connections 2023-09-13T02:12:29.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7f50a7fff640 1 -- 172.21.15.104:0/2537238989 shutdown_connections 2023-09-13T02:12:29.566 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7f9d5bfff640 1 -- 172.21.15.104:0/911390850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d5403c350 msgr2=0x7f9d540c9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.566 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7f9d5bfff640 1 --2- 172.21.15.104:0/911390850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d5403c350 0x7f9d540c9ab0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c0772b0 tx=0x7f9d5c068e50 comp rx=0 tx=0).stop 2023-09-13T02:12:29.566 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7f50a7fff640 1 -- 172.21.15.104:0/2537238989 wait complete. 2023-09-13T02:12:29.567 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7f9d5bfff640 1 -- 172.21.15.104:0/911390850 shutdown_connections 2023-09-13T02:12:29.567 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7f9d5bfff640 1 --2- 172.21.15.104:0/911390850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d5403c350 0x7f9d540c9ab0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.567 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7f9d5bfff640 1 --2- 172.21.15.104:0/911390850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d54008280 0x7f9d540c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.568 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7fe1d3563640 1 -- 172.21.15.104:0/1046983776 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c403c960 msgr2=0x7fe1c40d7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.568 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7fe1d3563640 1 --2- 172.21.15.104:0/1046983776 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c403c960 0x7fe1c40d7040 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0772b0 tx=0x7fe1cc068e50 comp rx=0 tx=0).stop 2023-09-13T02:12:29.568 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7f9d5bfff640 1 -- 172.21.15.104:0/911390850 >> 172.21.15.104:0/911390850 conn(0x7f9d5400b730 msgr2=0x7f9d5400bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.569 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7fe1d3563640 1 -- 172.21.15.104:0/1046983776 shutdown_connections 2023-09-13T02:12:29.569 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7fe1d3563640 1 --2- 172.21.15.104:0/1046983776 >> v2:172.21.15.104:3300/0 conn(0x7fe1c40c6a40 0x7fe1c40cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.569 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7fe1d3563640 1 --2- 172.21.15.104:0/1046983776 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c403c960 0x7fe1c40d7040 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.570 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7fe1d3563640 1 -- 172.21.15.104:0/1046983776 >> 172.21.15.104:0/1046983776 conn(0x7fe1c403ec40 msgr2=0x7fe1c403f050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.570 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7fe1d3563640 1 -- 172.21.15.104:0/1046983776 shutdown_connections 2023-09-13T02:12:29.570 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.554+0000 7f90bf14c640 1 Processor -- start 2023-09-13T02:12:29.571 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7fe1d3563640 1 -- 172.21.15.104:0/1046983776 wait complete. 2023-09-13T02:12:29.571 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f90bf14c640 1 -- start start 2023-09-13T02:12:29.571 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.553+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/3600706102 wait complete. 2023-09-13T02:12:29.572 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f50a7fff640 1 Processor -- start 2023-09-13T02:12:29.572 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.554+0000 7f7f721ef640 1 Processor -- start 2023-09-13T02:12:29.573 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f50a7fff640 1 -- start start 2023-09-13T02:12:29.573 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.554+0000 7f1408e6d640 1 Processor -- start 2023-09-13T02:12:29.573 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.554+0000 7f7f721ef640 1 -- start start 2023-09-13T02:12:29.574 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.554+0000 7f1408e6d640 1 -- start start 2023-09-13T02:12:29.574 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f7f721ef640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f6c072420 0x7f7f6c1e79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.575 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f1408e6d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f140406a4a0 0x7f14040b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.575 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f7f721ef640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f6c0af7c0 0x7f7f6c0a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.575 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f1408e6d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14040707a0 0x7f14041e7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.576 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f7f721ef640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f6c144200 0x7f7f6c0a7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.576 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f7f721ef640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c1e7590 con 0x7f7f6c0af7c0 2023-09-13T02:12:29.577 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7fcb3cc1f640 1 Processor -- start 2023-09-13T02:12:29.577 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f51aaa1f640 1 -- 172.21.15.104:0/2802344369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5190003970 msgr2=0x7f5190003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.577 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f51aaa1f640 1 --2- 172.21.15.104:0/2802344369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5190003970 0x7f5190003d90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f519c009b50 tx=0x7f51900057f0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.578 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f1408e6d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14040b7fc0 0x7f14041e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.578 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f7f721ef640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c141fb0 con 0x7f7f6c144200 2023-09-13T02:12:29.579 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f7f721ef640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0a7010 con 0x7f7f6c072420 2023-09-13T02:12:29.579 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f7f711ed640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f6c072420 0x7f7f6c1e79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.579 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f7f709ec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f6c0af7c0 0x7f7f6c0a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.579 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f7f709ec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f6c0af7c0 0x7f7f6c0a9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47160/0 (socket says 172.21.15.104:47160) 2023-09-13T02:12:29.579 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f7f709ec640 1 -- 172.21.15.104:0/1500342129 learned_addr learned my addr 172.21.15.104:0/1500342129 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:29.580 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f7f709ec640 1 -- 172.21.15.104:0/1500342129 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f6c072420 msgr2=0x7f7f6c1e79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.580 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f7f709ec640 1 --2- 172.21.15.104:0/1500342129 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f6c072420 0x7f7f6c1e79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.580 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f7f709ec640 1 -- 172.21.15.104:0/1500342129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f6c144200 msgr2=0x7f7f6c0a7940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T02:12:29.580 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f7f709ec640 1 --2- 172.21.15.104:0/1500342129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f6c144200 0x7f7f6c0a7940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.580 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f7f709ec640 1 -- 172.21.15.104:0/1500342129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f64009900 con 0x7f7f6c0af7c0 2023-09-13T02:12:29.581 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f1408e6d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1404150f30 con 0x7f14040b7fc0 2023-09-13T02:12:29.581 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f1408e6d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14040b0d80 con 0x7f140406a4a0 2023-09-13T02:12:29.581 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f90bf14c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b8070830 0x7f90b80b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.582 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f1408e6d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14040b0fd0 con 0x7f14040707a0 2023-09-13T02:12:29.582 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f14037fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f140406a4a0 0x7f14040b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.582 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f14037fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f140406a4a0 0x7f14040b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.104:39754/0 (socket says 172.21.15.104:39754) 2023-09-13T02:12:29.582 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f14037fe640 1 -- 172.21.15.104:0/1391694593 learned_addr learned my addr 172.21.15.104:0/1391694593 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:29.583 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7f1403fff640 1 --2- 172.21.15.104:0/1391694593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14040b7fc0 0x7f14041e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.583 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f51a8fbc640 1 -- 172.21.15.104:0/2802344369 reap_dead start 2023-09-13T02:12:29.583 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f7f709ec640 1 --2- 172.21.15.104:0/1500342129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f6c0af7c0 0x7f7f6c0a9c90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800d770 tx=0x7f7f6800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.584 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f90bf14c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90b8071240 0x7f90b8138d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.584 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f51aaa1f640 1 -- 172.21.15.104:0/2802344369 shutdown_connections 2023-09-13T02:12:29.584 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f51aaa1f640 1 -- 172.21.15.104:0/2802344369 >> 172.21.15.104:0/2802344369 conn(0x7f51a40b56f0 msgr2=0x7f51a40b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.585 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f50a7fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50a0036460 0x7f50a00ba230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.585 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f9d5bfff640 1 -- 172.21.15.104:0/911390850 shutdown_connections 2023-09-13T02:12:29.586 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f90bcee8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b8070830 0x7f90b80b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.586 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f90bcee8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b8070830 0x7f90b80b0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.104:39762/0 (socket says 172.21.15.104:39762) 2023-09-13T02:12:29.586 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f1402ffd640 1 --2- 172.21.15.104:0/1391694593 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14040707a0 0x7f14041e7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.587 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f50a7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50a0038920 0x7f50a00b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.587 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f90bf14c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90b8139270 0x7f90b8142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.588 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f90b7fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90b8071240 0x7f90b8138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.588 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f50a7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50a00c2aa0 0x7f50a00be8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.588 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f90b7fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90b8071240 0x7f90b8138d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.104:42490/0 (socket says 172.21.15.104:42490) 2023-09-13T02:12:29.589 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f90bcee8640 1 -- 172.21.15.104:0/3415759171 learned_addr learned my addr 172.21.15.104:0/3415759171 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:29.589 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f14037fe640 1 -- 172.21.15.104:0/1391694593 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14040707a0 msgr2=0x7f14041e7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.589 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f14037fe640 1 --2- 172.21.15.104:0/1391694593 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14040707a0 0x7f14041e7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.590 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7fe1d3563640 1 Processor -- start 2023-09-13T02:12:29.590 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.555+0000 7fe1d3563640 1 -- start start 2023-09-13T02:12:29.591 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7fe1d3563640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1c403a1d0 0x7fe1c40b88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.591 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7fe1d3563640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1c403c960 0x7fe1c4040d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.591 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7fe1d3563640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c40c6a40 0x7fe1c403fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.591 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7fe1d3563640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c40419f0 con 0x7fe1c403c960 2023-09-13T02:12:29.592 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f14037fe640 1 -- 172.21.15.104:0/1391694593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14040b7fc0 msgr2=0x7f14041e7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.592 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f50a67fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50a0038920 0x7f50a00b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.592 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f50a67fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50a0038920 0x7f50a00b7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.104:39772/0 (socket says 172.21.15.104:39772) 2023-09-13T02:12:29.593 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7fe1d3563640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c40b7320 con 0x7fe1c403a1d0 2023-09-13T02:12:29.593 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7fe1d3563640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c40bbb50 con 0x7fe1c40c6a40 2023-09-13T02:12:29.593 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7fe1d1d60640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1c403c960 0x7fe1c4040d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.593 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f14037fe640 1 --2- 172.21.15.104:0/1391694593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14040b7fc0 0x7f14041e7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.594 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f90bf14c640 1 -- 172.21.15.104:0/3415759171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b80b1630 con 0x7f90b8139270 2023-09-13T02:12:29.594 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f50a67fc640 1 -- 172.21.15.104:0/2632113798 learned_addr learned my addr 172.21.15.104:0/2632113798 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:29.595 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f90bf14c640 1 -- 172.21.15.104:0/3415759171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b8142700 con 0x7f90b8070830 2023-09-13T02:12:29.595 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f90bf14c640 1 -- 172.21.15.104:0/3415759171 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b80af830 con 0x7f90b8071240 2023-09-13T02:12:29.595 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f50a7fff640 1 -- 172.21.15.104:0/2632113798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a00c13d0 con 0x7f50a00c2aa0 2023-09-13T02:12:29.596 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7fe1d1d60640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1c403c960 0x7fe1c4040d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47166/0 (socket says 172.21.15.104:47166) 2023-09-13T02:12:29.596 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7fe1d1d60640 1 -- 172.21.15.104:0/1855040541 learned_addr learned my addr 172.21.15.104:0/1855040541 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:29.596 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7f14037fe640 1 -- 172.21.15.104:0/1391694593 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13fc009900 con 0x7f140406a4a0 2023-09-13T02:12:29.597 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f50a7fff640 1 -- 172.21.15.104:0/2632113798 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a00c0d10 con 0x7f50a0038920 2023-09-13T02:12:29.597 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f50a7fff640 1 -- 172.21.15.104:0/2632113798 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a00c0ff0 con 0x7f50a0036460 2023-09-13T02:12:29.597 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f50a6ffd640 1 --2- 172.21.15.104:0/2632113798 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50a0036460 0x7f50a00ba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.598 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f90bd6e9640 1 --2- 172.21.15.104:0/3415759171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90b8139270 0x7f90b8142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.598 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.556+0000 7fcb3cc1f640 1 -- start start 2023-09-13T02:12:29.598 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fcb3cc1f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb380acee0 0x7fcb380b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.599 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f7f61ffb640 1 -- 172.21.15.104:0/1500342129 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68009c30 con 0x7f7f6c0af7c0 2023-09-13T02:12:29.599 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fe1d2d62640 1 --2- 172.21.15.104:0/1855040541 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c40c6a40 0x7fe1c403fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.600 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fcb3cc1f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb380b38e0 0x7fcb3813f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.600 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f51aaa1f640 1 -- 172.21.15.104:0/2802344369 shutdown_connections 2023-09-13T02:12:29.601 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f7f61ffb640 1 -- 172.21.15.104:0/1500342129 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7f68009e80 con 0x7f7f6c0af7c0 2023-09-13T02:12:29.601 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fcb3659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb380acee0 0x7fcb380b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.601 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fcb3659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb380acee0 0x7fcb380b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47182/0 (socket says 172.21.15.104:47182) 2023-09-13T02:12:29.602 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f50a77fe640 1 --2- 172.21.15.104:0/2632113798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50a00c2aa0 0x7f50a00be8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.602 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fe1d2561640 1 --2- 172.21.15.104:0/1855040541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1c403a1d0 0x7fe1c40b88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.602 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fcb3659c640 1 -- 172.21.15.104:0/1713048235 learned_addr learned my addr 172.21.15.104:0/1713048235 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:29.603 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fcb3cc1f640 1 --2- 172.21.15.104:0/1713048235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb3813e5d0 0x7fcb38141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.603 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f14037fe640 1 --2- 172.21.15.104:0/1391694593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f140406a4a0 0x7f14040b0840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f13f400b410 tx=0x7f13f400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.603 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/1713048235 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3813ece0 con 0x7fcb380acee0 2023-09-13T02:12:29.604 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f50a77fe640 1 -- 172.21.15.104:0/2632113798 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50a0036460 msgr2=0x7f50a00ba230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.604 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fe1d1d60640 1 -- 172.21.15.104:0/1855040541 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c40c6a40 msgr2=0x7fe1c403fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.604 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fe1d1d60640 1 --2- 172.21.15.104:0/1855040541 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c40c6a40 0x7fe1c403fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fe1d1d60640 1 -- 172.21.15.104:0/1855040541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1c403a1d0 msgr2=0x7fe1c40b88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fe1d1d60640 1 --2- 172.21.15.104:0/1855040541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1c403a1d0 0x7fe1c40b88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fe1d1d60640 1 -- 172.21.15.104:0/1855040541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c40b9230 con 0x7fe1c403c960 2023-09-13T02:12:29.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f90bcee8640 1 -- 172.21.15.104:0/3415759171 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90b8071240 msgr2=0x7f90b8138d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.606 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f90bcee8640 1 --2- 172.21.15.104:0/3415759171 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90b8071240 0x7f90b8138d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.606 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f90bcee8640 1 -- 172.21.15.104:0/3415759171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90b8139270 msgr2=0x7f90b8142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.606 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f90bcee8640 1 --2- 172.21.15.104:0/3415759171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90b8139270 0x7f90b8142b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.606 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f90bcee8640 1 -- 172.21.15.104:0/3415759171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac009560 con 0x7f90b8070830 2023-09-13T02:12:29.607 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f90b7fff640 1 --2- 172.21.15.104:0/3415759171 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90b8071240 0x7f90b8138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T02:12:29.607 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f90bd6e9640 1 --2- 172.21.15.104:0/3415759171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90b8139270 0x7f90b8142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:29.607 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fe1d1d60640 1 --2- 172.21.15.104:0/1855040541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1c403c960 0x7fe1c4040d20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00e790 tx=0x7fe1bc00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.607 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f13ebfff640 1 -- 172.21.15.104:0/1391694593 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f4011830 con 0x7f140406a4a0 2023-09-13T02:12:29.608 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f50a77fe640 1 --2- 172.21.15.104:0/2632113798 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50a0036460 0x7f50a00ba230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.608 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f90bcee8640 1 --2- 172.21.15.104:0/3415759171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b8070830 0x7f90b80b0d60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f90ac02c2a0 tx=0x7f90ac02dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f50a77fe640 1 -- 172.21.15.104:0/2632113798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50a0038920 msgr2=0x7f50a00b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f50a77fe640 1 --2- 172.21.15.104:0/2632113798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50a0038920 0x7f50a00b7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f50a77fe640 1 -- 172.21.15.104:0/2632113798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a00cac30 con 0x7f50a00c2aa0 2023-09-13T02:12:29.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7f13ebfff640 1 -- 172.21.15.104:0/1391694593 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f13f4011a80 con 0x7f140406a4a0 2023-09-13T02:12:29.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/1713048235 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb38140cf0 con 0x7fcb3813e5d0 2023-09-13T02:12:29.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/1713048235 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3813e9d0 con 0x7fcb380b38e0 2023-09-13T02:12:29.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fcb35d9b640 1 --2- 172.21.15.104:0/1713048235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb380b38e0 0x7fcb3813f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.611 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7f13ebfff640 1 -- 172.21.15.104:0/1391694593 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f4011e70 con 0x7f140406a4a0 2023-09-13T02:12:29.611 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7fcb36d9d640 1 --2- 172.21.15.104:0/1713048235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb3813e5d0 0x7fcb38141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.611 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f9d5bfff640 1 -- 172.21.15.104:0/911390850 wait complete. 2023-09-13T02:12:29.612 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.557+0000 7f51aaa1f640 1 -- 172.21.15.104:0/2802344369 wait complete. 2023-09-13T02:12:29.612 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7f1408e6d640 1 -- 172.21.15.104:0/1391694593 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14040a65f0 con 0x7f140406a4a0 2023-09-13T02:12:29.613 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7fcb36d9d640 1 -- 172.21.15.104:0/1713048235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb380b38e0 msgr2=0x7fcb3813f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.613 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7f50a77fe640 1 --2- 172.21.15.104:0/2632113798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50a00c2aa0 0x7f50a00be8a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f50a8068cc0 tx=0x7f50a80af780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.613 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7fcb36d9d640 1 --2- 172.21.15.104:0/1713048235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb380b38e0 0x7fcb3813f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.614 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7fcb36d9d640 1 -- 172.21.15.104:0/1713048235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb380acee0 msgr2=0x7fcb380b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.614 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7fcb36d9d640 1 --2- 172.21.15.104:0/1713048235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb380acee0 0x7fcb380b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.614 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7fcb36d9d640 1 -- 172.21.15.104:0/1713048235 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb30013c30 con 0x7fcb3813e5d0 2023-09-13T02:12:29.615 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7f7f721ef640 1 -- 172.21.15.104:0/1500342129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5c009490 con 0x7f7f6c0af7c0 2023-09-13T02:12:29.615 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7f7f721ef640 1 -- 172.21.15.104:0/1500342129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6c0a7350 con 0x7f7f6c0af7c0 2023-09-13T02:12:29.615 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7f1408e6d640 1 -- 172.21.15.104:0/1391694593 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14040ae010 con 0x7f140406a4a0 2023-09-13T02:12:29.616 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7f508f7fe640 1 -- 172.21.15.104:0/2632113798 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a80afbc0 con 0x7f50a00c2aa0 2023-09-13T02:12:29.616 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7f9d5bfff640 1 Processor -- start 2023-09-13T02:12:29.616 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7f508f7fe640 1 -- 172.21.15.104:0/2632113798 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f50a80afe10 con 0x7f50a00c2aa0 2023-09-13T02:12:29.617 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7f51aaa1f640 1 Processor -- start 2023-09-13T02:12:29.617 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7f508f7fe640 1 -- 172.21.15.104:0/2632113798 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a80b8680 con 0x7f50a00c2aa0 2023-09-13T02:12:29.618 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.559+0000 7f50a7fff640 1 -- 172.21.15.104:0/2632113798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a00bab70 con 0x7f50a00c2aa0 2023-09-13T02:12:29.618 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.559+0000 7f50a7fff640 1 -- 172.21.15.104:0/2632113798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a00ba950 con 0x7f50a00c2aa0 2023-09-13T02:12:29.618 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.559+0000 7f51aaa1f640 1 -- start start 2023-09-13T02:12:29.619 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.559+0000 7fcb36d9d640 1 --2- 172.21.15.104:0/1713048235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb3813e5d0 0x7fcb38141840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcb380b6c70 tx=0x7fcb3003b400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.619 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7fe1c2ffd640 1 -- 172.21.15.104:0/1855040541 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc00ccc0 con 0x7fe1c403c960 2023-09-13T02:12:29.620 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.559+0000 7f9d5bfff640 1 -- start start 2023-09-13T02:12:29.620 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7f9d5bfff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d54008280 0x7f9d54169fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.620 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7f51aaa1f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51a4137a20 0x7f51a406fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.621 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7f9d5bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d5400c4c0 0x7f9d540359b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.621 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.559+0000 7f90b57fa640 1 -- 172.21.15.104:0/3415759171 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac02de50 con 0x7f90b8070830 2023-09-13T02:12:29.621 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.559+0000 7f90b57fa640 1 -- 172.21.15.104:0/3415759171 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f90ac0038f0 con 0x7f90b8070830 2023-09-13T02:12:29.621 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.559+0000 7f90b57fa640 1 -- 172.21.15.104:0/3415759171 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac003ca0 con 0x7f90b8070830 2023-09-13T02:12:29.622 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7f51aaa1f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51a40701f0 0x7f51a4141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.622 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7f51aaa1f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51a4137e00 0x7f51a4141850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.623 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7f90bf14c640 1 -- 172.21.15.104:0/3415759171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b80aeb00 con 0x7f90b8070830 2023-09-13T02:12:29.623 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7f51aaa1f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4140be0 con 0x7f51a4137a20 2023-09-13T02:12:29.623 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7f51aaa1f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a41dda20 con 0x7f51a40701f0 2023-09-13T02:12:29.624 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7f51aaa1f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a41ddd00 con 0x7f51a4137e00 2023-09-13T02:12:29.624 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7fe1c2ffd640 1 -- 172.21.15.104:0/1855040541 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe1bc00ce20 con 0x7fe1c403c960 2023-09-13T02:12:29.624 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7fe1c2ffd640 1 -- 172.21.15.104:0/1855040541 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc005280 con 0x7fe1c403c960 2023-09-13T02:12:29.625 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7fe1d3563640 1 -- 172.21.15.104:0/1855040541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c40b9510 con 0x7fe1c403c960 2023-09-13T02:12:29.625 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.558+0000 7fe1d3563640 1 -- 172.21.15.104:0/1855040541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c40b99d0 con 0x7fe1c403c960 2023-09-13T02:12:29.625 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7f90bf14c640 1 -- 172.21.15.104:0/3415759171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b813ef90 con 0x7f90b8070830 2023-09-13T02:12:29.626 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7f9d5affd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d54008280 0x7f9d54169fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.626 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7f9d5affd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d54008280 0x7f9d54169fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.104:42536/0 (socket says 172.21.15.104:42536) 2023-09-13T02:12:29.626 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7f9d5affd640 1 -- 172.21.15.104:0/700559131 learned_addr learned my addr 172.21.15.104:0/700559131 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:29.627 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7f9d5a7fc640 1 --2- 172.21.15.104:0/700559131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d5400c4c0 0x7f9d540359b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.627 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7f9d5bfff640 1 --2- 172.21.15.104:0/700559131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d5403c350 0x7f9d54038b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.627 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7f51a3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51a4137a20 0x7f51a406fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.628 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f51a3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51a4137a20 0x7f51a406fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47184/0 (socket says 172.21.15.104:47184) 2023-09-13T02:12:29.628 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f51a3fff640 1 -- 172.21.15.104:0/3329554918 learned_addr learned my addr 172.21.15.104:0/3329554918 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:29.628 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f9d5bfff640 1 -- 172.21.15.104:0/700559131 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d54038730 con 0x7f9d5403c350 2023-09-13T02:12:29.629 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f9d5bfff640 1 -- 172.21.15.104:0/700559131 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d54038100 con 0x7f9d5400c4c0 2023-09-13T02:12:29.629 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f9d5bfff640 1 -- 172.21.15.104:0/700559131 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540364a0 con 0x7f9d54008280 2023-09-13T02:12:29.630 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7fcb26ffd640 1 -- 172.21.15.104:0/1713048235 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30003d80 con 0x7fcb3813e5d0 2023-09-13T02:12:29.630 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7fcb26ffd640 1 -- 172.21.15.104:0/1713048235 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcb30013220 con 0x7fcb3813e5d0 2023-09-13T02:12:29.630 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.560+0000 7fcb26ffd640 1 -- 172.21.15.104:0/1713048235 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb300135d0 con 0x7fcb3813e5d0 2023-09-13T02:12:29.630 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/1713048235 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb380b5090 con 0x7fcb3813e5d0 2023-09-13T02:12:29.630 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/1713048235 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3813d4b0 con 0x7fcb3813e5d0 2023-09-13T02:12:29.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f13e9ffb640 1 -- 172.21.15.104:0/1391694593 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f140406f590 con 0x7f140406a4a0 2023-09-13T02:12:29.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.559+0000 7f7f61ffb640 1 -- 172.21.15.104:0/1500342129 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f680106c0 con 0x7f7f6c0af7c0 2023-09-13T02:12:29.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f7f721ef640 1 -- 172.21.15.104:0/1500342129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f6c0650f0 con 0x7f7f6c0af7c0 2023-09-13T02:12:29.632 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f51a3fff640 1 -- 172.21.15.104:0/3329554918 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51a4137e00 msgr2=0x7f51a4141850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.632 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f51a3fff640 1 --2- 172.21.15.104:0/3329554918 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51a4137e00 0x7f51a4141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.632 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f51a3fff640 1 -- 172.21.15.104:0/3329554918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51a40701f0 msgr2=0x7f51a4141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.633 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f51a3fff640 1 --2- 172.21.15.104:0/3329554918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51a40701f0 0x7f51a4141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.633 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f51a3fff640 1 -- 172.21.15.104:0/3329554918 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a41ddfe0 con 0x7f51a4137a20 2023-09-13T02:12:29.633 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f9d5affd640 1 -- 172.21.15.104:0/700559131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d5400c4c0 msgr2=0x7f9d540359b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.633 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f9d5affd640 1 --2- 172.21.15.104:0/700559131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d5400c4c0 0x7f9d540359b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.634 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f9d5affd640 1 -- 172.21.15.104:0/700559131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d5403c350 msgr2=0x7f9d54038b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.634 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f9d5affd640 1 --2- 172.21.15.104:0/700559131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d5403c350 0x7f9d54038b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.634 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f9d5affd640 1 -- 172.21.15.104:0/700559131 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d54038350 con 0x7f9d54008280 2023-09-13T02:12:29.634 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f13ebfff640 1 -- 172.21.15.104:0/1391694593 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f13f401a400 con 0x7f140406a4a0 2023-09-13T02:12:29.635 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7fe1d3563640 1 -- 172.21.15.104:0/1855040541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe1b4000fc0 con 0x7fe1c403c960 2023-09-13T02:12:29.635 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f9d5affd640 1 --2- 172.21.15.104:0/700559131 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d54008280 0x7f9d54169fd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00c4d0 tx=0x7f9d4c00c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.636 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.561+0000 7f51a3fff640 1 --2- 172.21.15.104:0/3329554918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51a4137a20 0x7f51a406fcb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f519c009c70 tx=0x7f519c033c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.636 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.562+0000 7f13ebfff640 1 --2- 172.21.15.104:0/1391694593 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f13f006a540 0x7f13f006ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.636 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.562+0000 7f50a7fff640 1 -- 172.21.15.104:0/2632113798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50a00c0e80 con 0x7f50a00c2aa0 2023-09-13T02:12:29.637 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.562+0000 7f90bf14c640 1 -- 172.21.15.104:0/3415759171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f90b804e100 con 0x7f90b8070830 2023-09-13T02:12:29.637 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.562+0000 7f13ebfff640 1 -- 172.21.15.104:0/1391694593 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13f4088d60 con 0x7f140406a4a0 2023-09-13T02:12:29.638 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.562+0000 7f51a0ff9640 1 -- 172.21.15.104:0/3329554918 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c03e8f0 con 0x7f51a4137a20 2023-09-13T02:12:29.638 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.562+0000 7f13ebfff640 1 --2- 172.21.15.104:0/1391694593 >> [v2:172.21.15.119:6808/2918159428,v1:172.21.15.119:6809/2918159428] conn(0x7f13f00726e0 0x7f13f0074b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.562+0000 7f13ebfff640 1 -- 172.21.15.104:0/1391694593 --> [v2:172.21.15.119:6808/2918159428,v1:172.21.15.119:6809/2918159428] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13f00751b0 con 0x7f13f00726e0 2023-09-13T02:12:29.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.562+0000 7f13ebfff640 1 -- 172.21.15.104:0/1391694593 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13f4054350 con 0x7f140406a4a0 2023-09-13T02:12:29.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7f51aaa1f640 1 -- 172.21.15.104:0/3329554918 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a4140e50 con 0x7f51a4137a20 2023-09-13T02:12:29.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7f1403fff640 1 --2- 172.21.15.104:0/1391694593 >> [v2:172.21.15.119:6808/2918159428,v1:172.21.15.119:6809/2918159428] conn(0x7f13f00726e0 0x7f13f0074b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.562+0000 7f9d43fff640 1 -- 172.21.15.104:0/700559131 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c012830 con 0x7f9d54008280 2023-09-13T02:12:29.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.562+0000 7f9d43fff640 1 -- 172.21.15.104:0/700559131 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9d4c012a80 con 0x7f9d54008280 2023-09-13T02:12:29.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.562+0000 7f9d43fff640 1 -- 172.21.15.104:0/700559131 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c012e90 con 0x7f9d54008280 2023-09-13T02:12:29.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.562+0000 7f9d5bfff640 1 -- 172.21.15.104:0/700559131 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5416aa80 con 0x7f9d54008280 2023-09-13T02:12:29.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.562+0000 7f9d5bfff640 1 -- 172.21.15.104:0/700559131 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d540360d0 con 0x7f9d54008280 2023-09-13T02:12:29.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7f7f61ffb640 1 -- 172.21.15.104:0/1500342129 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f7f68010820 con 0x7f7f6c0af7c0 2023-09-13T02:12:29.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/1713048235 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb380b94b0 con 0x7fcb3813e5d0 2023-09-13T02:12:29.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7f1402ffd640 1 --2- 172.21.15.104:0/1391694593 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f13f006a540 0x7f13f006ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.562+0000 7f90b57fa640 1 -- 172.21.15.104:0/3415759171 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f90ac03e450 con 0x7f90b8070830 2023-09-13T02:12:29.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7f90b57fa640 1 --2- 172.21.15.104:0/3415759171 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f909c06a5c0 0x7f909c06ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7f90b57fa640 1 -- 172.21.15.104:0/3415759171 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90ac0ab4b0 con 0x7f90b8070830 2023-09-13T02:12:29.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7f90b57fa640 1 --2- 172.21.15.104:0/3415759171 >> [v2:172.21.15.104:6800/3271772377,v1:172.21.15.104:6801/3271772377] conn(0x7f909c072760 0x7f909c074b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7f90b57fa640 1 -- 172.21.15.104:0/3415759171 --> [v2:172.21.15.104:6800/3271772377,v1:172.21.15.104:6801/3271772377] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f909c075230 con 0x7f909c072760 2023-09-13T02:12:29.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7fe1c2ffd640 1 -- 172.21.15.104:0/1855040541 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe1bc0053e0 con 0x7fe1c403c960 2023-09-13T02:12:29.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7f7f61ffb640 1 --2- 172.21.15.104:0/1500342129 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f7f5006a5c0 0x7f7f5006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7f1403fff640 1 --2- 172.21.15.104:0/1391694593 >> [v2:172.21.15.119:6808/2918159428,v1:172.21.15.119:6809/2918159428] conn(0x7f13f00726e0 0x7f13f0074b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7f9d41ffb640 1 -- 172.21.15.104:0/700559131 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d54005490 con 0x7f9d54008280 2023-09-13T02:12:29.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7f90b57fa640 1 -- 172.21.15.104:0/3415759171 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90ac076c70 con 0x7f90b8070830 2023-09-13T02:12:29.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7f90bd6e9640 1 --2- 172.21.15.104:0/3415759171 >> [v2:172.21.15.104:6800/3271772377,v1:172.21.15.104:6801/3271772377] conn(0x7f909c072760 0x7f909c074b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7f7f711ed640 1 --2- 172.21.15.104:0/1500342129 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f7f5006a5c0 0x7f7f5006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7f7f61ffb640 1 -- 172.21.15.104:0/1500342129 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f68088df0 con 0x7f7f6c0af7c0 2023-09-13T02:12:29.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.564+0000 7f7f61ffb640 1 --2- 172.21.15.104:0/1500342129 >> [v2:172.21.15.119:6816/892749725,v1:172.21.15.119:6817/892749725] conn(0x7f7f500727e0 0x7f7f50074c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.564+0000 7f7f61ffb640 1 -- 172.21.15.104:0/1500342129 --> [v2:172.21.15.119:6816/892749725,v1:172.21.15.119:6817/892749725] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f500752b0 con 0x7f7f500727e0 2023-09-13T02:12:29.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.564+0000 7f7f61ffb640 1 -- 172.21.15.104:0/1500342129 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f6808b410 con 0x7f7f6c0af7c0 2023-09-13T02:12:29.648 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.564+0000 7f1402ffd640 1 --2- 172.21.15.104:0/1391694593 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f13f006a540 0x7f13f006ca00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f14041427c0 tx=0x7f13f8005f90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.648 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.564+0000 7f90b7fff640 1 --2- 172.21.15.104:0/3415759171 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f909c06a5c0 0x7f909c06ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.648 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7f90b7fff640 1 --2- 172.21.15.104:0/3415759171 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f909c06a5c0 0x7f909c06ca80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f90b80b0220 tx=0x7f90a4007e30 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.648 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7f90bd6e9640 1 --2- 172.21.15.104:0/3415759171 >> [v2:172.21.15.104:6800/3271772377,v1:172.21.15.104:6801/3271772377] conn(0x7f909c072760 0x7f909c074b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.649 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7f508f7fe640 1 -- 172.21.15.104:0/2632113798 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f50a80b87e0 con 0x7f50a00c2aa0 2023-09-13T02:12:29.649 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.564+0000 7fe1c2ffd640 1 --2- 172.21.15.104:0/1855040541 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fe1b006a5c0 0x7fe1b006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.649 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.564+0000 7fe1c2ffd640 1 -- 172.21.15.104:0/1855040541 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1bc014070 con 0x7fe1c403c960 2023-09-13T02:12:29.650 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.564+0000 7fe1c2ffd640 1 --2- 172.21.15.104:0/1855040541 >> [v2:172.21.15.104:6816/621253853,v1:172.21.15.104:6818/621253853] conn(0x7fe1b0072760 0x7fe1b0074b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.650 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.564+0000 7fe1c2ffd640 1 -- 172.21.15.104:0/1855040541 --> [v2:172.21.15.104:6816/621253853,v1:172.21.15.104:6818/621253853] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1b0075230 con 0x7fe1b0072760 2023-09-13T02:12:29.650 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.564+0000 7fe1c2ffd640 1 -- 172.21.15.104:0/1855040541 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1bc0547b0 con 0x7fe1c403c960 2023-09-13T02:12:29.650 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7f51a0ff9640 1 -- 172.21.15.104:0/3329554918 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f519c03ea50 con 0x7f51a4137a20 2023-09-13T02:12:29.651 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.563+0000 7f51a0ff9640 1 -- 172.21.15.104:0/3329554918 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c03ee60 con 0x7f51a4137a20 2023-09-13T02:12:29.651 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.564+0000 7f51aaa1f640 1 -- 172.21.15.104:0/3329554918 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a41429e0 con 0x7f51a4137a20 2023-09-13T02:12:29.651 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.564+0000 7f7f711ed640 1 --2- 172.21.15.104:0/1500342129 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f7f5006a5c0 0x7f7f5006ca80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7f64005fd0 tx=0x7f7f640095c0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.653 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7f7f719ee640 1 --2- 172.21.15.104:0/1500342129 >> [v2:172.21.15.119:6816/892749725,v1:172.21.15.119:6817/892749725] conn(0x7f7f500727e0 0x7f7f50074c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.654 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.564+0000 7fe1d2d62640 1 --2- 172.21.15.104:0/1855040541 >> [v2:172.21.15.104:6816/621253853,v1:172.21.15.104:6818/621253853] conn(0x7fe1b0072760 0x7fe1b0074b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.654 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.564+0000 7fcb26ffd640 1 -- 172.21.15.104:0/1713048235 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fcb3000a040 con 0x7fcb3813e5d0 2023-09-13T02:12:29.654 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.564+0000 7fcb26ffd640 1 --2- 172.21.15.104:0/1713048235 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fcb1806a5c0 0x7fcb1806ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.654 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7fcb26ffd640 1 -- 172.21.15.104:0/1713048235 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb300ab560 con 0x7fcb3813e5d0 2023-09-13T02:12:29.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7fcb26ffd640 1 --2- 172.21.15.104:0/1713048235 >> [v2:172.21.15.104:6817/2319361072,v1:172.21.15.104:6819/2319361072] conn(0x7fcb18072760 0x7fcb18074b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7fcb26ffd640 1 -- 172.21.15.104:0/1713048235 --> [v2:172.21.15.104:6817/2319361072,v1:172.21.15.104:6819/2319361072] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb18075230 con 0x7fcb18072760 2023-09-13T02:12:29.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7fcb26ffd640 1 -- 172.21.15.104:0/1713048235 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb30076a30 con 0x7fcb3813e5d0 2023-09-13T02:12:29.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7fe1d2d62640 1 --2- 172.21.15.104:0/1855040541 >> [v2:172.21.15.104:6816/621253853,v1:172.21.15.104:6818/621253853] conn(0x7fe1b0072760 0x7fe1b0074b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.656 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7f7f719ee640 1 --2- 172.21.15.104:0/1500342129 >> [v2:172.21.15.119:6816/892749725,v1:172.21.15.119:6817/892749725] conn(0x7f7f500727e0 0x7f7f50074c00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.656 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7f508f7fe640 1 --2- 172.21.15.104:0/2632113798 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f509406a5c0 0x7f509406ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.657 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7f51a0ff9640 1 -- 172.21.15.104:0/3329554918 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f519c046400 con 0x7f51a4137a20 2023-09-13T02:12:29.657 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7f51aaa1f640 1 -- 172.21.15.104:0/3329554918 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5188000fc0 con 0x7f51a4137a20 2023-09-13T02:12:29.657 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7f9d43fff640 1 -- 172.21.15.104:0/700559131 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f9d4c01a3b0 con 0x7f9d54008280 2023-09-13T02:12:29.658 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7f9d43fff640 1 --2- 172.21.15.104:0/700559131 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f9d4806a5f0 0x7f9d4806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.658 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7f9d43fff640 1 -- 172.21.15.104:0/700559131 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d4c088af0 con 0x7f9d54008280 2023-09-13T02:12:29.658 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7f9d43fff640 1 --2- 172.21.15.104:0/700559131 >> [v2:172.21.15.119:6824/3509665357,v1:172.21.15.119:6825/3509665357] conn(0x7f9d48072620 0x7f9d48074a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.658 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7f9d43fff640 1 -- 172.21.15.104:0/700559131 --> [v2:172.21.15.119:6824/3509665357,v1:172.21.15.119:6825/3509665357] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d480750f0 con 0x7f9d48072620 2023-09-13T02:12:29.659 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7f508f7fe640 1 -- 172.21.15.104:0/2632113798 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50a8123a70 con 0x7f50a00c2aa0 2023-09-13T02:12:29.659 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7fcb3659c640 1 --2- 172.21.15.104:0/1713048235 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fcb1806a5c0 0x7fcb1806ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.659 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7f508f7fe640 1 --2- 172.21.15.104:0/2632113798 >> [v2:172.21.15.104:6808/3786698894,v1:172.21.15.104:6809/3786698894] conn(0x7f50940727e0 0x7f5094074c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.660 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7fe1d2561640 1 --2- 172.21.15.104:0/1855040541 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fe1b006a5c0 0x7fe1b006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.660 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.565+0000 7f508f7fe640 1 -- 172.21.15.104:0/2632113798 --> [v2:172.21.15.104:6808/3786698894,v1:172.21.15.104:6809/3786698894] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50940752b0 con 0x7f50940727e0 2023-09-13T02:12:29.661 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7f508f7fe640 1 -- 172.21.15.104:0/2632113798 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50a81282a0 con 0x7f50a00c2aa0 2023-09-13T02:12:29.661 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7fcb35d9b640 1 --2- 172.21.15.104:0/1713048235 >> [v2:172.21.15.104:6817/2319361072,v1:172.21.15.104:6819/2319361072] conn(0x7fcb18072760 0x7fcb18074b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.661 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7f50a6ffd640 1 --2- 172.21.15.104:0/2632113798 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f509406a5c0 0x7f509406ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.662 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7f90b57fa640 1 -- 172.21.15.104:0/3415759171 <== osd.0 v2:172.21.15.104:6800/3271772377 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f909c075230 con 0x7f909c072760 2023-09-13T02:12:29.662 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7f50a67fc640 1 --2- 172.21.15.104:0/2632113798 >> [v2:172.21.15.104:6808/3786698894,v1:172.21.15.104:6809/3786698894] conn(0x7f50940727e0 0x7f5094074c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.663 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7f51a0ff9640 1 --2- 172.21.15.104:0/3329554918 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f518406a5f0 0x7f518406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.663 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7fcb3659c640 1 --2- 172.21.15.104:0/1713048235 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fcb1806a5c0 0x7fcb1806ca80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb381eb090 tx=0x7fcb28009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.663 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7f9d43fff640 1 -- 172.21.15.104:0/700559131 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d4c0540e0 con 0x7f9d54008280 2023-09-13T02:12:29.664 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7fe1d2561640 1 --2- 172.21.15.104:0/1855040541 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fe1b006a5c0 0x7fe1b006ca80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40386d0 tx=0x7fe1c8009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.664 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7fcb35d9b640 1 --2- 172.21.15.104:0/1713048235 >> [v2:172.21.15.104:6817/2319361072,v1:172.21.15.104:6819/2319361072] conn(0x7fcb18072760 0x7fcb18074b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.665 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7f51a37fe640 1 --2- 172.21.15.104:0/3329554918 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f518406a5f0 0x7f518406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.665 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7f51a0ff9640 1 -- 172.21.15.104:0/3329554918 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f519c0abb30 con 0x7f51a4137a20 2023-09-13T02:12:29.665 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7f7f61ffb640 1 -- 172.21.15.104:0/1500342129 <== osd.7 v2:172.21.15.119:6816/892749725 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f7f500752b0 con 0x7f7f500727e0 2023-09-13T02:12:29.666 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7f51a0ff9640 1 --2- 172.21.15.104:0/3329554918 >> [v2:172.21.15.119:6800/3049794634,v1:172.21.15.119:6801/3049794634] conn(0x7f5184072790 0x7f5184074bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.666 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7f51a0ff9640 1 -- 172.21.15.104:0/3329554918 --> [v2:172.21.15.119:6800/3049794634,v1:172.21.15.119:6801/3049794634] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5184075260 con 0x7f5184072790 2023-09-13T02:12:29.666 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7fe1c2ffd640 1 -- 172.21.15.104:0/1855040541 <== osd.3 v2:172.21.15.104:6816/621253853 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe1b0075230 con 0x7fe1b0072760 2023-09-13T02:12:29.667 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7f50a6ffd640 1 --2- 172.21.15.104:0/2632113798 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f509406a5c0 0x7f509406ca80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f50a00be420 tx=0x7f509c00b040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.667 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7f9d5b7fe640 1 --2- 172.21.15.104:0/700559131 >> [v2:172.21.15.119:6824/3509665357,v1:172.21.15.119:6825/3509665357] conn(0x7f9d48072620 0x7f9d48074a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.667 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7f9d5a7fc640 1 --2- 172.21.15.104:0/700559131 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f9d4806a5f0 0x7f9d4806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.668 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.566+0000 7f13ebfff640 1 -- 172.21.15.104:0/1391694593 <== osd.5 v2:172.21.15.119:6808/2918159428 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f13f00751b0 con 0x7f13f00726e0 2023-09-13T02:12:29.668 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.567+0000 7f50a67fc640 1 --2- 172.21.15.104:0/2632113798 >> [v2:172.21.15.104:6808/3786698894,v1:172.21.15.104:6809/3786698894] conn(0x7f50940727e0 0x7f5094074c00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.669 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.567+0000 7f9d5b7fe640 1 --2- 172.21.15.104:0/700559131 >> [v2:172.21.15.119:6824/3509665357,v1:172.21.15.119:6825/3509665357] conn(0x7f9d48072620 0x7f9d48074a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.669 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.567+0000 7f9d5a7fc640 1 --2- 172.21.15.104:0/700559131 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f9d4806a5f0 0x7f9d4806cab0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9d5416ae20 tx=0x7f9d50005f90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.669 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.567+0000 7fcb26ffd640 1 -- 172.21.15.104:0/1713048235 <== osd.2 v2:172.21.15.104:6817/2319361072 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fcb18075230 con 0x7fcb18072760 2023-09-13T02:12:29.670 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.568+0000 7f508f7fe640 1 -- 172.21.15.104:0/2632113798 <== osd.1 v2:172.21.15.104:6808/3786698894 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f50940752b0 con 0x7f50940727e0 2023-09-13T02:12:29.670 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.568+0000 7f9d43fff640 1 -- 172.21.15.104:0/700559131 <== osd.6 v2:172.21.15.119:6824/3509665357 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9d480750f0 con 0x7f9d48072620 2023-09-13T02:12:29.671 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.567+0000 7f51a8fbc640 1 --2- 172.21.15.104:0/3329554918 >> [v2:172.21.15.119:6800/3049794634,v1:172.21.15.119:6801/3049794634] conn(0x7f5184072790 0x7f5184074bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.671 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.567+0000 7f51a0ff9640 1 -- 172.21.15.104:0/3329554918 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f519c0771d0 con 0x7f51a4137a20 2023-09-13T02:12:29.671 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.567+0000 7f51a8fbc640 1 --2- 172.21.15.104:0/3329554918 >> [v2:172.21.15.119:6800/3049794634,v1:172.21.15.119:6801/3049794634] conn(0x7f5184072790 0x7f5184074bb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.671 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.568+0000 7f51a37fe640 1 --2- 172.21.15.104:0/3329554918 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f518406a5f0 0x7f518406cab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f518c001050 tx=0x7f518c003610 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.671 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.568+0000 7f51a0ff9640 1 -- 172.21.15.104:0/3329554918 <== osd.4 v2:172.21.15.119:6800/3049794634 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f5184075260 con 0x7f5184072790 2023-09-13T02:12:29.672 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.597+0000 7f90bf14c640 1 -- 172.21.15.104:0/3415759171 --> [v2:172.21.15.104:6800/3271772377,v1:172.21.15.104:6801/3271772377] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f90b8142840 con 0x7f909c072760 2023-09-13T02:12:29.672 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.598+0000 7f13e9ffb640 1 -- 172.21.15.104:0/1391694593 --> [v2:172.21.15.119:6808/2918159428,v1:172.21.15.119:6809/2918159428] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f14040b3d10 con 0x7f13f00726e0 2023-09-13T02:12:29.673 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.598+0000 7f13ebfff640 1 -- 172.21.15.104:0/1391694593 <== osd.5 v2:172.21.15.119:6808/2918159428 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f14040b3d10 con 0x7f13f00726e0 2023-09-13T02:12:29.673 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.599+0000 7f90b57fa640 1 -- 172.21.15.104:0/3415759171 <== osd.0 v2:172.21.15.104:6800/3271772377 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f90b8142840 con 0x7f909c072760 2023-09-13T02:12:29.674 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.599+0000 7f1408e6d640 1 -- 172.21.15.104:0/1391694593 >> [v2:172.21.15.119:6808/2918159428,v1:172.21.15.119:6809/2918159428] conn(0x7f13f00726e0 msgr2=0x7f13f0074b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.674 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.599+0000 7f1408e6d640 1 --2- 172.21.15.104:0/1391694593 >> [v2:172.21.15.119:6808/2918159428,v1:172.21.15.119:6809/2918159428] conn(0x7f13f00726e0 0x7f13f0074b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.674 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.599+0000 7f1408e6d640 1 -- 172.21.15.104:0/1391694593 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f13f006a540 msgr2=0x7f13f006ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.675 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.599+0000 7f1408e6d640 1 --2- 172.21.15.104:0/1391694593 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f13f006a540 0x7f13f006ca00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f14041427c0 tx=0x7f13f8005f90 comp rx=0 tx=0).stop 2023-09-13T02:12:29.675 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.599+0000 7f1408e6d640 1 -- 172.21.15.104:0/1391694593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f140406a4a0 msgr2=0x7f14040b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.675 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.599+0000 7f1408e6d640 1 --2- 172.21.15.104:0/1391694593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f140406a4a0 0x7f14040b0840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f13f400b410 tx=0x7f13f400b8d0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.676 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.599+0000 7f1403fff640 1 -- 172.21.15.104:0/1391694593 reap_dead start 2023-09-13T02:12:29.676 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.599+0000 7fe1d3563640 1 -- 172.21.15.104:0/1855040541 --> [v2:172.21.15.104:6816/621253853,v1:172.21.15.104:6818/621253853] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe1b4002cb0 con 0x7fe1b0072760 2023-09-13T02:12:29.677 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.599+0000 7f1408e6d640 1 -- 172.21.15.104:0/1391694593 shutdown_connections 2023-09-13T02:12:29.677 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.599+0000 7f1408e6d640 1 -- 172.21.15.104:0/1391694593 >> 172.21.15.104:0/1391694593 conn(0x7f14040697b0 msgr2=0x7f1404070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.677 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.599+0000 7f50a7fff640 1 -- 172.21.15.104:0/2632113798 --> [v2:172.21.15.104:6808/3786698894,v1:172.21.15.104:6809/3786698894] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f50a00d2fb0 con 0x7f50940727e0 2023-09-13T02:12:29.678 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.600+0000 7f1408e6d640 1 -- 172.21.15.104:0/1391694593 shutdown_connections 2023-09-13T02:12:29.678 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.600+0000 7f508f7fe640 1 -- 172.21.15.104:0/2632113798 <== osd.1 v2:172.21.15.104:6808/3786698894 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5098009840 con 0x7f50940727e0 2023-09-13T02:12:29.679 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.600+0000 7fe1c2ffd640 1 -- 172.21.15.104:0/1855040541 <== osd.3 v2:172.21.15.104:6816/621253853 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe1b4002cb0 con 0x7fe1b0072760 2023-09-13T02:12:29.679 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.600+0000 7f1408e6d640 1 -- 172.21.15.104:0/1391694593 wait complete. 2023-09-13T02:12:29.680 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.600+0000 7f9d41ffb640 1 -- 172.21.15.104:0/700559131 --> [v2:172.21.15.119:6824/3509665357,v1:172.21.15.119:6825/3509665357] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d5401f3f0 con 0x7f9d48072620 2023-09-13T02:12:29.680 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.600+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/1713048235 --> [v2:172.21.15.104:6817/2319361072,v1:172.21.15.104:6819/2319361072] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb38141660 con 0x7fcb18072760 2023-09-13T02:12:29.680 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.600+0000 7f90a2ffd640 1 -- 172.21.15.104:0/3415759171 >> [v2:172.21.15.104:6800/3271772377,v1:172.21.15.104:6801/3271772377] conn(0x7f909c072760 msgr2=0x7f909c074b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.681 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.600+0000 7f90a2ffd640 1 --2- 172.21.15.104:0/3415759171 >> [v2:172.21.15.104:6800/3271772377,v1:172.21.15.104:6801/3271772377] conn(0x7f909c072760 0x7f909c074b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.681 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.600+0000 7fe1c0ff9640 1 -- 172.21.15.104:0/1855040541 >> [v2:172.21.15.104:6816/621253853,v1:172.21.15.104:6818/621253853] conn(0x7fe1b0072760 msgr2=0x7fe1b0074b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.681 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.600+0000 7fe1c0ff9640 1 --2- 172.21.15.104:0/1855040541 >> [v2:172.21.15.104:6816/621253853,v1:172.21.15.104:6818/621253853] conn(0x7fe1b0072760 0x7fe1b0074b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.682 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.600+0000 7f50a7fff640 1 -- 172.21.15.104:0/2632113798 >> [v2:172.21.15.104:6808/3786698894,v1:172.21.15.104:6809/3786698894] conn(0x7f50940727e0 msgr2=0x7f5094074c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.682 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.600+0000 7f50a7fff640 1 --2- 172.21.15.104:0/2632113798 >> [v2:172.21.15.104:6808/3786698894,v1:172.21.15.104:6809/3786698894] conn(0x7f50940727e0 0x7f5094074c00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.682 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.600+0000 7f90a2ffd640 1 -- 172.21.15.104:0/3415759171 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f909c06a5c0 msgr2=0x7f909c06ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.600+0000 7f90a2ffd640 1 --2- 172.21.15.104:0/3415759171 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f909c06a5c0 0x7f909c06ca80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f90b80b0220 tx=0x7f90a4007e30 comp rx=0 tx=0).stop 2023-09-13T02:12:29.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f90a2ffd640 1 -- 172.21.15.104:0/3415759171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b8070830 msgr2=0x7f90b80b0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f90a2ffd640 1 --2- 172.21.15.104:0/3415759171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b8070830 0x7f90b80b0d60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f90ac02c2a0 tx=0x7f90ac02dc60 comp rx=0 tx=0).stop 2023-09-13T02:12:29.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f90bd6e9640 1 -- 172.21.15.104:0/3415759171 reap_dead start 2023-09-13T02:12:29.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7fe1c0ff9640 1 -- 172.21.15.104:0/1855040541 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fe1b006a5c0 msgr2=0x7fe1b006ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.684 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7fe1c0ff9640 1 --2- 172.21.15.104:0/1855040541 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fe1b006a5c0 0x7fe1b006ca80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40386d0 tx=0x7fe1c8009040 comp rx=0 tx=0).stop 2023-09-13T02:12:29.684 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7fe1c0ff9640 1 -- 172.21.15.104:0/1855040541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1c403c960 msgr2=0x7fe1c4040d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.684 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7fe1c0ff9640 1 --2- 172.21.15.104:0/1855040541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1c403c960 0x7fe1c4040d20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00e790 tx=0x7fe1bc00ec50 comp rx=0 tx=0).stop 2023-09-13T02:12:29.684 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7fe1d2d62640 1 -- 172.21.15.104:0/1855040541 reap_dead start 2023-09-13T02:12:29.685 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f51aaa1f640 1 -- 172.21.15.104:0/3329554918 --> [v2:172.21.15.119:6800/3049794634,v1:172.21.15.119:6801/3049794634] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5188002cb0 con 0x7f5184072790 2023-09-13T02:12:29.685 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f9d43fff640 1 -- 172.21.15.104:0/700559131 <== osd.6 v2:172.21.15.119:6824/3509665357 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9d5401f3f0 con 0x7f9d48072620 2023-09-13T02:12:29.686 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f90a2ffd640 1 -- 172.21.15.104:0/3415759171 shutdown_connections 2023-09-13T02:12:29.686 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f90a2ffd640 1 -- 172.21.15.104:0/3415759171 >> 172.21.15.104:0/3415759171 conn(0x7f90b8069b30 msgr2=0x7f90b8147dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.687 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f90a2ffd640 1 -- 172.21.15.104:0/3415759171 shutdown_connections 2023-09-13T02:12:29.687 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f90a2ffd640 1 -- 172.21.15.104:0/3415759171 wait complete. 2023-09-13T02:12:29.687 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7fcb26ffd640 1 -- 172.21.15.104:0/1713048235 <== osd.2 v2:172.21.15.104:6817/2319361072 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcb38141660 con 0x7fcb18072760 2023-09-13T02:12:29.687 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/1713048235 >> [v2:172.21.15.104:6817/2319361072,v1:172.21.15.104:6819/2319361072] conn(0x7fcb18072760 msgr2=0x7fcb18074b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.688 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7fcb3cc1f640 1 --2- 172.21.15.104:0/1713048235 >> [v2:172.21.15.104:6817/2319361072,v1:172.21.15.104:6819/2319361072] conn(0x7fcb18072760 0x7fcb18074b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.688 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7fe1c0ff9640 1 -- 172.21.15.104:0/1855040541 shutdown_connections 2023-09-13T02:12:29.688 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7fe1c0ff9640 1 -- 172.21.15.104:0/1855040541 >> 172.21.15.104:0/1855040541 conn(0x7fe1c403ec40 msgr2=0x7fe1c40cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.689 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f50a7fff640 1 -- 172.21.15.104:0/2632113798 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f509406a5c0 msgr2=0x7f509406ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.689 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f50a7fff640 1 --2- 172.21.15.104:0/2632113798 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f509406a5c0 0x7f509406ca80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f50a00be420 tx=0x7f509c00b040 comp rx=0 tx=0).stop 2023-09-13T02:12:29.689 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f50a7fff640 1 -- 172.21.15.104:0/2632113798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50a00c2aa0 msgr2=0x7f50a00be8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.690 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f7f721ef640 1 -- 172.21.15.104:0/1500342129 --> [v2:172.21.15.119:6816/892749725,v1:172.21.15.119:6817/892749725] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7f6c0b0230 con 0x7f7f500727e0 2023-09-13T02:12:29.690 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/1713048235 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fcb1806a5c0 msgr2=0x7fcb1806ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.690 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7fcb3cc1f640 1 --2- 172.21.15.104:0/1713048235 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fcb1806a5c0 0x7fcb1806ca80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb381eb090 tx=0x7fcb28009040 comp rx=0 tx=0).stop 2023-09-13T02:12:29.691 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f51a0ff9640 1 -- 172.21.15.104:0/3329554918 <== osd.4 v2:172.21.15.119:6800/3049794634 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5188002cb0 con 0x7f5184072790 2023-09-13T02:12:29.691 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f50a7fff640 1 --2- 172.21.15.104:0/2632113798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50a00c2aa0 0x7f50a00be8a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f50a8068cc0 tx=0x7f50a80af780 comp rx=0 tx=0).stop 2023-09-13T02:12:29.692 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/1713048235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb3813e5d0 msgr2=0x7fcb38141840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.692 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7fcb3cc1f640 1 --2- 172.21.15.104:0/1713048235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb3813e5d0 0x7fcb38141840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcb380b6c70 tx=0x7fcb3003b400 comp rx=0 tx=0).stop 2023-09-13T02:12:29.692 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7fcb36d9d640 1 -- 172.21.15.104:0/1713048235 reap_dead start 2023-09-13T02:12:29.693 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7fe1c0ff9640 1 -- 172.21.15.104:0/1855040541 shutdown_connections 2023-09-13T02:12:29.693 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7fe1c0ff9640 1 -- 172.21.15.104:0/1855040541 wait complete. 2023-09-13T02:12:29.694 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f9d41ffb640 1 -- 172.21.15.104:0/700559131 >> [v2:172.21.15.119:6824/3509665357,v1:172.21.15.119:6825/3509665357] conn(0x7f9d48072620 msgr2=0x7f9d48074a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.694 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f9d41ffb640 1 --2- 172.21.15.104:0/700559131 >> [v2:172.21.15.119:6824/3509665357,v1:172.21.15.119:6825/3509665357] conn(0x7f9d48072620 0x7f9d48074a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.694 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f9d41ffb640 1 -- 172.21.15.104:0/700559131 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f9d4806a5f0 msgr2=0x7f9d4806cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.694 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f9d41ffb640 1 --2- 172.21.15.104:0/700559131 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f9d4806a5f0 0x7f9d4806cab0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9d5416ae20 tx=0x7f9d50005f90 comp rx=0 tx=0).stop 2023-09-13T02:12:29.695 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f50a77fe640 1 -- 172.21.15.104:0/2632113798 reap_dead start 2023-09-13T02:12:29.695 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f50a7fff640 1 -- 172.21.15.104:0/2632113798 shutdown_connections 2023-09-13T02:12:29.695 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.601+0000 7f50a7fff640 1 -- 172.21.15.104:0/2632113798 >> 172.21.15.104:0/2632113798 conn(0x7f50a003ae40 msgr2=0x7f50a0005af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.696 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f9d41ffb640 1 -- 172.21.15.104:0/700559131 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d54008280 msgr2=0x7f9d54169fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.696 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f9d41ffb640 1 --2- 172.21.15.104:0/700559131 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d54008280 0x7f9d54169fd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00c4d0 tx=0x7f9d4c00c990 comp rx=0 tx=0).stop 2023-09-13T02:12:29.696 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f50a7fff640 1 -- 172.21.15.104:0/2632113798 shutdown_connections 2023-09-13T02:12:29.697 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/1713048235 shutdown_connections 2023-09-13T02:12:29.697 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/1713048235 >> 172.21.15.104:0/1713048235 conn(0x7fcb3806bfb0 msgr2=0x7fcb380b7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.698 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f9d5b7fe640 1 -- 172.21.15.104:0/700559131 reap_dead start 2023-09-13T02:12:29.698 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f9d41ffb640 1 -- 172.21.15.104:0/700559131 shutdown_connections 2023-09-13T02:12:29.698 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f9d41ffb640 1 -- 172.21.15.104:0/700559131 >> 172.21.15.104:0/700559131 conn(0x7f9d5400b730 msgr2=0x7f9d54008f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.698 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f7f61ffb640 1 -- 172.21.15.104:0/1500342129 <== osd.7 v2:172.21.15.119:6816/892749725 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7f6c0b0230 con 0x7f7f500727e0 2023-09-13T02:12:29.699 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/1713048235 shutdown_connections 2023-09-13T02:12:29.699 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7fcb3cc1f640 1 -- 172.21.15.104:0/1713048235 wait complete. 2023-09-13T02:12:29.700 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f51aaa1f640 1 -- 172.21.15.104:0/3329554918 >> [v2:172.21.15.119:6800/3049794634,v1:172.21.15.119:6801/3049794634] conn(0x7f5184072790 msgr2=0x7f5184074bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.700 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f51aaa1f640 1 --2- 172.21.15.104:0/3329554918 >> [v2:172.21.15.119:6800/3049794634,v1:172.21.15.119:6801/3049794634] conn(0x7f5184072790 0x7f5184074bb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.700 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f50a7fff640 1 -- 172.21.15.104:0/2632113798 wait complete. 2023-09-13T02:12:29.701 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f9d41ffb640 1 -- 172.21.15.104:0/700559131 shutdown_connections 2023-09-13T02:12:29.701 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f51aaa1f640 1 -- 172.21.15.104:0/3329554918 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f518406a5f0 msgr2=0x7f518406cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.702 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f51aaa1f640 1 --2- 172.21.15.104:0/3329554918 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f518406a5f0 0x7f518406cab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f518c001050 tx=0x7f518c003610 comp rx=0 tx=0).stop 2023-09-13T02:12:29.702 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f9d41ffb640 1 -- 172.21.15.104:0/700559131 wait complete. 2023-09-13T02:12:29.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f51aaa1f640 1 -- 172.21.15.104:0/3329554918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51a4137a20 msgr2=0x7f51a406fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f51aaa1f640 1 --2- 172.21.15.104:0/3329554918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51a4137a20 0x7f51a406fcb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f519c009c70 tx=0x7f519c033c40 comp rx=0 tx=0).stop 2023-09-13T02:12:29.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f51a8fbc640 1 -- 172.21.15.104:0/3329554918 reap_dead start 2023-09-13T02:12:29.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f51aaa1f640 1 -- 172.21.15.104:0/3329554918 shutdown_connections 2023-09-13T02:12:29.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.602+0000 7f51aaa1f640 1 -- 172.21.15.104:0/3329554918 >> 172.21.15.104:0/3329554918 conn(0x7f51a40b56f0 msgr2=0x7f51a40ad930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.704 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.603+0000 7f51aaa1f640 1 -- 172.21.15.104:0/3329554918 shutdown_connections 2023-09-13T02:12:29.704 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.603+0000 7f7f721ef640 1 -- 172.21.15.104:0/1500342129 >> [v2:172.21.15.119:6816/892749725,v1:172.21.15.119:6817/892749725] conn(0x7f7f500727e0 msgr2=0x7f7f50074c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.704 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.603+0000 7f7f721ef640 1 --2- 172.21.15.104:0/1500342129 >> [v2:172.21.15.119:6816/892749725,v1:172.21.15.119:6817/892749725] conn(0x7f7f500727e0 0x7f7f50074c00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.705 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.603+0000 7f51aaa1f640 1 -- 172.21.15.104:0/3329554918 wait complete. 2023-09-13T02:12:29.705 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.603+0000 7f7f721ef640 1 -- 172.21.15.104:0/1500342129 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f7f5006a5c0 msgr2=0x7f7f5006ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.705 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.603+0000 7f7f721ef640 1 --2- 172.21.15.104:0/1500342129 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f7f5006a5c0 0x7f7f5006ca80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7f64005fd0 tx=0x7f7f640095c0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.603+0000 7f7f721ef640 1 -- 172.21.15.104:0/1500342129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f6c0af7c0 msgr2=0x7f7f6c0a9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.604+0000 7f7f721ef640 1 --2- 172.21.15.104:0/1500342129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f6c0af7c0 0x7f7f6c0a9c90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800d770 tx=0x7f7f6800dc30 comp rx=0 tx=0).stop 2023-09-13T02:12:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.604+0000 7f7f719ee640 1 -- 172.21.15.104:0/1500342129 reap_dead start 2023-09-13T02:12:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.604+0000 7f7f721ef640 1 -- 172.21.15.104:0/1500342129 shutdown_connections 2023-09-13T02:12:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.604+0000 7f7f721ef640 1 -- 172.21.15.104:0/1500342129 >> 172.21.15.104:0/1500342129 conn(0x7f7f6c0b5e20 msgr2=0x7f7f6c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.707 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.604+0000 7f7f721ef640 1 -- 172.21.15.104:0/1500342129 shutdown_connections 2023-09-13T02:12:29.707 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.604+0000 7f7f721ef640 1 -- 172.21.15.104:0/1500342129 wait complete. 2023-09-13T02:12:29.707 INFO:teuthology.orchestra.run.smithi104.stdout:55834574853 2023-09-13T02:12:29.708 INFO:teuthology.orchestra.run.smithi104.stdout:55834574856 2023-09-13T02:12:29.708 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2023-09-13T02:12:29.709 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-13T02:12:29.710 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-13T02:12:29.710 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-13T02:12:29.711 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2023-09-13T02:12:29.712 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-13T02:12:29.713 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2023-09-13T02:12:29.713 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-13T02:12:29.714 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2023-09-13T02:12:29.714 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-13T02:12:29.715 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2023-09-13T02:12:29.716 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-13T02:12:29.717 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2023-09-13T02:12:29.717 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-13T02:12:29.924 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7ff64717c640 1 -- 172.21.15.104:0/2469413528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6400afaf0 msgr2=0x7ff640141410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.924 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7ff64717c640 1 --2- 172.21.15.104:0/2469413528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6400afaf0 0x7ff640141410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff638005fd0 tx=0x7ff63802c310 comp rx=0 tx=0).stop 2023-09-13T02:12:29.925 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7fca8559a640 1 -- 172.21.15.104:0/46685788 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0038a0 con 0x7fca88070820 2023-09-13T02:12:29.925 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7fca8759e640 1 -- 172.21.15.104:0/46685788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca88070820 msgr2=0x7fca88070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.925 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7fca8759e640 1 --2- 172.21.15.104:0/46685788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca88070820 0x7fca88070cb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0098e0 tx=0x7fca7c034490 comp rx=0 tx=0).stop 2023-09-13T02:12:29.926 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7ff64717c640 1 -- 172.21.15.104:0/2469413528 shutdown_connections 2023-09-13T02:12:29.926 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7ff64717c640 1 --2- 172.21.15.104:0/2469413528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6400afaf0 0x7ff640141410 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.926 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7ff64717c640 1 -- 172.21.15.104:0/2469413528 >> 172.21.15.104:0/2469413528 conn(0x7ff6400b6860 msgr2=0x7ff6400b6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.926 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7f93c27fc640 1 -- 172.21.15.104:0/3889179659 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4034e10 con 0x7f93c40ae6e0 2023-09-13T02:12:29.927 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7fca8759e640 1 -- 172.21.15.104:0/46685788 shutdown_connections 2023-09-13T02:12:29.927 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7fca8759e640 1 --2- 172.21.15.104:0/46685788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca88070820 0x7fca88070cb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.928 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7fca8759e640 1 --2- 172.21.15.104:0/46685788 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca8806a7d0 0x7fca8806b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.928 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7fca8759e640 1 -- 172.21.15.104:0/46685788 >> 172.21.15.104:0/46685788 conn(0x7fca88069b50 msgr2=0x7fca880b76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.928 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7fca8759e640 1 -- 172.21.15.104:0/46685788 shutdown_connections 2023-09-13T02:12:29.928 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7f93ca094640 1 -- 172.21.15.104:0/3889179659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93c40ae6e0 msgr2=0x7f93c40acfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.929 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7f93ca094640 1 --2- 172.21.15.104:0/3889179659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93c40ae6e0 0x7f93c40acfc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f93c40ae240 tx=0x7f93b4034270 comp rx=0 tx=0).stop 2023-09-13T02:12:29.929 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7fca8759e640 1 -- 172.21.15.104:0/46685788 wait complete. 2023-09-13T02:12:29.930 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7f93ca094640 1 -- 172.21.15.104:0/3889179659 shutdown_connections 2023-09-13T02:12:29.930 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7f93ca094640 1 --2- 172.21.15.104:0/3889179659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93c40ae6e0 0x7f93c40acfc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.930 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7f93ca094640 1 --2- 172.21.15.104:0/3889179659 >> v2:172.21.15.119:3300/0 conn(0x7f93c406b5e0 0x7f93c413fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.930 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7f93ca094640 1 -- 172.21.15.104:0/3889179659 >> 172.21.15.104:0/3889179659 conn(0x7f93c40b54d0 msgr2=0x7f93c40b58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.931 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.923+0000 7ff64717c640 1 -- 172.21.15.104:0/2469413528 shutdown_connections 2023-09-13T02:12:29.931 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.924+0000 7f90c1c26640 1 -- 172.21.15.104:0/2988074235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90bc1444d0 msgr2=0x7f90bc13a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.932 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.924+0000 7f90c1c26640 1 --2- 172.21.15.104:0/2988074235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90bc1444d0 0x7f90bc13a960 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f90b4005fd0 tx=0x7f90b402c060 comp rx=0 tx=0).stop 2023-09-13T02:12:29.932 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.924+0000 7f93ca094640 1 -- 172.21.15.104:0/3889179659 shutdown_connections 2023-09-13T02:12:29.932 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.924+0000 7ff64717c640 1 -- 172.21.15.104:0/2469413528 wait complete. 2023-09-13T02:12:29.933 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.924+0000 7f93ca094640 1 -- 172.21.15.104:0/3889179659 wait complete. 2023-09-13T02:12:29.933 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.924+0000 7ff1a359e640 1 -- 172.21.15.104:0/1796329088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff19c035820 msgr2=0x7ff19c035cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.934 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.924+0000 7ff1a359e640 1 --2- 172.21.15.104:0/1796329088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff19c035820 0x7ff19c035cd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff198005fd0 tx=0x7ff19800ac00 comp rx=0 tx=0).stop 2023-09-13T02:12:29.934 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.924+0000 7ff1a359e640 1 -- 172.21.15.104:0/1796329088 shutdown_connections 2023-09-13T02:12:29.934 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.924+0000 7ff1a359e640 1 --2- 172.21.15.104:0/1796329088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff19c035820 0x7ff19c035cd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.934 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.924+0000 7ff1a359e640 1 --2- 172.21.15.104:0/1796329088 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff19c037070 0x7ff19c0c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.935 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7ff1a359e640 1 -- 172.21.15.104:0/1796329088 >> 172.21.15.104:0/1796329088 conn(0x7ff19c03a9f0 msgr2=0x7ff19c03ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.935 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f8553a56640 1 -- 172.21.15.104:0/34027574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f854c147b90 msgr2=0x7f854c1482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.935 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.924+0000 7f90c1c26640 1 -- 172.21.15.104:0/2988074235 shutdown_connections 2023-09-13T02:12:29.936 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.924+0000 7f90c1c26640 1 --2- 172.21.15.104:0/2988074235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90bc1444d0 0x7f90bc13a960 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.936 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.924+0000 7f90c1c26640 1 --2- 172.21.15.104:0/2988074235 >> v2:172.21.15.119:3300/0 conn(0x7f90bc0b0ae0 0x7f90bc140640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.936 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.924+0000 7f90c1c26640 1 -- 172.21.15.104:0/2988074235 >> 172.21.15.104:0/2988074235 conn(0x7f90bc0b56f0 msgr2=0x7f90bc0b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.937 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f8553a56640 1 --2- 172.21.15.104:0/34027574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f854c147b90 0x7f854c1482f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f854c06b460 tx=0x7f853c02bda0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.937 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f001f1bd640 1 -- 172.21.15.104:0/3770797110 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0010004ab0 msgr2=0x7f0010036ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.937 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f001f1bd640 1 --2- 172.21.15.104:0/3770797110 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0010004ab0 0x7f0010036ce0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f000c009830 tx=0x7f000c02bd60 comp rx=0 tx=0).stop 2023-09-13T02:12:29.938 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f90c1c26640 1 -- 172.21.15.104:0/2988074235 shutdown_connections 2023-09-13T02:12:29.938 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f8553a56640 1 -- 172.21.15.104:0/34027574 shutdown_connections 2023-09-13T02:12:29.939 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f90c1c26640 1 -- 172.21.15.104:0/2988074235 wait complete. 2023-09-13T02:12:29.939 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f8553a56640 1 --2- 172.21.15.104:0/34027574 >> v2:172.21.15.104:3300/0 conn(0x7f854c0b1820 0x7f854c0afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.939 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f44dca32640 1 -- 172.21.15.104:0/1904601724 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44d00c6960 msgr2=0x7f44d00cd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.940 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f44dca32640 1 --2- 172.21.15.104:0/1904601724 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44d00c6960 0x7f44d00cd040 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f44d8000b60 tx=0x7f44d80686e0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.940 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f8553a56640 1 --2- 172.21.15.104:0/34027574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f854c147b90 0x7f854c1482f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.940 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f8553a56640 1 -- 172.21.15.104:0/34027574 >> 172.21.15.104:0/34027574 conn(0x7f854c0708b0 msgr2=0x7f854c070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.941 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7fca8759e640 1 Processor -- start 2023-09-13T02:12:29.941 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f001f1bd640 1 -- 172.21.15.104:0/3770797110 shutdown_connections 2023-09-13T02:12:29.941 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f001f1bd640 1 --2- 172.21.15.104:0/3770797110 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0010004ab0 0x7f0010036ce0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.942 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f001f1bd640 1 -- 172.21.15.104:0/3770797110 >> 172.21.15.104:0/3770797110 conn(0x7f001003ad30 msgr2=0x7f001003b140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.942 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f8553a56640 1 -- 172.21.15.104:0/34027574 shutdown_connections 2023-09-13T02:12:29.942 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f8553a56640 1 -- 172.21.15.104:0/34027574 wait complete. 2023-09-13T02:12:29.943 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f001f1bd640 1 -- 172.21.15.104:0/3770797110 shutdown_connections 2023-09-13T02:12:29.943 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7ff64717c640 1 Processor -- start 2023-09-13T02:12:29.944 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7ff64717c640 1 -- start start 2023-09-13T02:12:29.944 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f001f1bd640 1 -- 172.21.15.104:0/3770797110 wait complete. 2023-09-13T02:12:29.944 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7f44dca32640 1 -- 172.21.15.104:0/1904601724 shutdown_connections 2023-09-13T02:12:29.945 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7f44dca32640 1 --2- 172.21.15.104:0/1904601724 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44d00c6960 0x7f44d00cd040 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.945 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7f44dca32640 1 -- 172.21.15.104:0/1904601724 >> 172.21.15.104:0/1904601724 conn(0x7f44d003eac0 msgr2=0x7f44d003eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:29.945 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7fca8759e640 1 -- start start 2023-09-13T02:12:29.947 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.925+0000 7f93ca094640 1 Processor -- start 2023-09-13T02:12:29.947 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7f93ca094640 1 -- start start 2023-09-13T02:12:29.947 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7f44dca32640 1 -- 172.21.15.104:0/1904601724 shutdown_connections 2023-09-13T02:12:29.948 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7fca8759e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca8806a7d0 0x7fca88138800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.948 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7fca8759e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca8806be50 0x7fca88144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.948 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7fca8759e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca88070820 0x7fca881d92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.949 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7fca8759e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca881d8ed0 con 0x7fca8806be50 2023-09-13T02:12:29.949 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7fca8759e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca881390a0 con 0x7fca8806a7d0 2023-09-13T02:12:29.949 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7fca8759e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca88144e70 con 0x7fca88070820 2023-09-13T02:12:29.949 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7f44dca32640 1 -- 172.21.15.104:0/1904601724 wait complete. 2023-09-13T02:12:29.950 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7ff64717c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6400ae730 0x7ff64013cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.950 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7ff64717c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6400afaf0 0x7ff640143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.950 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7ff64717c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff64013b2c0 0x7ff64012d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.951 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7ff64717c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64013dfe0 con 0x7ff64013b2c0 2023-09-13T02:12:29.951 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7ff64717c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff640071920 con 0x7ff6400ae730 2023-09-13T02:12:29.951 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7ff64717c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64006f9e0 con 0x7ff6400afaf0 2023-09-13T02:12:29.952 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7f90c1c26640 1 Processor -- start 2023-09-13T02:12:29.952 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7fca85d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca8806be50 0x7fca88144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.953 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7fca8659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca8806a7d0 0x7fca88138800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.953 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7ff63ffff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6400afaf0 0x7ff640143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.953 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7ff645719640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff64013b2c0 0x7ff64012d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.953 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7ff645719640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff64013b2c0 0x7ff64012d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47234/0 (socket says 172.21.15.104:47234) 2023-09-13T02:12:29.954 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7ff645719640 1 -- 172.21.15.104:0/3011972703 learned_addr learned my addr 172.21.15.104:0/3011972703 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:29.954 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7f90c1c26640 1 -- start start 2023-09-13T02:12:29.954 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7ff1a359e640 1 -- 172.21.15.104:0/1796329088 shutdown_connections 2023-09-13T02:12:29.955 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7fca8659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca8806a7d0 0x7fca88138800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.104:39864/0 (socket says 172.21.15.104:39864) 2023-09-13T02:12:29.955 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7fca8659c640 1 -- 172.21.15.104:0/2278050293 learned_addr learned my addr 172.21.15.104:0/2278050293 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7ff644f18640 1 --2- 172.21.15.104:0/3011972703 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6400ae730 0x7ff64013cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7f8553a56640 1 Processor -- start 2023-09-13T02:12:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7f8553a56640 1 -- start start 2023-09-13T02:12:29.957 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7f001f1bd640 1 Processor -- start 2023-09-13T02:12:29.958 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7ff645719640 1 -- 172.21.15.104:0/3011972703 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6400afaf0 msgr2=0x7ff640143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.958 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7ff645719640 1 --2- 172.21.15.104:0/3011972703 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6400afaf0 0x7ff640143d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.959 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7ff645719640 1 -- 172.21.15.104:0/3011972703 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6400ae730 msgr2=0x7ff64013cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.959 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7ff645719640 1 --2- 172.21.15.104:0/3011972703 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6400ae730 0x7ff64013cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.959 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7ff645719640 1 -- 172.21.15.104:0/3011972703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff638009900 con 0x7ff64013b2c0 2023-09-13T02:12:29.959 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7f001f1bd640 1 -- start start 2023-09-13T02:12:29.960 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7ff644f18640 1 --2- 172.21.15.104:0/3011972703 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6400ae730 0x7ff64013cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:29.960 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7ff645719640 1 --2- 172.21.15.104:0/3011972703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff64013b2c0 0x7ff64012d9e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff63400c3c0 tx=0x7ff63400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.960 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7ff1a359e640 1 -- 172.21.15.104:0/1796329088 wait complete. 2023-09-13T02:12:29.961 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7fca8659c640 1 -- 172.21.15.104:0/2278050293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca88070820 msgr2=0x7fca881d92f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-13T02:12:29.961 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7ff63d7fa640 1 -- 172.21.15.104:0/3011972703 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6340052d0 con 0x7ff64013b2c0 2023-09-13T02:12:29.962 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7fca8659c640 1 --2- 172.21.15.104:0/2278050293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca88070820 0x7fca881d92f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.962 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7f93ca094640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93c406b5e0 0x7f93c406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.963 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.926+0000 7f93ca094640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c40ae6e0 0x7f93c413ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.963 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7f93c37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93c406b5e0 0x7f93c406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.963 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7f93c37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93c406b5e0 0x7f93c406d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47248/0 (socket says 172.21.15.104:47248) 2023-09-13T02:12:29.963 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7f93ca094640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c40af700 0x7f93c413d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.963 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7f93ca094640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c406f260 con 0x7f93c406b5e0 2023-09-13T02:12:29.965 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7f93ca094640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c406f540 con 0x7f93c40af700 2023-09-13T02:12:29.965 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7f93ca094640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c406ff80 con 0x7f93c40ae6e0 2023-09-13T02:12:29.966 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7fca8659c640 1 -- 172.21.15.104:0/2278050293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca8806be50 msgr2=0x7fca88144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.966 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.927+0000 7f93c2ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c40ae6e0 0x7f93c413ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.966 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f93c2ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c40ae6e0 0x7f93c413ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.104:42612/0 (socket says 172.21.15.104:42612) 2023-09-13T02:12:29.966 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f93c2ffd640 1 -- 172.21.15.104:0/2150502835 learned_addr learned my addr 172.21.15.104:0/2150502835 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:29.967 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f93c3fff640 1 --2- 172.21.15.104:0/2150502835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c40af700 0x7f93c413d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.967 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f90c1c26640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90bc0b0ae0 0x7f90bc0b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.967 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7fca8659c640 1 --2- 172.21.15.104:0/2278050293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca8806be50 0x7fca88144930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.968 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7ff63d7fa640 1 -- 172.21.15.104:0/3011972703 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff6340035f0 con 0x7ff64013b2c0 2023-09-13T02:12:29.968 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7fca8659c640 1 -- 172.21.15.104:0/2278050293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c009540 con 0x7fca8806a7d0 2023-09-13T02:12:29.969 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7fca85d9b640 1 --2- 172.21.15.104:0/2278050293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca8806be50 0x7fca88144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T02:12:29.969 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f8553a56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f854c0b5ba0 0x7f854c13bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.969 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f8553a56640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f854c147b90 0x7f854c0b9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.969 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f85517f2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f854c0b5ba0 0x7f854c13bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.970 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7ff64717c640 1 -- 172.21.15.104:0/3011972703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64006e7b0 con 0x7ff64013b2c0 2023-09-13T02:12:29.970 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7ff64717c640 1 -- 172.21.15.104:0/3011972703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64013dc60 con 0x7ff64013b2c0 2023-09-13T02:12:29.970 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7ff63d7fa640 1 -- 172.21.15.104:0/3011972703 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6340039e0 con 0x7ff64013b2c0 2023-09-13T02:12:29.971 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f44dca32640 1 Processor -- start 2023-09-13T02:12:29.971 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f44dca32640 1 -- start start 2023-09-13T02:12:29.971 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f90c1c26640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90bc13a500 0x7f90bc06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.972 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f90c1c26640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90bc1444d0 0x7f90bc132a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.972 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f90bb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90bc0b0ae0 0x7f90bc0b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.972 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f90baffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90bc13a500 0x7f90bc06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.972 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f90baffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90bc13a500 0x7f90bc06dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.104:42620/0 (socket says 172.21.15.104:42620) 2023-09-13T02:12:29.972 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f90baffd640 1 -- 172.21.15.104:0/3320483246 learned_addr learned my addr 172.21.15.104:0/3320483246 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:29.972 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f90bbfff640 1 --2- 172.21.15.104:0/3320483246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90bc1444d0 0x7f90bc132a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.973 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f90c1c26640 1 -- 172.21.15.104:0/3320483246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc139f70 con 0x7f90bc0b0ae0 2023-09-13T02:12:29.973 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f90c1c26640 1 -- 172.21.15.104:0/3320483246 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc070bf0 con 0x7f90bc1444d0 2023-09-13T02:12:29.973 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f90c1c26640 1 -- 172.21.15.104:0/3320483246 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc070430 con 0x7f90bc13a500 2023-09-13T02:12:29.974 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f85517f2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f854c0b5ba0 0x7f854c13bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.104:39884/0 (socket says 172.21.15.104:39884) 2023-09-13T02:12:29.974 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f85517f2640 1 -- 172.21.15.104:0/558732326 learned_addr learned my addr 172.21.15.104:0/558732326 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:29.974 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f8553a56640 1 --2- 172.21.15.104:0/558732326 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f854c0b7d60 0x7f854c0b81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.974 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f8553a56640 1 -- 172.21.15.104:0/558732326 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c13c4c0 con 0x7f854c147b90 2023-09-13T02:12:29.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7f8551ff3640 1 --2- 172.21.15.104:0/558732326 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f854c0b7d60 0x7f854c0b81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7ff1a359e640 1 Processor -- start 2023-09-13T02:12:29.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.928+0000 7ff1a359e640 1 -- start start 2023-09-13T02:12:29.976 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f8553a56640 1 -- 172.21.15.104:0/558732326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c0b9840 con 0x7f854c0b5ba0 2023-09-13T02:12:29.976 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f8553a56640 1 -- 172.21.15.104:0/558732326 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854c0b8720 con 0x7f854c0b7d60 2023-09-13T02:12:29.977 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f44dca32640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44d003a320 0x7f44d01659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.977 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f44dca32640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44d003c7e0 0x7f44d0041480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.977 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f44dca32640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44d00c6960 0x7f44d00bf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f44dca32640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d00ce9d0 con 0x7f44d003a320 2023-09-13T02:12:29.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f44dca32640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d00cecb0 con 0x7f44d00c6960 2023-09-13T02:12:29.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f44dca32640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d00cd6b0 con 0x7f44d003c7e0 2023-09-13T02:12:29.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f44d659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44d003a320 0x7f44d01659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f44d659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44d003a320 0x7f44d01659c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47278/0 (socket says 172.21.15.104:47278) 2023-09-13T02:12:29.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f8551ff3640 1 -- 172.21.15.104:0/558732326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f854c0b5ba0 msgr2=0x7f854c13bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f8551ff3640 1 --2- 172.21.15.104:0/558732326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f854c0b5ba0 0x7f854c13bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f8551ff3640 1 -- 172.21.15.104:0/558732326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f854c147b90 msgr2=0x7f854c0b9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f8551ff3640 1 --2- 172.21.15.104:0/558732326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f854c147b90 0x7f854c0b9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f8551ff3640 1 -- 172.21.15.104:0/558732326 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c009560 con 0x7f854c0b7d60 2023-09-13T02:12:29.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f44d659c640 1 -- 172.21.15.104:0/1728778253 learned_addr learned my addr 172.21.15.104:0/1728778253 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:29.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f44d6d9d640 1 --2- 172.21.15.104:0/1728778253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44d00c6960 0x7f44d00bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7ff1a359e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff19c035820 0x7ff19c033710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7ff1a359e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff19c036c90 0x7ff19c0caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7ff1a359e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff19c037070 0x7ff19c0caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7ff1a359e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c0ca5a0 con 0x7ff19c035820 2023-09-13T02:12:29.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7ff1a359e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c0cc480 con 0x7ff19c036c90 2023-09-13T02:12:29.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7ff1a359e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c0c9f80 con 0x7ff19c037070 2023-09-13T02:12:29.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f001f1bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0010004ab0 0x7f00100c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.983 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f001f1bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00100c1fc0 0x7f00100ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.983 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f8551ff3640 1 --2- 172.21.15.104:0/558732326 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f854c0b7d60 0x7f854c0b81e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f854400c690 tx=0x7f854400cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.983 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f001f1bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00100cc0f0 0x7f00100bcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.984 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7ff1a2d9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff19c037070 0x7ff19c0caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.984 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7ff1a2d9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff19c037070 0x7ff19c0caf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.104:42636/0 (socket says 172.21.15.104:42636) 2023-09-13T02:12:29.984 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7ff1a2d9d640 1 -- 172.21.15.104:0/1563530636 learned_addr learned my addr 172.21.15.104:0/1563530636 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:29.985 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f44d659c640 1 -- 172.21.15.104:0/1728778253 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44d003c7e0 msgr2=0x7f44d0041480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T02:12:29.985 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f44d659c640 1 --2- 172.21.15.104:0/1728778253 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44d003c7e0 0x7f44d0041480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.985 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f44d659c640 1 -- 172.21.15.104:0/1728778253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44d00c6960 msgr2=0x7f44d00bf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.985 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f44d659c640 1 --2- 172.21.15.104:0/1728778253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44d00c6960 0x7f44d00bf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f44d659c640 1 -- 172.21.15.104:0/1728778253 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d00d0620 con 0x7f44d003a320 2023-09-13T02:12:29.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7ff1a259c640 1 --2- 172.21.15.104:0/1563530636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff19c035820 0x7ff19c033710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7ff1a1d9b640 1 --2- 172.21.15.104:0/1563530636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff19c036c90 0x7ff19c0caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.987 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f0017fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00100c1fc0 0x7f00100ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.987 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f0017fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00100c1fc0 0x7f00100ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.104:39922/0 (socket says 172.21.15.104:39922) 2023-09-13T02:12:29.987 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f0017fff640 1 -- 172.21.15.104:0/1979961905 learned_addr learned my addr 172.21.15.104:0/1979961905 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:29.988 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f8541ffb640 1 -- 172.21.15.104:0/558732326 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8544003b70 con 0x7f854c0b7d60 2023-09-13T02:12:29.988 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f001d75a640 1 --2- 172.21.15.104:0/1979961905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00100cc0f0 0x7f00100bcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.989 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f001f1bd640 1 -- 172.21.15.104:0/1979961905 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00100bf720 con 0x7f00100cc0f0 2023-09-13T02:12:29.989 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f001f1bd640 1 -- 172.21.15.104:0/1979961905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00100c0a80 con 0x7f00100c1fc0 2023-09-13T02:12:29.989 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7ff1a259c640 1 -- 172.21.15.104:0/1563530636 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff19c037070 msgr2=0x7ff19c0caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.989 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7ff1a259c640 1 --2- 172.21.15.104:0/1563530636 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff19c037070 0x7ff19c0caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.990 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7ff1a259c640 1 -- 172.21.15.104:0/1563530636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff19c036c90 msgr2=0x7ff19c0caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.990 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7ff1a259c640 1 --2- 172.21.15.104:0/1563530636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff19c036c90 0x7ff19c0caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.990 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f8541ffb640 1 -- 172.21.15.104:0/558732326 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8544003cd0 con 0x7f854c0b7d60 2023-09-13T02:12:29.991 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f8541ffb640 1 -- 172.21.15.104:0/558732326 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8544005330 con 0x7f854c0b7d60 2023-09-13T02:12:29.991 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7fca8659c640 1 --2- 172.21.15.104:0/2278050293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca8806a7d0 0x7fca88138800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fca7800b3f0 tx=0x7fca7800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.991 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f93c3fff640 1 -- 172.21.15.104:0/2150502835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c40ae6e0 msgr2=0x7f93c413ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.992 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f001f1bd640 1 -- 172.21.15.104:0/1979961905 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00100c0d60 con 0x7f0010004ab0 2023-09-13T02:12:29.992 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f44d659c640 1 --2- 172.21.15.104:0/1728778253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44d003a320 0x7f44d01659c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f44c8001e70 tx=0x7f44c800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.993 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f001cf59640 1 --2- 172.21.15.104:0/1979961905 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0010004ab0 0x7f00100c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:29.993 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f93c3fff640 1 --2- 172.21.15.104:0/2150502835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c40ae6e0 0x7f93c413ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.994 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7ff1a259c640 1 -- 172.21.15.104:0/1563530636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1980081d0 con 0x7ff19c035820 2023-09-13T02:12:29.994 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7ff1a1d9b640 1 --2- 172.21.15.104:0/1563530636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff19c036c90 0x7ff19c0caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:29.994 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f8553a56640 1 -- 172.21.15.104:0/558732326 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854c0ba400 con 0x7f854c0b7d60 2023-09-13T02:12:29.994 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f8553a56640 1 -- 172.21.15.104:0/558732326 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854c0b91f0 con 0x7f854c0b7d60 2023-09-13T02:12:29.995 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7ff1a259c640 1 --2- 172.21.15.104:0/1563530636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff19c035820 0x7ff19c033710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4068280 tx=0x7ff1a4067370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.995 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f44c6ffd640 1 -- 172.21.15.104:0/1728778253 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8015e30 con 0x7f44d003a320 2023-09-13T02:12:29.996 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.931+0000 7f001d75a640 1 -- 172.21.15.104:0/1979961905 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0010004ab0 msgr2=0x7f00100c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.996 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.931+0000 7f001d75a640 1 --2- 172.21.15.104:0/1979961905 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0010004ab0 0x7f00100c15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.996 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.931+0000 7f001d75a640 1 -- 172.21.15.104:0/1979961905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00100c1fc0 msgr2=0x7f00100ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.996 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.931+0000 7f001d75a640 1 --2- 172.21.15.104:0/1979961905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00100c1fc0 0x7f00100ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.997 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.931+0000 7f001d75a640 1 -- 172.21.15.104:0/1979961905 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c009490 con 0x7f00100cc0f0 2023-09-13T02:12:29.997 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.931+0000 7f0017fff640 1 --2- 172.21.15.104:0/1979961905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00100c1fc0 0x7f00100ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:29.997 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.931+0000 7f001d75a640 1 --2- 172.21.15.104:0/1979961905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00100cc0f0 0x7f00100bcc40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f000400c390 tx=0x7f000400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:29.997 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.931+0000 7ff63d7fa640 1 -- 172.21.15.104:0/3011972703 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff634003b40 con 0x7ff64013b2c0 2023-09-13T02:12:29.998 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.931+0000 7ff63d7fa640 1 --2- 172.21.15.104:0/3011972703 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff62c06a5f0 0x7ff62c06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:29.998 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.931+0000 7ff63d7fa640 1 -- 172.21.15.104:0/3011972703 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff634088000 con 0x7ff64013b2c0 2023-09-13T02:12:29.998 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.931+0000 7f44c6ffd640 1 -- 172.21.15.104:0/1728778253 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f44c801d530 con 0x7f44d003a320 2023-09-13T02:12:29.998 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.931+0000 7f44c6ffd640 1 -- 172.21.15.104:0/1728778253 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c801d920 con 0x7f44d003a320 2023-09-13T02:12:29.999 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.931+0000 7f44dca32640 1 -- 172.21.15.104:0/1728778253 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d00419c0 con 0x7f44d003a320 2023-09-13T02:12:29.999 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f90baffd640 1 -- 172.21.15.104:0/3320483246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90bc1444d0 msgr2=0x7f90bc132a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:29.999 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f90baffd640 1 --2- 172.21.15.104:0/3320483246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90bc1444d0 0x7f90bc132a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:29.999 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f90baffd640 1 -- 172.21.15.104:0/3320483246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90bc0b0ae0 msgr2=0x7f90bc0b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.000 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f90baffd640 1 --2- 172.21.15.104:0/3320483246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90bc0b0ae0 0x7f90bc0b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.000 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.929+0000 7f90baffd640 1 -- 172.21.15.104:0/3320483246 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b4009840 con 0x7f90bc13a500 2023-09-13T02:12:30.000 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f90baffd640 1 --2- 172.21.15.104:0/3320483246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90bc13a500 0x7f90bc06dd30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00c490 tx=0x7f90ac00c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:30.000 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f90a3fff640 1 -- 172.21.15.104:0/3320483246 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac013c40 con 0x7f90bc13a500 2023-09-13T02:12:30.000 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f90a3fff640 1 -- 172.21.15.104:0/3320483246 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f90ac013e90 con 0x7f90bc13a500 2023-09-13T02:12:30.001 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f90a3fff640 1 -- 172.21.15.104:0/3320483246 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac01c660 con 0x7f90bc13a500 2023-09-13T02:12:30.001 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f90c1c26640 1 -- 172.21.15.104:0/3320483246 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90bc06fb00 con 0x7f90bc13a500 2023-09-13T02:12:30.001 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f90c1c26640 1 -- 172.21.15.104:0/3320483246 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90bc139ba0 con 0x7f90bc13a500 2023-09-13T02:12:30.001 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.932+0000 7ff192ffd640 1 -- 172.21.15.104:0/1563530636 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40666b0 con 0x7ff19c035820 2023-09-13T02:12:30.002 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.932+0000 7ff192ffd640 1 -- 172.21.15.104:0/1563530636 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff1a4066810 con 0x7ff19c035820 2023-09-13T02:12:30.002 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f93c3fff640 1 -- 172.21.15.104:0/2150502835 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93c406b5e0 msgr2=0x7f93c406d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.002 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f93c3fff640 1 --2- 172.21.15.104:0/2150502835 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93c406b5e0 0x7f93c406d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f93c3fff640 1 -- 172.21.15.104:0/2150502835 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b4013b90 con 0x7f93c40af700 2023-09-13T02:12:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f93c37fe640 1 --2- 172.21.15.104:0/2150502835 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93c406b5e0 0x7f93c406d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T02:12:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f93c3fff640 1 --2- 172.21.15.104:0/2150502835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c40af700 0x7f93c413d3d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f93b403b000 tx=0x7f93b403dc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.930+0000 7f93abfff640 1 -- 172.21.15.104:0/2150502835 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b403de40 con 0x7f93c40af700 2023-09-13T02:12:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.931+0000 7f93abfff640 1 -- 172.21.15.104:0/2150502835 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f93b4005110 con 0x7f93c40af700 2023-09-13T02:12:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.932+0000 7f93ca094640 1 -- 172.21.15.104:0/2150502835 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c4070260 con 0x7f93c40af700 2023-09-13T02:12:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.932+0000 7f93ca094640 1 -- 172.21.15.104:0/2150502835 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c406ed30 con 0x7f93c40af700 2023-09-13T02:12:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.932+0000 7f93abfff640 1 -- 172.21.15.104:0/2150502835 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4005500 con 0x7f93c40af700 2023-09-13T02:12:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.932+0000 7ff192ffd640 1 -- 172.21.15.104:0/1563530636 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40666b0 con 0x7ff19c035820 2023-09-13T02:12:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.932+0000 7ff1a359e640 1 -- 172.21.15.104:0/1563530636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19c0c9810 con 0x7ff19c035820 2023-09-13T02:12:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.932+0000 7ff1a359e640 1 -- 172.21.15.104:0/1563530636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c0cc6f0 con 0x7ff19c035820 2023-09-13T02:12:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.932+0000 7fca76ffd640 1 -- 172.21.15.104:0/2278050293 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78011830 con 0x7fca8806a7d0 2023-09-13T02:12:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.932+0000 7fca76ffd640 1 -- 172.21.15.104:0/2278050293 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fca78011a80 con 0x7fca8806a7d0 2023-09-13T02:12:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.933+0000 7fca76ffd640 1 -- 172.21.15.104:0/2278050293 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78011e90 con 0x7fca8806a7d0 2023-09-13T02:12:30.006 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.932+0000 7ff64717c640 1 -- 172.21.15.104:0/3011972703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff620005250 con 0x7ff64013b2c0 2023-09-13T02:12:30.006 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.932+0000 7f44dca32640 1 -- 172.21.15.104:0/1728778253 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d00cdde0 con 0x7f44d003a320 2023-09-13T02:12:30.007 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.933+0000 7f93ca094640 1 -- 172.21.15.104:0/2150502835 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c406efb0 con 0x7f93c40af700 2023-09-13T02:12:30.007 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.933+0000 7f44c6ffd640 1 -- 172.21.15.104:0/1728778253 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f44c80263b0 con 0x7f44d003a320 2023-09-13T02:12:30.008 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.933+0000 7fca8759e640 1 -- 172.21.15.104:0/2278050293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8813ea90 con 0x7fca8806a7d0 2023-09-13T02:12:30.008 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.933+0000 7fca8759e640 1 -- 172.21.15.104:0/2278050293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca881441e0 con 0x7fca8806a7d0 2023-09-13T02:12:30.008 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.933+0000 7ff1a359e640 1 -- 172.21.15.104:0/1563530636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff188005250 con 0x7ff19c035820 2023-09-13T02:12:30.009 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.933+0000 7f8553a56640 1 -- 172.21.15.104:0/558732326 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854c0b9050 con 0x7f854c0b7d60 2023-09-13T02:12:30.009 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.933+0000 7f8541ffb640 1 -- 172.21.15.104:0/558732326 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f8544005490 con 0x7f854c0b7d60 2023-09-13T02:12:30.010 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.934+0000 7f90c1c26640 1 -- 172.21.15.104:0/3320483246 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909c005250 con 0x7f90bc13a500 2023-09-13T02:12:30.010 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.934+0000 7f44c6ffd640 1 --2- 172.21.15.104:0/1728778253 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f44b806a520 0x7f44b806c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:30.010 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.934+0000 7f44dca32640 1 -- 172.21.15.104:0/1728778253 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d0041b50 con 0x7f44d003a320 2023-09-13T02:12:30.011 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.934+0000 7f44c6ffd640 1 -- 172.21.15.104:0/1728778253 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44c80909a0 con 0x7f44d003a320 2023-09-13T02:12:30.011 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.934+0000 7f00157fa640 1 -- 172.21.15.104:0/1979961905 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00040035f0 con 0x7f00100cc0f0 2023-09-13T02:12:30.011 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.934+0000 7f00157fa640 1 -- 172.21.15.104:0/1979961905 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0004003750 con 0x7f00100cc0f0 2023-09-13T02:12:30.011 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.934+0000 7f00157fa640 1 -- 172.21.15.104:0/1979961905 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004003b40 con 0x7f00100cc0f0 2023-09-13T02:12:30.012 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.934+0000 7f001f1bd640 1 -- 172.21.15.104:0/1979961905 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00100c9cd0 con 0x7f00100cc0f0 2023-09-13T02:12:30.012 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.934+0000 7ff192ffd640 1 -- 172.21.15.104:0/1563530636 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff1a4091430 con 0x7ff19c035820 2023-09-13T02:12:30.012 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.934+0000 7f001f1bd640 1 -- 172.21.15.104:0/1979961905 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00100c07a0 con 0x7f00100cc0f0 2023-09-13T02:12:30.013 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.934+0000 7f90a3fff640 1 -- 172.21.15.104:0/3320483246 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f90ac0130b0 con 0x7f90bc13a500 2023-09-13T02:12:30.013 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.934+0000 7f8541ffb640 1 --2- 172.21.15.104:0/558732326 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f853006a5c0 0x7f853006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:30.014 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.935+0000 7f90a3fff640 1 --2- 172.21.15.104:0/3320483246 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f90a8072e00 0x7f90a80752c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:30.014 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.934+0000 7f8541ffb640 1 -- 172.21.15.104:0/558732326 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8544088800 con 0x7f854c0b7d60 2023-09-13T02:12:30.014 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.935+0000 7fca8759e640 1 -- 172.21.15.104:0/2278050293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca88138f00 con 0x7fca8806a7d0 2023-09-13T02:12:30.015 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.934+0000 7ff644f18640 1 --2- 172.21.15.104:0/3011972703 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff62c06a5f0 0x7ff62c06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:30.015 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.935+0000 7f90a3fff640 1 -- 172.21.15.104:0/3320483246 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90ac0881b0 con 0x7f90bc13a500 2023-09-13T02:12:30.016 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.935+0000 7ff192ffd640 1 --2- 172.21.15.104:0/1563530636 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff18406a5b0 0x7ff18406ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:30.016 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.935+0000 7ff192ffd640 1 -- 172.21.15.104:0/1563530636 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1a4100500 con 0x7ff19c035820 2023-09-13T02:12:30.016 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.935+0000 7f44d5d9b640 1 --2- 172.21.15.104:0/1728778253 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f44b806a520 0x7f44b806c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:30.017 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.935+0000 7fca76ffd640 1 -- 172.21.15.104:0/2278050293 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fca7801a400 con 0x7fca8806a7d0 2023-09-13T02:12:30.017 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.936+0000 7f001f1bd640 1 -- 172.21.15.104:0/1979961905 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0010005790 con 0x7f00100cc0f0 2023-09-13T02:12:30.017 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.936+0000 7f44d5d9b640 1 --2- 172.21.15.104:0/1728778253 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f44b806a520 0x7f44b806c9e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f44d00c7800 tx=0x7f44cc0078a0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:30.018 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.936+0000 7f90bb7fe640 1 --2- 172.21.15.104:0/3320483246 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f90a8072e00 0x7f90a80752c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:30.018 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.936+0000 7f85517f2640 1 --2- 172.21.15.104:0/558732326 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f853006a5c0 0x7f853006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:30.019 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.936+0000 7f93abfff640 1 -- 172.21.15.104:0/2150502835 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f93b4003800 con 0x7f93c40af700 2023-09-13T02:12:30.019 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.936+0000 7ff1a1d9b640 1 --2- 172.21.15.104:0/1563530636 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff18406a5b0 0x7ff18406ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:30.020 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.936+0000 7fca76ffd640 1 --2- 172.21.15.104:0/2278050293 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fca6806a570 0x7fca6806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:30.020 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.936+0000 7fca76ffd640 1 -- 172.21.15.104:0/2278050293 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca78088cf0 con 0x7fca8806a7d0 2023-09-13T02:12:30.020 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.936+0000 7fca85d9b640 1 --2- 172.21.15.104:0/2278050293 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fca6806a570 0x7fca6806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:30.021 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.936+0000 7f93abfff640 1 --2- 172.21.15.104:0/2150502835 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f93b006a570 0x7f93b006ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:30.021 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.936+0000 7f90bb7fe640 1 --2- 172.21.15.104:0/3320483246 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f90a8072e00 0x7f90a80752c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f90b000bbe0 tx=0x7f90b000b390 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:30.021 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.936+0000 7f93abfff640 1 -- 172.21.15.104:0/2150502835 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93b40b3c40 con 0x7f93c40af700 2023-09-13T02:12:30.022 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.937+0000 7f93c37fe640 1 --2- 172.21.15.104:0/2150502835 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f93b006a570 0x7f93b006ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:30.022 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.937+0000 7f85517f2640 1 --2- 172.21.15.104:0/558732326 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f853006a5c0 0x7f853006ca80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f854c0b7ad0 tx=0x7f853c004730 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:30.022 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.937+0000 7fca85d9b640 1 --2- 172.21.15.104:0/2278050293 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fca6806a570 0x7fca6806ca30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca88141ec0 tx=0x7fca8000d040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:30.023 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.937+0000 7ff644f18640 1 --2- 172.21.15.104:0/3011972703 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff62c06a5f0 0x7ff62c06cab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff638036000 tx=0x7ff638004a40 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:30.023 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.937+0000 7f93c37fe640 1 --2- 172.21.15.104:0/2150502835 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f93b006a570 0x7f93b006ca30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f93b80046b0 tx=0x7f93b8007eb0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.937+0000 7ff1a1d9b640 1 --2- 172.21.15.104:0/1563530636 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff18406a5b0 0x7ff18406ca70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff19400b3c0 tx=0x7ff19400d040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.938+0000 7f8541ffb640 1 -- 172.21.15.104:0/558732326 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f854c0b9050 con 0x7f854c0b7d60 2023-09-13T02:12:30.025 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.940+0000 7ff63d7fa640 1 -- 172.21.15.104:0/3011972703 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff6340536a0 con 0x7ff64013b2c0 2023-09-13T02:12:30.025 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.941+0000 7fca76ffd640 1 -- 172.21.15.104:0/2278050293 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fca88138f00 con 0x7fca8806a7d0 2023-09-13T02:12:30.026 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.941+0000 7f00157fa640 1 -- 172.21.15.104:0/1979961905 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f0004003ca0 con 0x7f00100cc0f0 2023-09-13T02:12:30.026 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.942+0000 7f00157fa640 1 --2- 172.21.15.104:0/1979961905 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7efffc06a570 0x7efffc06ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:30.026 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.942+0000 7f001cf59640 1 --2- 172.21.15.104:0/1979961905 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7efffc06a570 0x7efffc06ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:30.026 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.942+0000 7f001cf59640 1 --2- 172.21.15.104:0/1979961905 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7efffc06a570 0x7efffc06ca30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f000c036000 tx=0x7f000c004730 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:30.027 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.943+0000 7f90a3fff640 1 -- 172.21.15.104:0/3320483246 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f90ac0537a0 con 0x7f90bc13a500 2023-09-13T02:12:30.027 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.945+0000 7f44c6ffd640 1 -- 172.21.15.104:0/1728778253 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f44c805bfc0 con 0x7f44d003a320 2023-09-13T02:12:30.027 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.947+0000 7f93abfff640 1 -- 172.21.15.104:0/2150502835 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f93b407f300 con 0x7f93c40af700 2023-09-13T02:12:30.028 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.950+0000 7f00157fa640 1 -- 172.21.15.104:0/1979961905 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0004057b70 con 0x7f00100cc0f0 2023-09-13T02:12:30.028 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.951+0000 7ff192ffd640 1 -- 172.21.15.104:0/1563530636 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff1a40cba50 con 0x7ff19c035820 2023-09-13T02:12:30.029 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:29.958+0000 7f00157fa640 1 -- 172.21.15.104:0/1979961905 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0004053eb0 con 0x7f00100cc0f0 2023-09-13T02:12:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.340+0000 7f8553a56640 1 -- 172.21.15.104:0/558732326 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f854c0b9050 con 0x7f854c0b7d60 2023-09-13T02:12:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.341+0000 7f8541ffb640 1 -- 172.21.15.104:0/558732326 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f854c0b9050 con 0x7f854c0b7d60 2023-09-13T02:12:30.342 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2023-09-13T02:12:30.343 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.341+0000 7f44dca32640 1 -- 172.21.15.104:0/1728778253 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f44d00cdde0 con 0x7f44d003a320 2023-09-13T02:12:30.343 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.341+0000 7ff64717c640 1 -- 172.21.15.104:0/3011972703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff620005500 con 0x7ff64013b2c0 2023-09-13T02:12:30.344 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.342+0000 7ff63d7fa640 1 -- 172.21.15.104:0/3011972703 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff634017030 con 0x7ff64013b2c0 2023-09-13T02:12:30.344 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.342+0000 7f44c6ffd640 1 -- 172.21.15.104:0/1728778253 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44d00cdde0 con 0x7f44d003a320 2023-09-13T02:12:30.345 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.342+0000 7fca8759e640 1 -- 172.21.15.104:0/2278050293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fca88138f00 con 0x7fca8806a7d0 2023-09-13T02:12:30.345 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2023-09-13T02:12:30.345 INFO:teuthology.orchestra.run.smithi104.stdout:55834574853 2023-09-13T02:12:30.346 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.342+0000 7fca76ffd640 1 -- 172.21.15.104:0/2278050293 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fca88138f00 con 0x7fca8806a7d0 2023-09-13T02:12:30.346 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2023-09-13T02:12:30.348 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.344+0000 7f8553a56640 1 -- 172.21.15.104:0/558732326 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f853006a5c0 msgr2=0x7f853006ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.348 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.344+0000 7f8553a56640 1 --2- 172.21.15.104:0/558732326 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f853006a5c0 0x7f853006ca80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f854c0b7ad0 tx=0x7f853c004730 comp rx=0 tx=0).stop 2023-09-13T02:12:30.348 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f8553a56640 1 -- 172.21.15.104:0/558732326 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f854c0b7d60 msgr2=0x7f854c0b81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.348 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f8553a56640 1 --2- 172.21.15.104:0/558732326 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f854c0b7d60 0x7f854c0b81e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f854400c690 tx=0x7f854400cb50 comp rx=0 tx=0).stop 2023-09-13T02:12:30.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f8553a56640 1 -- 172.21.15.104:0/558732326 shutdown_connections 2023-09-13T02:12:30.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f8553a56640 1 --2- 172.21.15.104:0/558732326 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f853006a5c0 0x7f853006ca80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f8553a56640 1 --2- 172.21.15.104:0/558732326 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f854c0b7d60 0x7f854c0b81e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f8553a56640 1 --2- 172.21.15.104:0/558732326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f854c147b90 0x7f854c0b9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f8553a56640 1 --2- 172.21.15.104:0/558732326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f854c0b5ba0 0x7f854c13bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.350 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f8553a56640 1 -- 172.21.15.104:0/558732326 >> 172.21.15.104:0/558732326 conn(0x7f854c0708b0 msgr2=0x7f854c13e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:30.350 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f8553a56640 1 -- 172.21.15.104:0/558732326 shutdown_connections 2023-09-13T02:12:30.350 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f8553a56640 1 -- 172.21.15.104:0/558732326 wait complete. 2023-09-13T02:12:30.350 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f44c4ff9640 1 -- 172.21.15.104:0/1728778253 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f44b806a520 msgr2=0x7f44b806c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.351 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f90c1c26640 1 -- 172.21.15.104:0/3320483246 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f909c0050c0 con 0x7f90bc13a500 2023-09-13T02:12:30.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f44c4ff9640 1 --2- 172.21.15.104:0/1728778253 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f44b806a520 0x7f44b806c9e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f44d00c7800 tx=0x7f44cc0078a0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f44c4ff9640 1 -- 172.21.15.104:0/1728778253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44d003a320 msgr2=0x7f44d01659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f44c4ff9640 1 --2- 172.21.15.104:0/1728778253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44d003a320 0x7f44d01659c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f44c8001e70 tx=0x7f44c800c960 comp rx=0 tx=0).stop 2023-09-13T02:12:30.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f44c4ff9640 1 -- 172.21.15.104:0/1728778253 shutdown_connections 2023-09-13T02:12:30.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f44c4ff9640 1 --2- 172.21.15.104:0/1728778253 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f44b806a520 0x7f44b806c9e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7f44c4ff9640 1 --2- 172.21.15.104:0/1728778253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44d00c6960 0x7f44d00bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.346+0000 7f44c4ff9640 1 --2- 172.21.15.104:0/1728778253 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44d003c7e0 0x7f44d0041480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.346+0000 7f44c4ff9640 1 --2- 172.21.15.104:0/1728778253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44d003a320 0x7f44d01659c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.354 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7ff64717c640 1 -- 172.21.15.104:0/3011972703 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff62c06a5f0 msgr2=0x7ff62c06cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.354 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7ff64717c640 1 --2- 172.21.15.104:0/3011972703 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff62c06a5f0 0x7ff62c06cab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff638036000 tx=0x7ff638004a40 comp rx=0 tx=0).stop 2023-09-13T02:12:30.354 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7ff64717c640 1 -- 172.21.15.104:0/3011972703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff64013b2c0 msgr2=0x7ff64012d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.354 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.345+0000 7ff64717c640 1 --2- 172.21.15.104:0/3011972703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff64013b2c0 0x7ff64012d9e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff63400c3c0 tx=0x7ff63400c880 comp rx=0 tx=0).stop 2023-09-13T02:12:30.355 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.346+0000 7f44c4ff9640 1 -- 172.21.15.104:0/1728778253 >> 172.21.15.104:0/1728778253 conn(0x7f44d003eac0 msgr2=0x7f44d003eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:30.355 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.346+0000 7ff64717c640 1 -- 172.21.15.104:0/3011972703 shutdown_connections 2023-09-13T02:12:30.356 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.346+0000 7ff64717c640 1 --2- 172.21.15.104:0/3011972703 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff62c06a5f0 0x7ff62c06cab0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.356 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.346+0000 7ff64717c640 1 --2- 172.21.15.104:0/3011972703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff64013b2c0 0x7ff64012d9e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.356 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.346+0000 7ff64717c640 1 --2- 172.21.15.104:0/3011972703 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6400afaf0 0x7ff640143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.356 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.346+0000 7ff64717c640 1 --2- 172.21.15.104:0/3011972703 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6400ae730 0x7ff64013cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.357 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.346+0000 7ff64717c640 1 -- 172.21.15.104:0/3011972703 >> 172.21.15.104:0/3011972703 conn(0x7ff6400b6860 msgr2=0x7ff64013a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:30.357 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.346+0000 7ff64717c640 1 -- 172.21.15.104:0/3011972703 shutdown_connections 2023-09-13T02:12:30.357 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.346+0000 7f44c4ff9640 1 -- 172.21.15.104:0/1728778253 shutdown_connections 2023-09-13T02:12:30.357 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.346+0000 7f44c4ff9640 1 -- 172.21.15.104:0/1728778253 wait complete. 2023-09-13T02:12:30.358 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.346+0000 7ff64717c640 1 -- 172.21.15.104:0/3011972703 wait complete. 2023-09-13T02:12:30.358 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.346+0000 7f90a3fff640 1 -- 172.21.15.104:0/3320483246 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f90ac056dc0 con 0x7f90bc13a500 2023-09-13T02:12:30.359 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2023-09-13T02:12:30.360 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.347+0000 7fca8759e640 1 -- 172.21.15.104:0/2278050293 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fca6806a570 msgr2=0x7fca6806ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.360 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.347+0000 7fca8759e640 1 --2- 172.21.15.104:0/2278050293 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fca6806a570 0x7fca6806ca30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca88141ec0 tx=0x7fca8000d040 comp rx=0 tx=0).stop 2023-09-13T02:12:30.361 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.347+0000 7fca8759e640 1 -- 172.21.15.104:0/2278050293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca8806a7d0 msgr2=0x7fca88138800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.361 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.347+0000 7fca8759e640 1 --2- 172.21.15.104:0/2278050293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca8806a7d0 0x7fca88138800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fca7800b3f0 tx=0x7fca7800b8b0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.361 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.347+0000 7fca8759e640 1 -- 172.21.15.104:0/2278050293 shutdown_connections 2023-09-13T02:12:30.361 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.347+0000 7fca8759e640 1 --2- 172.21.15.104:0/2278050293 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fca6806a570 0x7fca6806ca30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.361 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.347+0000 7fca8759e640 1 --2- 172.21.15.104:0/2278050293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca88070820 0x7fca881d92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.362 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.347+0000 7fca8759e640 1 --2- 172.21.15.104:0/2278050293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca8806be50 0x7fca88144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.362 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.347+0000 7fca8759e640 1 --2- 172.21.15.104:0/2278050293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca8806a7d0 0x7fca88138800 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.362 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.347+0000 7fca8759e640 1 -- 172.21.15.104:0/2278050293 >> 172.21.15.104:0/2278050293 conn(0x7fca88069b50 msgr2=0x7fca8813c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:30.362 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.348+0000 7fca8759e640 1 -- 172.21.15.104:0/2278050293 shutdown_connections 2023-09-13T02:12:30.363 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.348+0000 7f93ca094640 1 -- 172.21.15.104:0/2150502835 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f93c40700c0 con 0x7f93c40af700 2023-09-13T02:12:30.363 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.348+0000 7fca8759e640 1 -- 172.21.15.104:0/2278050293 wait complete. 2023-09-13T02:12:30.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.348+0000 7f93abfff640 1 -- 172.21.15.104:0/2150502835 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93c40700c0 con 0x7f93c40af700 2023-09-13T02:12:30.364 INFO:teuthology.orchestra.run.smithi104.stdout:55834574853 2023-09-13T02:12:30.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.350+0000 7f90c1c26640 1 -- 172.21.15.104:0/3320483246 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f90a8072e00 msgr2=0x7f90a80752c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.350+0000 7f90c1c26640 1 --2- 172.21.15.104:0/3320483246 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f90a8072e00 0x7f90a80752c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f90b000bbe0 tx=0x7f90b000b390 comp rx=0 tx=0).stop 2023-09-13T02:12:30.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.350+0000 7f90c1c26640 1 -- 172.21.15.104:0/3320483246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90bc13a500 msgr2=0x7f90bc06dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.350+0000 7f90c1c26640 1 --2- 172.21.15.104:0/3320483246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90bc13a500 0x7f90bc06dd30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00c490 tx=0x7f90ac00c950 comp rx=0 tx=0).stop 2023-09-13T02:12:30.366 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.350+0000 7f90c1c26640 1 -- 172.21.15.104:0/3320483246 shutdown_connections 2023-09-13T02:12:30.366 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.350+0000 7f90c1c26640 1 --2- 172.21.15.104:0/3320483246 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f90a8072e00 0x7f90a80752c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.366 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.350+0000 7f90c1c26640 1 --2- 172.21.15.104:0/3320483246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90bc1444d0 0x7f90bc132a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.366 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.350+0000 7f90c1c26640 1 --2- 172.21.15.104:0/3320483246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90bc13a500 0x7f90bc06dd30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.366 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.350+0000 7f90c1c26640 1 --2- 172.21.15.104:0/3320483246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90bc0b0ae0 0x7f90bc0b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.367 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.350+0000 7f90c1c26640 1 -- 172.21.15.104:0/3320483246 >> 172.21.15.104:0/3320483246 conn(0x7f90bc0b56f0 msgr2=0x7f90bc0653e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:30.367 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.351+0000 7f90c1c26640 1 -- 172.21.15.104:0/3320483246 shutdown_connections 2023-09-13T02:12:30.367 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.351+0000 7f90c1c26640 1 -- 172.21.15.104:0/3320483246 wait complete. 2023-09-13T02:12:30.368 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.352+0000 7f93ca094640 1 -- 172.21.15.104:0/2150502835 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f93b006a570 msgr2=0x7f93b006ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.368 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.352+0000 7f93ca094640 1 --2- 172.21.15.104:0/2150502835 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f93b006a570 0x7f93b006ca30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f93b80046b0 tx=0x7f93b8007eb0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.368 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.352+0000 7f93ca094640 1 -- 172.21.15.104:0/2150502835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c40af700 msgr2=0x7f93c413d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.368 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.352+0000 7f93ca094640 1 --2- 172.21.15.104:0/2150502835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c40af700 0x7f93c413d3d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f93b403b000 tx=0x7f93b403dc50 comp rx=0 tx=0).stop 2023-09-13T02:12:30.368 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.352+0000 7f93ca094640 1 -- 172.21.15.104:0/2150502835 shutdown_connections 2023-09-13T02:12:30.369 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.352+0000 7f93ca094640 1 --2- 172.21.15.104:0/2150502835 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f93b006a570 0x7f93b006ca30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.369 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.352+0000 7f93ca094640 1 --2- 172.21.15.104:0/2150502835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c40af700 0x7f93c413d3d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.369 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.352+0000 7f93ca094640 1 --2- 172.21.15.104:0/2150502835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c40ae6e0 0x7f93c413ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.369 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.353+0000 7f93ca094640 1 --2- 172.21.15.104:0/2150502835 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93c406b5e0 0x7f93c406d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.369 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.353+0000 7f93ca094640 1 -- 172.21.15.104:0/2150502835 >> 172.21.15.104:0/2150502835 conn(0x7f93c40b54d0 msgr2=0x7f93c413e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:30.370 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.353+0000 7f93ca094640 1 -- 172.21.15.104:0/2150502835 shutdown_connections 2023-09-13T02:12:30.370 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.353+0000 7f93ca094640 1 -- 172.21.15.104:0/2150502835 wait complete. 2023-09-13T02:12:30.370 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.353+0000 7ff1a359e640 1 -- 172.21.15.104:0/1563530636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff1880050c0 con 0x7ff19c035820 2023-09-13T02:12:30.371 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.353+0000 7ff192ffd640 1 -- 172.21.15.104:0/1563530636 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff1a40cf070 con 0x7ff19c035820 2023-09-13T02:12:30.371 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2023-09-13T02:12:30.372 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.357+0000 7ff190ff9640 1 -- 172.21.15.104:0/1563530636 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff18406a5b0 msgr2=0x7ff18406ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.373 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.357+0000 7ff190ff9640 1 --2- 172.21.15.104:0/1563530636 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff18406a5b0 0x7ff18406ca70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff19400b3c0 tx=0x7ff19400d040 comp rx=0 tx=0).stop 2023-09-13T02:12:30.373 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.357+0000 7ff190ff9640 1 -- 172.21.15.104:0/1563530636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff19c035820 msgr2=0x7ff19c033710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.373 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.358+0000 7ff190ff9640 1 --2- 172.21.15.104:0/1563530636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff19c035820 0x7ff19c033710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4068280 tx=0x7ff1a4067370 comp rx=0 tx=0).stop 2023-09-13T02:12:30.373 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.358+0000 7ff190ff9640 1 -- 172.21.15.104:0/1563530636 shutdown_connections 2023-09-13T02:12:30.374 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.358+0000 7ff190ff9640 1 --2- 172.21.15.104:0/1563530636 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff18406a5b0 0x7ff18406ca70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.374 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.358+0000 7ff190ff9640 1 --2- 172.21.15.104:0/1563530636 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff19c037070 0x7ff19c0caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.374 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.358+0000 7ff190ff9640 1 --2- 172.21.15.104:0/1563530636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff19c036c90 0x7ff19c0caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.374 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.358+0000 7ff190ff9640 1 --2- 172.21.15.104:0/1563530636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff19c035820 0x7ff19c033710 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.374 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.358+0000 7ff190ff9640 1 -- 172.21.15.104:0/1563530636 >> 172.21.15.104:0/1563530636 conn(0x7ff19c03a9f0 msgr2=0x7ff19c0056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:30.375 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.358+0000 7ff190ff9640 1 -- 172.21.15.104:0/1563530636 shutdown_connections 2023-09-13T02:12:30.375 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.359+0000 7ff190ff9640 1 -- 172.21.15.104:0/1563530636 wait complete. 2023-09-13T02:12:30.375 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.360+0000 7f001f1bd640 1 -- 172.21.15.104:0/1979961905 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f00100c1b30 con 0x7f00100cc0f0 2023-09-13T02:12:30.376 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.360+0000 7f00157fa640 1 -- 172.21.15.104:0/1979961905 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0004021020 con 0x7f00100cc0f0 2023-09-13T02:12:30.376 INFO:teuthology.orchestra.run.smithi104.stdout:55834574852 2023-09-13T02:12:30.377 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.364+0000 7f001f1bd640 1 -- 172.21.15.104:0/1979961905 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7efffc06a570 msgr2=0x7efffc06ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.378 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.364+0000 7f001f1bd640 1 --2- 172.21.15.104:0/1979961905 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7efffc06a570 0x7efffc06ca30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f000c036000 tx=0x7f000c004730 comp rx=0 tx=0).stop 2023-09-13T02:12:30.378 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.364+0000 7f001f1bd640 1 -- 172.21.15.104:0/1979961905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00100cc0f0 msgr2=0x7f00100bcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:30.378 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.364+0000 7f001f1bd640 1 --2- 172.21.15.104:0/1979961905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00100cc0f0 0x7f00100bcc40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f000400c390 tx=0x7f000400c850 comp rx=0 tx=0).stop 2023-09-13T02:12:30.378 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.365+0000 7f001f1bd640 1 -- 172.21.15.104:0/1979961905 shutdown_connections 2023-09-13T02:12:30.378 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.365+0000 7f001f1bd640 1 --2- 172.21.15.104:0/1979961905 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7efffc06a570 0x7efffc06ca30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.379 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.365+0000 7f001f1bd640 1 --2- 172.21.15.104:0/1979961905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00100cc0f0 0x7f00100bcc40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.379 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.365+0000 7f001f1bd640 1 --2- 172.21.15.104:0/1979961905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00100c1fc0 0x7f00100ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.379 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.365+0000 7f001f1bd640 1 --2- 172.21.15.104:0/1979961905 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0010004ab0 0x7f00100c15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:30.379 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.365+0000 7f001f1bd640 1 -- 172.21.15.104:0/1979961905 >> 172.21.15.104:0/1979961905 conn(0x7f001003ad30 msgr2=0x7f0010038ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:30.379 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.365+0000 7f001f1bd640 1 -- 172.21.15.104:0/1979961905 shutdown_connections 2023-09-13T02:12:30.380 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:30.365+0000 7f001f1bd640 1 -- 172.21.15.104:0/1979961905 wait complete. 2023-09-13T02:12:30.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-09-13T02:12:30.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-09-13T02:12:30.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-09-13T02:12:30.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-09-13T02:12:30.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-09-13T02:12:30.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-09-13T02:12:30.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-09-13T02:12:30.387 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-09-13T02:12:31.381 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-13T02:12:31.382 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-13T02:12:31.383 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-13T02:12:31.384 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-13T02:12:31.384 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-13T02:12:31.386 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-13T02:12:31.387 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-13T02:12:31.388 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-13T02:12:31.537 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.536+0000 7f7ab27fc640 1 -- 172.21.15.104:0/3704135242 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8006270 con 0x7f7a9c0039d0 2023-09-13T02:12:31.538 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.536+0000 7f7ab9bb0640 1 -- 172.21.15.104:0/3704135242 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a9c0039d0 msgr2=0x7f7a9c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.538 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.536+0000 7f7ab9bb0640 1 --2- 172.21.15.104:0/3704135242 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a9c0039d0 0x7f7a9c003e10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8006c70 tx=0x7f7a9c0057f0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.538 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.536+0000 7f7ab3fff640 1 -- 172.21.15.104:0/3704135242 reap_dead start 2023-09-13T02:12:31.539 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.536+0000 7f7ab9bb0640 1 -- 172.21.15.104:0/3704135242 shutdown_connections 2023-09-13T02:12:31.539 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.536+0000 7f7ab9bb0640 1 -- 172.21.15.104:0/3704135242 >> 172.21.15.104:0/3704135242 conn(0x7f7ab40b3350 msgr2=0x7f7ab40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:31.539 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.537+0000 7f7ab9bb0640 1 -- 172.21.15.104:0/3704135242 shutdown_connections 2023-09-13T02:12:31.539 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.537+0000 7f7ab9bb0640 1 -- 172.21.15.104:0/3704135242 wait complete. 2023-09-13T02:12:31.540 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.539+0000 7f9d92c75640 1 -- 172.21.15.104:0/3111701715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d8c0afe20 msgr2=0x7f9d8c0b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.540 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.539+0000 7f9d92c75640 1 --2- 172.21.15.104:0/3111701715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d8c0afe20 0x7f9d8c0b02b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0b5ee0 tx=0x7f9d8802dfa0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.540 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.539+0000 7f9d92c75640 1 -- 172.21.15.104:0/3111701715 shutdown_connections 2023-09-13T02:12:31.541 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.539+0000 7f9d92c75640 1 --2- 172.21.15.104:0/3111701715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d8c0afe20 0x7f9d8c0b02b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.541 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.539+0000 7f9d92c75640 1 --2- 172.21.15.104:0/3111701715 >> v2:172.21.15.119:3300/0 conn(0x7f9d8c071720 0x7f9d8c154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.541 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.539+0000 7f9d92c75640 1 --2- 172.21.15.104:0/3111701715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d8c071340 0x7f9d8c1547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.541 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.539+0000 7f9d92c75640 1 -- 172.21.15.104:0/3111701715 >> 172.21.15.104:0/3111701715 conn(0x7f9d8c069970 msgr2=0x7f9d8c0b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:31.542 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.538+0000 7f7ab9bb0640 1 Processor -- start 2023-09-13T02:12:31.542 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.538+0000 7f7ab9bb0640 1 -- start start 2023-09-13T02:12:31.543 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.539+0000 7f9d92c75640 1 -- 172.21.15.104:0/3111701715 shutdown_connections 2023-09-13T02:12:31.543 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.539+0000 7f9d92c75640 1 -- 172.21.15.104:0/3111701715 wait complete. 2023-09-13T02:12:31.544 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.539+0000 7f7ab9bb0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a9c0039d0 0x7f7ab41d97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.544 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.539+0000 7f7ab9bb0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ab4070350 0x7f7ab41d6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.545 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.539+0000 7f7ab9bb0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ab41d6750 0x7f7ab4138a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.545 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.539+0000 7f7ab9bb0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4070ef0 con 0x7f7ab4070350 2023-09-13T02:12:31.545 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.539+0000 7f7ab9bb0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40707d0 con 0x7f7a9c0039d0 2023-09-13T02:12:31.545 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.539+0000 7f7ab9bb0640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab413ee00 con 0x7f7ab41d6750 2023-09-13T02:12:31.546 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.540+0000 7f7ab3fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ab41d6750 0x7f7ab4138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.546 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.540+0000 7f7ab3fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ab41d6750 0x7f7ab4138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.104:42678/0 (socket says 172.21.15.104:42678) 2023-09-13T02:12:31.546 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.540+0000 7f7ab3fff640 1 -- 172.21.15.104:0/3618066429 learned_addr learned my addr 172.21.15.104:0/3618066429 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:31.546 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.540+0000 7f7ab37fe640 1 --2- 172.21.15.104:0/3618066429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a9c0039d0 0x7f7ab41d97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.547 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.540+0000 7f7ab3fff640 1 -- 172.21.15.104:0/3618066429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a9c0039d0 msgr2=0x7f7ab41d97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.547 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.540+0000 7f7ab3fff640 1 --2- 172.21.15.104:0/3618066429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a9c0039d0 0x7f7ab41d97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.547 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.540+0000 7f7ab3fff640 1 -- 172.21.15.104:0/3618066429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ab4070350 msgr2=0x7f7ab41d6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.547 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.540+0000 7f7ab2ffd640 1 --2- 172.21.15.104:0/3618066429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ab4070350 0x7f7ab41d6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.547 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.541+0000 7f7ab3fff640 1 --2- 172.21.15.104:0/3618066429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ab4070350 0x7f7ab41d6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.547 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.541+0000 7f7ab3fff640 1 -- 172.21.15.104:0/3618066429 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab41d6bd0 con 0x7f7ab41d6750 2023-09-13T02:12:31.548 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.541+0000 7f9d92c75640 1 Processor -- start 2023-09-13T02:12:31.548 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.541+0000 7f9d92c75640 1 -- start start 2023-09-13T02:12:31.549 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.541+0000 7f7ab2ffd640 1 --2- 172.21.15.104:0/3618066429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ab4070350 0x7f7ab41d6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:12:31.549 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.541+0000 7f7ab3fff640 1 --2- 172.21.15.104:0/3618066429 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ab41d6750 0x7f7ab4138a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4072a90 tx=0x7f7aac00cf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:31.549 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.541+0000 7f7a9bfff640 1 -- 172.21.15.104:0/3618066429 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac00aae0 con 0x7f7ab41d6750 2023-09-13T02:12:31.550 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.542+0000 7f9d92c75640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d8c071340 0x7f9d8c0ac110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.550 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.542+0000 7f9d92c75640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d8c071720 0x7f9d8c1e9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.550 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.542+0000 7f9d92c75640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d8c0afe20 0x7f9d8c151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.551 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.542+0000 7f9d92c75640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0ab3c0 con 0x7f9d8c071340 2023-09-13T02:12:31.551 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.542+0000 7f9d92c75640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0a9ab0 con 0x7f9d8c071720 2023-09-13T02:12:31.551 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.542+0000 7f9d92c75640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0a8af0 con 0x7f9d8c0afe20 2023-09-13T02:12:31.552 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.542+0000 7f7a9bfff640 1 -- 172.21.15.104:0/3618066429 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7aac00ad30 con 0x7f7ab41d6750 2023-09-13T02:12:31.552 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.542+0000 7f7a9bfff640 1 -- 172.21.15.104:0/3618066429 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac00aee0 con 0x7f7ab41d6750 2023-09-13T02:12:31.552 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.542+0000 7f7ab9bb0640 1 -- 172.21.15.104:0/3618066429 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab41d9df0 con 0x7f7ab41d6750 2023-09-13T02:12:31.552 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.542+0000 7f9d91c73640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d8c071340 0x7f9d8c0ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.553 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.542+0000 7f7ab9bb0640 1 -- 172.21.15.104:0/3618066429 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab413f070 con 0x7f7ab41d6750 2023-09-13T02:12:31.554 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.542+0000 7f9d91c73640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d8c071340 0x7f9d8c0ac110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47362/0 (socket says 172.21.15.104:47362) 2023-09-13T02:12:31.554 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.542+0000 7f9d91c73640 1 -- 172.21.15.104:0/472854804 learned_addr learned my addr 172.21.15.104:0/472854804 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:31.554 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.543+0000 7f9d91472640 1 --2- 172.21.15.104:0/472854804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d8c071720 0x7f9d8c1e9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.555 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.543+0000 7f9d91c73640 1 -- 172.21.15.104:0/472854804 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d8c0afe20 msgr2=0x7f9d8c151760 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-13T02:12:31.555 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.543+0000 7f9d91c73640 1 --2- 172.21.15.104:0/472854804 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d8c0afe20 0x7f9d8c151760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.555 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.543+0000 7f9d91c73640 1 -- 172.21.15.104:0/472854804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d8c071720 msgr2=0x7f9d8c1e9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.555 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.543+0000 7f9d91c73640 1 --2- 172.21.15.104:0/472854804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d8c071720 0x7f9d8c1e9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.555 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.543+0000 7f9d91c73640 1 -- 172.21.15.104:0/472854804 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8800c490 con 0x7f9d8c071340 2023-09-13T02:12:31.556 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.544+0000 7f9d91c73640 1 --2- 172.21.15.104:0/472854804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d8c071340 0x7f9d8c0ac110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400bd60 tx=0x7f9d84009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:31.556 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.544+0000 7f7ab9bb0640 1 -- 172.21.15.104:0/3618066429 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab41d9f80 con 0x7f7ab41d6750 2023-09-13T02:12:31.556 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.545+0000 7fc1f88dc640 1 -- 172.21.15.104:0/4002934760 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1e4003970 msgr2=0x7fc1e4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.557 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.544+0000 7f9d827fc640 1 -- 172.21.15.104:0/472854804 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8400cbe0 con 0x7f9d8c071340 2023-09-13T02:12:31.557 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.544+0000 7f9d827fc640 1 -- 172.21.15.104:0/472854804 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9d8400ce50 con 0x7f9d8c071340 2023-09-13T02:12:31.557 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.545+0000 7fc1f88dc640 1 --2- 172.21.15.104:0/4002934760 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1e4003970 0x7fc1e4003d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4068cc0 tx=0x7fc1e40057f0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.558 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.545+0000 7f9d827fc640 1 -- 172.21.15.104:0/472854804 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84014680 con 0x7f9d8c071340 2023-09-13T02:12:31.558 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.545+0000 7f7a9bfff640 1 -- 172.21.15.104:0/3618066429 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f7aac007070 con 0x7f7ab41d6750 2023-09-13T02:12:31.559 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.545+0000 7fc1f3fff640 1 -- 172.21.15.104:0/4002934760 reap_dead start 2023-09-13T02:12:31.559 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.545+0000 7fc1f88dc640 1 -- 172.21.15.104:0/4002934760 shutdown_connections 2023-09-13T02:12:31.559 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.545+0000 7fc1f88dc640 1 -- 172.21.15.104:0/4002934760 >> 172.21.15.104:0/4002934760 conn(0x7fc1ec03eb30 msgr2=0x7fc1ec03ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:31.559 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.546+0000 7fc1f88dc640 1 -- 172.21.15.104:0/4002934760 shutdown_connections 2023-09-13T02:12:31.560 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.546+0000 7f9d92c75640 1 -- 172.21.15.104:0/472854804 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8c0ae820 con 0x7f9d8c071340 2023-09-13T02:12:31.560 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.546+0000 7f9d92c75640 1 -- 172.21.15.104:0/472854804 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c0ab6a0 con 0x7f9d8c071340 2023-09-13T02:12:31.561 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.546+0000 7f7a9bfff640 1 --2- 172.21.15.104:0/3618066429 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f7aa006a5c0 0x7f7aa006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.561 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.546+0000 7f7ab37fe640 1 --2- 172.21.15.104:0/3618066429 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f7aa006a5c0 0x7f7aa006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.561 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.547+0000 7f7a9bfff640 1 -- 172.21.15.104:0/3618066429 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7aac088910 con 0x7f7ab41d6750 2023-09-13T02:12:31.562 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.547+0000 7f7ab37fe640 1 --2- 172.21.15.104:0/3618066429 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f7aa006a5c0 0x7f7aa006ca80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8056000 tx=0x7f7aa8001a50 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:31.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.546+0000 7fc1f88dc640 1 -- 172.21.15.104:0/4002934760 wait complete. 2023-09-13T02:12:31.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.547+0000 7fc1f88dc640 1 Processor -- start 2023-09-13T02:12:31.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.547+0000 7fc1f88dc640 1 -- start start 2023-09-13T02:12:31.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.548+0000 7fc1f88dc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1ec15f8a0 0x7fc1ec15fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.548+0000 7fc1f88dc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1ec0bae00 0x7fc1ec0bb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.548+0000 7fc1f88dc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1ec0be2a0 0x7fc1ec0be720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.548+0000 7fc1f88dc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec164c60 con 0x7fc1ec0bae00 2023-09-13T02:12:31.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.548+0000 7fc1f88dc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0bb7c0 con 0x7fc1ec0be2a0 2023-09-13T02:12:31.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.548+0000 7fc1f88dc640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0c5950 con 0x7fc1ec15f8a0 2023-09-13T02:12:31.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.549+0000 7fc1f37fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1ec15f8a0 0x7fc1ec15fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.549+0000 7fc1f37fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1ec15f8a0 0x7fc1ec15fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.104:42704/0 (socket says 172.21.15.104:42704) 2023-09-13T02:12:31.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.549+0000 7fc1f37fe640 1 -- 172.21.15.104:0/3696717379 learned_addr learned my addr 172.21.15.104:0/3696717379 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:31.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.549+0000 7fc1f3fff640 1 --2- 172.21.15.104:0/3696717379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1ec0be2a0 0x7fc1ec0be720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.566 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.549+0000 7fc1f2ffd640 1 --2- 172.21.15.104:0/3696717379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1ec0bae00 0x7fc1ec0bb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.566 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.549+0000 7fc1f3fff640 1 -- 172.21.15.104:0/3696717379 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1ec15f8a0 msgr2=0x7fc1ec15fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.566 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.549+0000 7f9d827fc640 1 -- 172.21.15.104:0/472854804 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f9d8401d3b0 con 0x7f9d8c071340 2023-09-13T02:12:31.567 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.549+0000 7fc1f3fff640 1 --2- 172.21.15.104:0/3696717379 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1ec15f8a0 0x7fc1ec15fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.567 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.549+0000 7fc1f3fff640 1 -- 172.21.15.104:0/3696717379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1ec0bae00 msgr2=0x7fc1ec0bb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.567 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.549+0000 7fc1f3fff640 1 --2- 172.21.15.104:0/3696717379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1ec0bae00 0x7fc1ec0bb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.567 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.549+0000 7fc1f3fff640 1 -- 172.21.15.104:0/3696717379 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec165500 con 0x7fc1ec0be2a0 2023-09-13T02:12:31.568 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.549+0000 7fc1f2ffd640 1 --2- 172.21.15.104:0/3696717379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1ec0bae00 0x7fc1ec0bb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:12:31.568 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.549+0000 7f9d827fc640 1 --2- 172.21.15.104:0/472854804 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f9d7006a590 0x7f9d7006ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.568 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.549+0000 7fc1f3fff640 1 --2- 172.21.15.104:0/3696717379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1ec0be2a0 0x7fc1ec0be720 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0cd590 tx=0x7fc1e800ea90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:31.569 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.550+0000 7f9d91472640 1 --2- 172.21.15.104:0/472854804 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f9d7006a590 0x7f9d7006ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.569 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.550+0000 7fc1dffff640 1 -- 172.21.15.104:0/3696717379 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8018070 con 0x7fc1ec0be2a0 2023-09-13T02:12:31.570 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.550+0000 7f9d827fc640 1 -- 172.21.15.104:0/472854804 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d84088c60 con 0x7f9d8c071340 2023-09-13T02:12:31.570 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.549+0000 7f9d92c75640 1 -- 172.21.15.104:0/472854804 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8c0a9910 con 0x7f9d8c071340 2023-09-13T02:12:31.571 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.550+0000 7fc1f88dc640 1 -- 172.21.15.104:0/3696717379 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ec1657e0 con 0x7fc1ec0be2a0 2023-09-13T02:12:31.571 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.550+0000 7fc1f88dc640 1 -- 172.21.15.104:0/3696717379 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ec163dd0 con 0x7fc1ec0be2a0 2023-09-13T02:12:31.571 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.550+0000 7fc1dffff640 1 -- 172.21.15.104:0/3696717379 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc1e8005110 con 0x7fc1ec0be2a0 2023-09-13T02:12:31.571 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.550+0000 7fc1dffff640 1 -- 172.21.15.104:0/3696717379 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e80054c0 con 0x7fc1ec0be2a0 2023-09-13T02:12:31.572 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.552+0000 7f7a9bfff640 1 -- 172.21.15.104:0/3618066429 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7aac053fb0 con 0x7f7ab41d6750 2023-09-13T02:12:31.573 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.552+0000 7fc1ddffb640 1 -- 172.21.15.104:0/3696717379 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ec165340 con 0x7fc1ec0be2a0 2023-09-13T02:12:31.573 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.553+0000 7fc1dffff640 1 -- 172.21.15.104:0/3696717379 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc1e80047a0 con 0x7fc1ec0be2a0 2023-09-13T02:12:31.573 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.553+0000 7fc1dffff640 1 --2- 172.21.15.104:0/3696717379 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fc1d806a5f0 0x7fc1d806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.573 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.553+0000 7fc1dffff640 1 -- 172.21.15.104:0/3696717379 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1e8088460 con 0x7fc1ec0be2a0 2023-09-13T02:12:31.573 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.554+0000 7fc1f37fe640 1 --2- 172.21.15.104:0/3696717379 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fc1d806a5f0 0x7fc1d806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.574 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.555+0000 7fc1f37fe640 1 --2- 172.21.15.104:0/3696717379 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fc1d806a5f0 0x7fc1d806cab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc1f404ee00 tx=0x7fc1f4067c40 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:31.574 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.553+0000 7f9d91472640 1 --2- 172.21.15.104:0/472854804 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f9d7006a590 0x7f9d7006ca50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c1dd290 tx=0x7f9d7c009260 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:31.574 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.559+0000 7f9d827fc640 1 -- 172.21.15.104:0/472854804 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9d8c0a9910 con 0x7f9d8c071340 2023-09-13T02:12:31.575 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.558+0000 7fc1dffff640 1 -- 172.21.15.104:0/3696717379 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc1e80539c0 con 0x7fc1ec0be2a0 2023-09-13T02:12:31.606 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.605+0000 7f0a6500d640 1 -- 172.21.15.104:0/3053489096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a600ae170 msgr2=0x7f0a6013cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.607 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.605+0000 7f0a6500d640 1 --2- 172.21.15.104:0/3053489096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a600ae170 0x7f0a6013cd80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0a58005fd0 tx=0x7f0a5802c260 comp rx=0 tx=0).stop 2023-09-13T02:12:31.607 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.606+0000 7f0a6500d640 1 -- 172.21.15.104:0/3053489096 shutdown_connections 2023-09-13T02:12:31.608 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.606+0000 7f0a6500d640 1 --2- 172.21.15.104:0/3053489096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a600ae170 0x7f0a6013cd80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.608 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.606+0000 7f0a6500d640 1 -- 172.21.15.104:0/3053489096 >> 172.21.15.104:0/3053489096 conn(0x7f0a600695a0 msgr2=0x7f0a600699b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:31.608 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.606+0000 7f0a6500d640 1 -- 172.21.15.104:0/3053489096 shutdown_connections 2023-09-13T02:12:31.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.606+0000 7f1e5ed01640 1 -- 172.21.15.104:0/3608534045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e500eae60 msgr2=0x7f1e500383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.606+0000 7f1e5ed01640 1 --2- 172.21.15.104:0/3608534045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e500eae60 0x7f1e500383c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c005fd0 tx=0x7f1e4c02be20 comp rx=0 tx=0).stop 2023-09-13T02:12:31.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.606+0000 7f1e5ed01640 1 -- 172.21.15.104:0/3608534045 shutdown_connections 2023-09-13T02:12:31.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.606+0000 7f0a6500d640 1 -- 172.21.15.104:0/3053489096 wait complete. 2023-09-13T02:12:31.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.606+0000 7f1e5ed01640 1 --2- 172.21.15.104:0/3608534045 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e500369d0 0x7f1e50035740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.611 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.606+0000 7f1e5ed01640 1 --2- 172.21.15.104:0/3608534045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e500eae60 0x7f1e500383c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.611 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.606+0000 7f1e5ed01640 1 -- 172.21.15.104:0/3608534045 >> 172.21.15.104:0/3608534045 conn(0x7f1e5003a8e0 msgr2=0x7f1e5003acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:31.611 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.607+0000 7f1e5ed01640 1 -- 172.21.15.104:0/3608534045 shutdown_connections 2023-09-13T02:12:31.611 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.607+0000 7f1e5ed01640 1 -- 172.21.15.104:0/3608534045 wait complete. 2023-09-13T02:12:31.613 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.608+0000 7ff9d6b87640 1 -- 172.21.15.104:0/610179082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9c8038fd0 msgr2=0x7ff9c8033590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.613 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.608+0000 7ff9d6b87640 1 --2- 172.21.15.104:0/610179082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9c8038fd0 0x7ff9c8033590 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc005fd0 tx=0x7ff9cc02df20 comp rx=0 tx=0).stop 2023-09-13T02:12:31.614 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.608+0000 7ff9d6b87640 1 -- 172.21.15.104:0/610179082 shutdown_connections 2023-09-13T02:12:31.614 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.608+0000 7f0a6500d640 1 Processor -- start 2023-09-13T02:12:31.615 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.608+0000 7ff9d6b87640 1 --2- 172.21.15.104:0/610179082 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9c8039e80 0x7ff9c8033ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.615 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.608+0000 7ff9d6b87640 1 --2- 172.21.15.104:0/610179082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9c8038fd0 0x7ff9c8033590 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.616 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.608+0000 7ff9d6b87640 1 -- 172.21.15.104:0/610179082 >> 172.21.15.104:0/610179082 conn(0x7ff9c803a9f0 msgr2=0x7ff9c803ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:31.616 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f216e7fc640 1 -- 172.21.15.104:0/2578178543 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216403c940 con 0x7f2170143880 2023-09-13T02:12:31.617 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f237cbc5640 1 -- 172.21.15.104:0/3961069214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23700066c0 msgr2=0x7f23700c26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.617 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f237cbc5640 1 --2- 172.21.15.104:0/3961069214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23700066c0 0x7f23700c26c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f23780772b0 tx=0x7f23780686b0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.617 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.608+0000 7f0a6500d640 1 -- start start 2023-09-13T02:12:31.618 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f2174e39640 1 -- 172.21.15.104:0/2578178543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2170143880 msgr2=0x7f2170143ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.618 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f2174e39640 1 --2- 172.21.15.104:0/2578178543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2170143880 0x7f2170143ce0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2164013f30 tx=0x7f2164034250 comp rx=0 tx=0).stop 2023-09-13T02:12:31.619 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7ff9d6b87640 1 -- 172.21.15.104:0/610179082 shutdown_connections 2023-09-13T02:12:31.619 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f237cbc5640 1 -- 172.21.15.104:0/3961069214 shutdown_connections 2023-09-13T02:12:31.620 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f237cbc5640 1 --2- 172.21.15.104:0/3961069214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23700066c0 0x7f23700c26c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.620 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f237cbc5640 1 --2- 172.21.15.104:0/3961069214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2370006260 0x7f23700c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.620 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f237cbc5640 1 --2- 172.21.15.104:0/3961069214 >> v2:172.21.15.119:3300/0 conn(0x7f2370037370 0x7f23700cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.621 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f237cbc5640 1 -- 172.21.15.104:0/3961069214 >> 172.21.15.104:0/3961069214 conn(0x7f237003af30 msgr2=0x7f237003b340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:31.621 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f0a6500d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a60072420 0x7f0a6013f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.622 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f0a6500d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a600b20e0 0x7f0a601e1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.622 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f0a6500d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a601e2270 0x7f0a600a8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.622 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f0a6500d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a601e2ce0 con 0x7f0a60072420 2023-09-13T02:12:31.623 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f0a6500d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a600a6670 con 0x7f0a600b20e0 2023-09-13T02:12:31.623 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f0a6500d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a601de7c0 con 0x7f0a601e2270 2023-09-13T02:12:31.623 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f0a5ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a60072420 0x7f0a6013f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.624 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f0a5f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a600b20e0 0x7f0a601e1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.624 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.610+0000 7f0a5ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a60072420 0x7f0a6013f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47402/0 (socket says 172.21.15.104:47402) 2023-09-13T02:12:31.624 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.610+0000 7f0a5ffff640 1 -- 172.21.15.104:0/1387376501 learned_addr learned my addr 172.21.15.104:0/1387376501 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:31.624 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.610+0000 7f0a5f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a600b20e0 0x7f0a601e1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.104:40022/0 (socket says 172.21.15.104:40022) 2023-09-13T02:12:31.625 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f1e5ed01640 1 Processor -- start 2023-09-13T02:12:31.625 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f1e5ed01640 1 -- start start 2023-09-13T02:12:31.626 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.610+0000 7f0a6480c640 1 --2- 172.21.15.104:0/1387376501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a601e2270 0x7f0a600a8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.626 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.610+0000 7f0a6480c640 1 -- 172.21.15.104:0/1387376501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a600b20e0 msgr2=0x7f0a601e1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.626 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.610+0000 7f0a6480c640 1 --2- 172.21.15.104:0/1387376501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a600b20e0 0x7f0a601e1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.626 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.610+0000 7f0a6480c640 1 -- 172.21.15.104:0/1387376501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a60072420 msgr2=0x7f0a6013f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.626 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.610+0000 7f0a6480c640 1 --2- 172.21.15.104:0/1387376501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a60072420 0x7f0a6013f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.627 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.610+0000 7f0a6480c640 1 -- 172.21.15.104:0/1387376501 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a58009900 con 0x7f0a601e2270 2023-09-13T02:12:31.627 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7ff9d6b87640 1 -- 172.21.15.104:0/610179082 wait complete. 2023-09-13T02:12:31.628 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.610+0000 7f0a6480c640 1 --2- 172.21.15.104:0/1387376501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a601e2270 0x7f0a600a8a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400c390 tx=0x7f0a5400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:31.628 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.610+0000 7f237cbc5640 1 -- 172.21.15.104:0/3961069214 shutdown_connections 2023-09-13T02:12:31.628 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.610+0000 7f237cbc5640 1 -- 172.21.15.104:0/3961069214 wait complete. 2023-09-13T02:12:31.629 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f2174e39640 1 -- 172.21.15.104:0/2578178543 shutdown_connections 2023-09-13T02:12:31.629 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f2174e39640 1 --2- 172.21.15.104:0/2578178543 >> v2:172.21.15.104:3300/0 conn(0x7f21700b1020 0x7f21700b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.629 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f2174e39640 1 --2- 172.21.15.104:0/2578178543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2170143880 0x7f2170143ce0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.630 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.609+0000 7f2174e39640 1 -- 172.21.15.104:0/2578178543 >> 172.21.15.104:0/2578178543 conn(0x7f21700b66a0 msgr2=0x7f21700b6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:31.630 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.610+0000 7f0a5cff9640 1 -- 172.21.15.104:0/1387376501 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a540052d0 con 0x7f0a601e2270 2023-09-13T02:12:31.630 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.610+0000 7f0a5cff9640 1 -- 172.21.15.104:0/1387376501 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0a540035f0 con 0x7f0a601e2270 2023-09-13T02:12:31.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f0a6500d640 1 -- 172.21.15.104:0/1387376501 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a601e2720 con 0x7f0a601e2270 2023-09-13T02:12:31.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f1e5ed01640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e500369d0 0x7f1e50033b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f1e5ed01640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e500e4060 0x7f1e5018c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.632 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f1e5ed01640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e500eae60 0x7f1e5003cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.632 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f1e5ed01640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e500fc900 con 0x7f1e500eae60 2023-09-13T02:12:31.632 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f1e5ed01640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5018ca70 con 0x7f1e500e4060 2023-09-13T02:12:31.633 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f1e5ed01640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5018cd50 con 0x7f1e500369d0 2023-09-13T02:12:31.633 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f0a6500d640 1 -- 172.21.15.104:0/1387376501 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6013e190 con 0x7f0a601e2270 2023-09-13T02:12:31.634 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7ff9d6b87640 1 Processor -- start 2023-09-13T02:12:31.634 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7ff9d6b87640 1 -- start start 2023-09-13T02:12:31.635 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f0a5cff9640 1 -- 172.21.15.104:0/1387376501 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54003a00 con 0x7f0a601e2270 2023-09-13T02:12:31.636 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f1e5ca9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e500369d0 0x7f1e50033b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.637 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f1e5ca9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e500369d0 0x7f1e50033b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.104:42764/0 (socket says 172.21.15.104:42764) 2023-09-13T02:12:31.637 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f1e5ca9d640 1 -- 172.21.15.104:0/2508085479 learned_addr learned my addr 172.21.15.104:0/2508085479 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:31.637 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f1e5d29e640 1 --2- 172.21.15.104:0/2508085479 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e500eae60 0x7f1e5003cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.638 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f1e5ca9d640 1 -- 172.21.15.104:0/2508085479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e500e4060 msgr2=0x7f1e5018c370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-13T02:12:31.638 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f1e5ca9d640 1 --2- 172.21.15.104:0/2508085479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e500e4060 0x7f1e5018c370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.638 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.612+0000 7ff9d6b87640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9c8038fd0 0x7ff9c80c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f1e5ca9d640 1 -- 172.21.15.104:0/2508085479 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e500eae60 msgr2=0x7f1e5003cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f1e5ca9d640 1 --2- 172.21.15.104:0/2508085479 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e500eae60 0x7f1e5003cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.611+0000 7f1e5ca9d640 1 -- 172.21.15.104:0/2508085479 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c009560 con 0x7f1e500369d0 2023-09-13T02:12:31.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.612+0000 7f2174e39640 1 -- 172.21.15.104:0/2578178543 shutdown_connections 2023-09-13T02:12:31.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.612+0000 7f2174e39640 1 -- 172.21.15.104:0/2578178543 wait complete. 2023-09-13T02:12:31.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.612+0000 7f1e5ca9d640 1 --2- 172.21.15.104:0/2508085479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e500369d0 0x7f1e50033b40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c0099f0 tx=0x7f1e4c02ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:31.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.612+0000 7f237cbc5640 1 Processor -- start 2023-09-13T02:12:31.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.612+0000 7f237cbc5640 1 -- start start 2023-09-13T02:12:31.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.613+0000 7f2174e39640 1 Processor -- start 2023-09-13T02:12:31.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.612+0000 7f1e557fa640 1 -- 172.21.15.104:0/2508085479 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c02ce70 con 0x7f1e500369d0 2023-09-13T02:12:31.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.612+0000 7f1e5ed01640 1 -- 172.21.15.104:0/2508085479 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e501820e0 con 0x7f1e500369d0 2023-09-13T02:12:31.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.612+0000 7f1e5ed01640 1 -- 172.21.15.104:0/2508085479 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e500d7c80 con 0x7f1e500369d0 2023-09-13T02:12:31.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.612+0000 7f1e557fa640 1 -- 172.21.15.104:0/2508085479 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1e4c003860 con 0x7f1e500369d0 2023-09-13T02:12:31.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.612+0000 7f1e557fa640 1 -- 172.21.15.104:0/2508085479 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c003c30 con 0x7f1e500369d0 2023-09-13T02:12:31.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.613+0000 7f237cbc5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2370006260 0x7f23700c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.613+0000 7f237cbc5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23700066c0 0x7f2370169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.613+0000 7f237cbc5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2370037370 0x7f237016a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.613+0000 7f237cbc5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23700d9590 con 0x7f23700066c0 2023-09-13T02:12:31.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.613+0000 7f237cbc5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2370169a70 con 0x7f2370006260 2023-09-13T02:12:31.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.613+0000 7f237cbc5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23700d9010 con 0x7f2370037370 2023-09-13T02:12:31.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.613+0000 7f237659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2370006260 0x7f23700c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.614+0000 7f2174e39640 1 -- start start 2023-09-13T02:12:31.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f2174e39640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21700af8e0 0x7f21701da710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f2174e39640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21700b1020 0x7f217013ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f2174e39640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2170143880 0x7f21700ac130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f2174e39640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217013e730 con 0x7f2170143880 2023-09-13T02:12:31.648 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f2174e39640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21700aa9b0 con 0x7f21700af8e0 2023-09-13T02:12:31.648 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f2174e39640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21701d83b0 con 0x7f21700b1020 2023-09-13T02:12:31.649 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.614+0000 7f0a5cff9640 1 -- 172.21.15.104:0/1387376501 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f0a54003b60 con 0x7f0a601e2270 2023-09-13T02:12:31.649 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.614+0000 7f0a5cff9640 1 --2- 172.21.15.104:0/1387376501 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0a4c06a5f0 0x7f0a4c06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.650 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f0a5cff9640 1 -- 172.21.15.104:0/1387376501 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a54088030 con 0x7f0a601e2270 2023-09-13T02:12:31.650 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f0a5ffff640 1 --2- 172.21.15.104:0/1387376501 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0a4c06a5f0 0x7f0a4c06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.650 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f216effd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21700b1020 0x7f217013ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.651 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.614+0000 7f1e557fa640 1 -- 172.21.15.104:0/2508085479 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f1e4c02e070 con 0x7f1e500369d0 2023-09-13T02:12:31.651 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.614+0000 7f1e5ed01640 1 -- 172.21.15.104:0/2508085479 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e38005250 con 0x7f1e500369d0 2023-09-13T02:12:31.651 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f1e557fa640 1 --2- 172.21.15.104:0/2508085479 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f1e3c06a5f0 0x7f1e3c06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.652 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f216f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21700af8e0 0x7f21701da710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.652 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f216f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21700af8e0 0x7f21701da710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.104:40046/0 (socket says 172.21.15.104:40046) 2023-09-13T02:12:31.652 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f1e557fa640 1 -- 172.21.15.104:0/2508085479 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e4c0ab530 con 0x7f1e500369d0 2023-09-13T02:12:31.653 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f216f7fe640 1 -- 172.21.15.104:0/2466654873 learned_addr learned my addr 172.21.15.104:0/2466654873 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:31.653 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f216ffff640 1 --2- 172.21.15.104:0/2466654873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2170143880 0x7f21700ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.653 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.612+0000 7ff9d6b87640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9c8039e80 0x7ff9c8166fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.654 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.613+0000 7ff9d6b87640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9c80c8f40 0x7ff9c81674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.654 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.613+0000 7ff9d6b87640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c81535d0 con 0x7ff9c8038fd0 2023-09-13T02:12:31.654 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.613+0000 7ff9d6b87640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80cc280 con 0x7ff9c8039e80 2023-09-13T02:12:31.654 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.613+0000 7ff9d6b87640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80cb960 con 0x7ff9c80c8f40 2023-09-13T02:12:31.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.613+0000 7ff9d5b85640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9c8038fd0 0x7ff9c80c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7ff9d5b85640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9c8038fd0 0x7ff9c80c2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47430/0 (socket says 172.21.15.104:47430) 2023-09-13T02:12:31.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7ff9d5b85640 1 -- 172.21.15.104:0/1389915943 learned_addr learned my addr 172.21.15.104:0/1389915943 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:31.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7ff9d5384640 1 --2- 172.21.15.104:0/1389915943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9c8039e80 0x7ff9c8166fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.656 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.614+0000 7f237659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2370006260 0x7f23700c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.104:40038/0 (socket says 172.21.15.104:40038) 2023-09-13T02:12:31.656 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.614+0000 7f237659c640 1 -- 172.21.15.104:0/3901756027 learned_addr learned my addr 172.21.15.104:0/3901756027 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:31.656 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.614+0000 7f2376d9d640 1 --2- 172.21.15.104:0/3901756027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2370037370 0x7f237016a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.656 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.614+0000 7f2376d9d640 1 -- 172.21.15.104:0/3901756027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2370006260 msgr2=0x7f23700c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.657 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.614+0000 7f2376d9d640 1 --2- 172.21.15.104:0/3901756027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2370006260 0x7f23700c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.657 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.614+0000 7f2376d9d640 1 -- 172.21.15.104:0/3901756027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23700066c0 msgr2=0x7f2370169f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.657 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.614+0000 7f2376d9d640 1 --2- 172.21.15.104:0/3901756027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23700066c0 0x7f2370169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.657 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.614+0000 7f2376d9d640 1 -- 172.21.15.104:0/3901756027 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23700da290 con 0x7f2370037370 2023-09-13T02:12:31.657 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f2376d9d640 1 --2- 172.21.15.104:0/3901756027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2370037370 0x7f237016a440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f237804e660 tx=0x7f23780ab5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:31.658 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7ff9d6386640 1 --2- 172.21.15.104:0/1389915943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9c80c8f40 0x7ff9c81674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.658 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f0a5ffff640 1 --2- 172.21.15.104:0/1387376501 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0a4c06a5f0 0x7f0a4c06cab0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0a50001840 tx=0x7f0a50009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:31.659 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f216f7fe640 1 -- 172.21.15.104:0/2466654873 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21700b1020 msgr2=0x7f217013ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.659 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f216f7fe640 1 --2- 172.21.15.104:0/2466654873 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21700b1020 0x7f217013ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.659 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f216f7fe640 1 -- 172.21.15.104:0/2466654873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2170143880 msgr2=0x7f21700ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.659 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.615+0000 7f216f7fe640 1 --2- 172.21.15.104:0/2466654873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2170143880 0x7f21700ac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.660 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.616+0000 7f0a6500d640 1 -- 172.21.15.104:0/1387376501 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a600b6800 con 0x7f0a601e2270 2023-09-13T02:12:31.660 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.616+0000 7f216f7fe640 1 -- 172.21.15.104:0/2466654873 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2164013b90 con 0x7f21700af8e0 2023-09-13T02:12:31.661 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.616+0000 7ff9d6386640 1 -- 172.21.15.104:0/1389915943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9c8039e80 msgr2=0x7ff9c8166fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.662 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.616+0000 7ff9d6386640 1 --2- 172.21.15.104:0/1389915943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9c8039e80 0x7ff9c8166fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.662 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.616+0000 7ff9d6386640 1 -- 172.21.15.104:0/1389915943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9c8038fd0 msgr2=0x7ff9c80c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.663 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.616+0000 7ff9d6386640 1 --2- 172.21.15.104:0/1389915943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9c8038fd0 0x7ff9c80c2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.663 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.616+0000 7ff9d6386640 1 -- 172.21.15.104:0/1389915943 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc009560 con 0x7ff9c80c8f40 2023-09-13T02:12:31.664 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.616+0000 7f1e57fff640 1 --2- 172.21.15.104:0/2508085479 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f1e3c06a5f0 0x7f1e3c06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.664 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.616+0000 7ff9d5b85640 1 --2- 172.21.15.104:0/1389915943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9c8038fd0 0x7ff9c80c2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T02:12:31.665 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.616+0000 7ff9d6386640 1 --2- 172.21.15.104:0/1389915943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9c80c8f40 0x7ff9c81674e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0068880 tx=0x7ff9d0067370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:31.666 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.616+0000 7f1e57fff640 1 --2- 172.21.15.104:0/2508085479 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f1e3c06a5f0 0x7f1e3c06cab0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1e58063200 tx=0x7f1e58079040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:31.667 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.616+0000 7f216f7fe640 1 --2- 172.21.15.104:0/2466654873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21700af8e0 0x7f21701da710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f216000c500 tx=0x7f216000c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:31.668 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.616+0000 7f2157fff640 1 -- 172.21.15.104:0/2466654873 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160012830 con 0x7f21700af8e0 2023-09-13T02:12:31.668 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.617+0000 7f2157fff640 1 -- 172.21.15.104:0/2466654873 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2160012a80 con 0x7f21700af8e0 2023-09-13T02:12:31.668 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.617+0000 7f2157fff640 1 -- 172.21.15.104:0/2466654873 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160012e90 con 0x7f21700af8e0 2023-09-13T02:12:31.668 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.617+0000 7f2174e39640 1 -- 172.21.15.104:0/2466654873 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21701d8690 con 0x7f21700af8e0 2023-09-13T02:12:31.669 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.618+0000 7f2174e39640 1 -- 172.21.15.104:0/2466654873 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21701d9bd0 con 0x7f21700af8e0 2023-09-13T02:12:31.669 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.619+0000 7f2174e39640 1 -- 172.21.15.104:0/2466654873 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21700650f0 con 0x7f21700af8e0 2023-09-13T02:12:31.669 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.619+0000 7f2157fff640 1 -- 172.21.15.104:0/2466654873 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f216001a3b0 con 0x7f21700af8e0 2023-09-13T02:12:31.671 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.619+0000 7ff9c67fc640 1 -- 172.21.15.104:0/1389915943 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0066690 con 0x7ff9c80c8f40 2023-09-13T02:12:31.671 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.620+0000 7ff9d6b87640 1 -- 172.21.15.104:0/1389915943 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c80cbc40 con 0x7ff9c80c8f40 2023-09-13T02:12:31.671 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.620+0000 7ff9d6b87640 1 -- 172.21.15.104:0/1389915943 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c80cc860 con 0x7ff9c80c8f40 2023-09-13T02:12:31.672 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.620+0000 7f1e557fa640 1 -- 172.21.15.104:0/2508085479 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f1e4c076ce0 con 0x7f1e500369d0 2023-09-13T02:12:31.672 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.620+0000 7f2157fff640 1 --2- 172.21.15.104:0/2466654873 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f215c06a4f0 0x7f215c06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.673 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.620+0000 7f2157fff640 1 -- 172.21.15.104:0/2466654873 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2160088880 con 0x7f21700af8e0 2023-09-13T02:12:31.673 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.620+0000 7f216effd640 1 --2- 172.21.15.104:0/2466654873 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f215c06a4f0 0x7f215c06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.673 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.619+0000 7f2366ffd640 1 -- 172.21.15.104:0/3901756027 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23780abb30 con 0x7f2370037370 2023-09-13T02:12:31.673 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.620+0000 7f237cbc5640 1 -- 172.21.15.104:0/3901756027 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23700da570 con 0x7f2370037370 2023-09-13T02:12:31.674 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.620+0000 7f237cbc5640 1 -- 172.21.15.104:0/3901756027 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2370034880 con 0x7f2370037370 2023-09-13T02:12:31.674 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.621+0000 7f216effd640 1 --2- 172.21.15.104:0/2466654873 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f215c06a4f0 0x7f215c06c9b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f216403e000 tx=0x7f2164004730 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:31.675 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.621+0000 7ff9d6b87640 1 -- 172.21.15.104:0/1389915943 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c80cc0e0 con 0x7ff9c80c8f40 2023-09-13T02:12:31.676 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.621+0000 7f237cbc5640 1 -- 172.21.15.104:0/3901756027 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2370169be0 con 0x7f2370037370 2023-09-13T02:12:31.677 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.624+0000 7ff9c67fc640 1 -- 172.21.15.104:0/1389915943 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff9d00667f0 con 0x7ff9c80c8f40 2023-09-13T02:12:31.677 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.624+0000 7ff9c67fc640 1 -- 172.21.15.104:0/1389915943 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0091690 con 0x7ff9c80c8f40 2023-09-13T02:12:31.678 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.624+0000 7f2366ffd640 1 -- 172.21.15.104:0/3901756027 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f23780ac410 con 0x7f2370037370 2023-09-13T02:12:31.678 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.624+0000 7f0a5cff9640 1 -- 172.21.15.104:0/1387376501 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0a600b6800 con 0x7f0a601e2270 2023-09-13T02:12:31.679 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.625+0000 7f2366ffd640 1 -- 172.21.15.104:0/3901756027 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23780ac650 con 0x7f2370037370 2023-09-13T02:12:31.680 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.625+0000 7f2157fff640 1 -- 172.21.15.104:0/2466654873 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f21600578a0 con 0x7f21700af8e0 2023-09-13T02:12:31.681 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.626+0000 7ff9c67fc640 1 -- 172.21.15.104:0/1389915943 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff9d006e430 con 0x7ff9c80c8f40 2023-09-13T02:12:31.681 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.626+0000 7ff9c67fc640 1 --2- 172.21.15.104:0/1389915943 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff9b406a4f0 0x7ff9b406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.681 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.626+0000 7f2366ffd640 1 -- 172.21.15.104:0/3901756027 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f23780b6460 con 0x7f2370037370 2023-09-13T02:12:31.682 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.627+0000 7f2366ffd640 1 --2- 172.21.15.104:0/3901756027 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f235806a4f0 0x7f235806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:31.682 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.627+0000 7f237659c640 1 --2- 172.21.15.104:0/3901756027 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f235806a4f0 0x7f235806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.682 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.627+0000 7f2366ffd640 1 -- 172.21.15.104:0/3901756027 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23781241b0 con 0x7f2370037370 2023-09-13T02:12:31.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.627+0000 7ff9d5b85640 1 --2- 172.21.15.104:0/1389915943 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff9b406a4f0 0x7ff9b406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:31.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.628+0000 7ff9c67fc640 1 -- 172.21.15.104:0/1389915943 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9d0100b80 con 0x7ff9c80c8f40 2023-09-13T02:12:31.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.628+0000 7f237659c640 1 --2- 172.21.15.104:0/3901756027 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f235806a4f0 0x7f235806c9b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f23680099a0 tx=0x7f23680090e0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:31.684 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.628+0000 7ff9d5b85640 1 --2- 172.21.15.104:0/1389915943 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff9b406a4f0 0x7ff9b406c9b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc006010 tx=0x7ff9cc0046c0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:31.684 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.629+0000 7f2366ffd640 1 -- 172.21.15.104:0/3901756027 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f23780ef970 con 0x7f2370037370 2023-09-13T02:12:31.685 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.633+0000 7ff9c67fc640 1 -- 172.21.15.104:0/1389915943 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff9d00cc150 con 0x7ff9c80c8f40 2023-09-13T02:12:31.932 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.931+0000 7f7ab9bb0640 1 -- 172.21.15.104:0/3618066429 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7ab404e100 con 0x7f7ab41d6750 2023-09-13T02:12:31.933 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.931+0000 7f7a9bfff640 1 -- 172.21.15.104:0/3618066429 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7aac017090 con 0x7f7ab41d6750 2023-09-13T02:12:31.933 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2023-09-13T02:12:31.937 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.935+0000 7f7a99ffb640 1 -- 172.21.15.104:0/3618066429 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f7aa006a5c0 msgr2=0x7f7aa006ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.937 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.935+0000 7f7a99ffb640 1 --2- 172.21.15.104:0/3618066429 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f7aa006a5c0 0x7f7aa006ca80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8056000 tx=0x7f7aa8001a50 comp rx=0 tx=0).stop 2023-09-13T02:12:31.937 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.935+0000 7f7a99ffb640 1 -- 172.21.15.104:0/3618066429 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ab41d6750 msgr2=0x7f7ab4138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.937 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.935+0000 7f7a99ffb640 1 --2- 172.21.15.104:0/3618066429 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ab41d6750 0x7f7ab4138a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4072a90 tx=0x7f7aac00cf00 comp rx=0 tx=0).stop 2023-09-13T02:12:31.937 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.935+0000 7f7a99ffb640 1 -- 172.21.15.104:0/3618066429 shutdown_connections 2023-09-13T02:12:31.938 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.935+0000 7f7a99ffb640 1 --2- 172.21.15.104:0/3618066429 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f7aa006a5c0 0x7f7aa006ca80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.938 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.935+0000 7f7a99ffb640 1 --2- 172.21.15.104:0/3618066429 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ab41d6750 0x7f7ab4138a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.938 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.935+0000 7f7a99ffb640 1 --2- 172.21.15.104:0/3618066429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ab4070350 0x7f7ab41d6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.938 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.935+0000 7f7a99ffb640 1 --2- 172.21.15.104:0/3618066429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a9c0039d0 0x7f7ab41d97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.939 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.936+0000 7f7a99ffb640 1 -- 172.21.15.104:0/3618066429 >> 172.21.15.104:0/3618066429 conn(0x7f7ab40b3350 msgr2=0x7f7ab41426d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:31.939 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.936+0000 7f7a99ffb640 1 -- 172.21.15.104:0/3618066429 shutdown_connections 2023-09-13T02:12:31.939 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.936+0000 7f7a99ffb640 1 -- 172.21.15.104:0/3618066429 wait complete. 2023-09-13T02:12:31.940 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.938+0000 7fc1ddffb640 1 -- 172.21.15.104:0/3696717379 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc1ec005790 con 0x7fc1ec0be2a0 2023-09-13T02:12:31.940 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.939+0000 7fc1dffff640 1 -- 172.21.15.104:0/3696717379 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1e8056fe0 con 0x7fc1ec0be2a0 2023-09-13T02:12:31.940 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2023-09-13T02:12:31.943 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.942+0000 7fc1f88dc640 1 -- 172.21.15.104:0/3696717379 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fc1d806a5f0 msgr2=0x7fc1d806cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.944 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.942+0000 7fc1f88dc640 1 --2- 172.21.15.104:0/3696717379 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fc1d806a5f0 0x7fc1d806cab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc1f404ee00 tx=0x7fc1f4067c40 comp rx=0 tx=0).stop 2023-09-13T02:12:31.944 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.942+0000 7fc1f88dc640 1 -- 172.21.15.104:0/3696717379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1ec0be2a0 msgr2=0x7fc1ec0be720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.944 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.942+0000 7fc1f88dc640 1 --2- 172.21.15.104:0/3696717379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1ec0be2a0 0x7fc1ec0be720 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0cd590 tx=0x7fc1e800ea90 comp rx=0 tx=0).stop 2023-09-13T02:12:31.944 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.942+0000 7fc1f88dc640 1 -- 172.21.15.104:0/3696717379 shutdown_connections 2023-09-13T02:12:31.944 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.942+0000 7fc1f88dc640 1 --2- 172.21.15.104:0/3696717379 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fc1d806a5f0 0x7fc1d806cab0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.945 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.942+0000 7fc1f88dc640 1 --2- 172.21.15.104:0/3696717379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1ec0be2a0 0x7fc1ec0be720 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.945 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.942+0000 7fc1f88dc640 1 --2- 172.21.15.104:0/3696717379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1ec0bae00 0x7fc1ec0bb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.945 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.942+0000 7fc1f88dc640 1 --2- 172.21.15.104:0/3696717379 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1ec15f8a0 0x7fc1ec15fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.945 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.942+0000 7fc1f88dc640 1 -- 172.21.15.104:0/3696717379 >> 172.21.15.104:0/3696717379 conn(0x7fc1ec03eb30 msgr2=0x7fc1ec03cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:31.945 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.943+0000 7fc1f88dc640 1 -- 172.21.15.104:0/3696717379 shutdown_connections 2023-09-13T02:12:31.946 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.943+0000 7fc1f88dc640 1 -- 172.21.15.104:0/3696717379 wait complete. 2023-09-13T02:12:31.946 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.943+0000 7f9d92c75640 1 -- 172.21.15.104:0/472854804 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9d8c0a9010 con 0x7f9d8c071340 2023-09-13T02:12:31.946 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.944+0000 7f9d827fc640 1 -- 172.21.15.104:0/472854804 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d8c0a9010 con 0x7f9d8c071340 2023-09-13T02:12:31.947 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2023-09-13T02:12:31.949 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.947+0000 7f9d6ffff640 1 -- 172.21.15.104:0/472854804 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f9d7006a590 msgr2=0x7f9d7006ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.949 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.948+0000 7f9d6ffff640 1 --2- 172.21.15.104:0/472854804 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f9d7006a590 0x7f9d7006ca50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c1dd290 tx=0x7f9d7c009260 comp rx=0 tx=0).stop 2023-09-13T02:12:31.949 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.948+0000 7f9d6ffff640 1 -- 172.21.15.104:0/472854804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d8c071340 msgr2=0x7f9d8c0ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.949 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.948+0000 7f9d6ffff640 1 --2- 172.21.15.104:0/472854804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d8c071340 0x7f9d8c0ac110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400bd60 tx=0x7f9d84009f10 comp rx=0 tx=0).stop 2023-09-13T02:12:31.951 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.948+0000 7f9d6ffff640 1 -- 172.21.15.104:0/472854804 shutdown_connections 2023-09-13T02:12:31.951 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.948+0000 7f9d6ffff640 1 --2- 172.21.15.104:0/472854804 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f9d7006a590 0x7f9d7006ca50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.951 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.948+0000 7f9d6ffff640 1 --2- 172.21.15.104:0/472854804 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d8c0afe20 0x7f9d8c151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.951 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.948+0000 7f9d6ffff640 1 --2- 172.21.15.104:0/472854804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d8c071720 0x7f9d8c1e9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.951 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.948+0000 7f9d6ffff640 1 --2- 172.21.15.104:0/472854804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d8c071340 0x7f9d8c0ac110 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.952 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.949+0000 7f9d6ffff640 1 -- 172.21.15.104:0/472854804 >> 172.21.15.104:0/472854804 conn(0x7f9d8c069970 msgr2=0x7f9d8c1dc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:31.952 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.949+0000 7f9d6ffff640 1 -- 172.21.15.104:0/472854804 shutdown_connections 2023-09-13T02:12:31.952 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.949+0000 7f9d6ffff640 1 -- 172.21.15.104:0/472854804 wait complete. 2023-09-13T02:12:31.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-09-13T02:12:31.955 DEBUG:teuthology.parallel:result is None 2023-09-13T02:12:31.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-09-13T02:12:31.962 DEBUG:teuthology.parallel:result is None 2023-09-13T02:12:31.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-09-13T02:12:31.967 DEBUG:teuthology.parallel:result is None 2023-09-13T02:12:31.985 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.984+0000 7f237cbc5640 1 -- 172.21.15.104:0/3901756027 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2370005790 con 0x7f2370037370 2023-09-13T02:12:31.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.984+0000 7f1e5ed01640 1 -- 172.21.15.104:0/2508085479 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1e38005500 con 0x7f1e500369d0 2023-09-13T02:12:31.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.985+0000 7f2366ffd640 1 -- 172.21.15.104:0/3901756027 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f23780ba020 con 0x7f2370037370 2023-09-13T02:12:31.986 INFO:teuthology.orchestra.run.smithi104.stdout:55834574853 2023-09-13T02:12:31.987 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.985+0000 7f1e557fa640 1 -- 172.21.15.104:0/2508085479 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1e4c042090 con 0x7f1e500369d0 2023-09-13T02:12:31.988 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2023-09-13T02:12:31.988 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f237cbc5640 1 -- 172.21.15.104:0/3901756027 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f235806a4f0 msgr2=0x7f235806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.988 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f237cbc5640 1 --2- 172.21.15.104:0/3901756027 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f235806a4f0 0x7f235806c9b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f23680099a0 tx=0x7f23680090e0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.989 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f237cbc5640 1 -- 172.21.15.104:0/3901756027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2370037370 msgr2=0x7f237016a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.989 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f237cbc5640 1 --2- 172.21.15.104:0/3901756027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2370037370 0x7f237016a440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f237804e660 tx=0x7f23780ab5f0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.989 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f1e5ed01640 1 -- 172.21.15.104:0/2508085479 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f1e3c06a5f0 msgr2=0x7f1e3c06cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.989 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f1e5ed01640 1 --2- 172.21.15.104:0/2508085479 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f1e3c06a5f0 0x7f1e3c06cab0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1e58063200 tx=0x7f1e58079040 comp rx=0 tx=0).stop 2023-09-13T02:12:31.990 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f237cbc5640 1 -- 172.21.15.104:0/3901756027 shutdown_connections 2023-09-13T02:12:31.990 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f237cbc5640 1 --2- 172.21.15.104:0/3901756027 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f235806a4f0 0x7f235806c9b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.991 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f237cbc5640 1 --2- 172.21.15.104:0/3901756027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2370037370 0x7f237016a440 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.991 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f237cbc5640 1 --2- 172.21.15.104:0/3901756027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23700066c0 0x7f2370169f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.991 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f237cbc5640 1 --2- 172.21.15.104:0/3901756027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2370006260 0x7f23700c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.991 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f237cbc5640 1 -- 172.21.15.104:0/3901756027 >> 172.21.15.104:0/3901756027 conn(0x7f237003af30 msgr2=0x7f23700c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:31.992 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f1e5ed01640 1 -- 172.21.15.104:0/2508085479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e500369d0 msgr2=0x7f1e50033b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.992 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f1e5ed01640 1 --2- 172.21.15.104:0/2508085479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e500369d0 0x7f1e50033b40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c0099f0 tx=0x7f1e4c02ef60 comp rx=0 tx=0).stop 2023-09-13T02:12:31.992 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f237cbc5640 1 -- 172.21.15.104:0/3901756027 shutdown_connections 2023-09-13T02:12:31.992 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f237cbc5640 1 -- 172.21.15.104:0/3901756027 wait complete. 2023-09-13T02:12:31.993 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f1e5ed01640 1 -- 172.21.15.104:0/2508085479 shutdown_connections 2023-09-13T02:12:31.993 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f1e5ed01640 1 --2- 172.21.15.104:0/2508085479 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f1e3c06a5f0 0x7f1e3c06cab0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.994 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f1e5ed01640 1 --2- 172.21.15.104:0/2508085479 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e500eae60 0x7f1e5003cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.994 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f1e5ed01640 1 --2- 172.21.15.104:0/2508085479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e500e4060 0x7f1e5018c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.994 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f1e5ed01640 1 --2- 172.21.15.104:0/2508085479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e500369d0 0x7f1e50033b40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.994 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f1e5ed01640 1 -- 172.21.15.104:0/2508085479 >> 172.21.15.104:0/2508085479 conn(0x7f1e5003a8e0 msgr2=0x7f1e50006540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:31.994 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f1e5ed01640 1 -- 172.21.15.104:0/2508085479 shutdown_connections 2023-09-13T02:12:31.995 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.987+0000 7f1e5ed01640 1 -- 172.21.15.104:0/2508085479 wait complete. 2023-09-13T02:12:31.995 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.988+0000 7ff9d6b87640 1 -- 172.21.15.104:0/1389915943 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff9c80cc0e0 con 0x7ff9c80c8f40 2023-09-13T02:12:31.995 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.988+0000 7ff9c67fc640 1 -- 172.21.15.104:0/1389915943 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9c80cc0e0 con 0x7ff9c80c8f40 2023-09-13T02:12:31.996 INFO:teuthology.orchestra.run.smithi104.stdout:55834574856 2023-09-13T02:12:31.996 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.990+0000 7ff9d6b87640 1 -- 172.21.15.104:0/1389915943 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff9b406a4f0 msgr2=0x7ff9b406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.997 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.990+0000 7ff9d6b87640 1 --2- 172.21.15.104:0/1389915943 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff9b406a4f0 0x7ff9b406c9b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc006010 tx=0x7ff9cc0046c0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.997 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.990+0000 7ff9d6b87640 1 -- 172.21.15.104:0/1389915943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9c80c8f40 msgr2=0x7ff9c81674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:31.997 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.990+0000 7ff9d6b87640 1 --2- 172.21.15.104:0/1389915943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9c80c8f40 0x7ff9c81674e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0068880 tx=0x7ff9d0067370 comp rx=0 tx=0).stop 2023-09-13T02:12:31.997 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.991+0000 7ff9d6b87640 1 -- 172.21.15.104:0/1389915943 shutdown_connections 2023-09-13T02:12:31.997 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.991+0000 7ff9d6b87640 1 --2- 172.21.15.104:0/1389915943 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff9b406a4f0 0x7ff9b406c9b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.998 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.991+0000 7ff9d6b87640 1 --2- 172.21.15.104:0/1389915943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9c80c8f40 0x7ff9c81674e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.998 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.991+0000 7ff9d6b87640 1 --2- 172.21.15.104:0/1389915943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9c8039e80 0x7ff9c8166fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.998 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.991+0000 7ff9d6b87640 1 --2- 172.21.15.104:0/1389915943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9c8038fd0 0x7ff9c80c2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:31.998 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.991+0000 7ff9d6b87640 1 -- 172.21.15.104:0/1389915943 >> 172.21.15.104:0/1389915943 conn(0x7ff9c803a9f0 msgr2=0x7ff9c803add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:31.998 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.991+0000 7ff9d6b87640 1 -- 172.21.15.104:0/1389915943 shutdown_connections 2023-09-13T02:12:31.999 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:31.991+0000 7ff9d6b87640 1 -- 172.21.15.104:0/1389915943 wait complete. 2023-09-13T02:12:32.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-09-13T02:12:32.002 DEBUG:teuthology.parallel:result is None 2023-09-13T02:12:32.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-09-13T02:12:32.003 DEBUG:teuthology.parallel:result is None 2023-09-13T02:12:32.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-09-13T02:12:32.004 DEBUG:teuthology.parallel:result is None 2023-09-13T02:12:32.025 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.024+0000 7f0a6500d640 1 -- 172.21.15.104:0/1387376501 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0a601de930 con 0x7f0a601e2270 2023-09-13T02:12:32.025 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.024+0000 7f0a5cff9640 1 -- 172.21.15.104:0/1387376501 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a601de930 con 0x7f0a601e2270 2023-09-13T02:12:32.026 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2023-09-13T02:12:32.026 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.025+0000 7f2174e39640 1 -- 172.21.15.104:0/2466654873 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f21701449c0 con 0x7f21700af8e0 2023-09-13T02:12:32.027 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.025+0000 7f2157fff640 1 -- 172.21.15.104:0/2466654873 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f21600011a0 con 0x7f21700af8e0 2023-09-13T02:12:32.027 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2023-09-13T02:12:32.029 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.027+0000 7f0a6500d640 1 -- 172.21.15.104:0/1387376501 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0a4c06a5f0 msgr2=0x7f0a4c06cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:32.029 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.027+0000 7f0a6500d640 1 --2- 172.21.15.104:0/1387376501 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0a4c06a5f0 0x7f0a4c06cab0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0a50001840 tx=0x7f0a50009040 comp rx=0 tx=0).stop 2023-09-13T02:12:32.029 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.027+0000 7f0a6500d640 1 -- 172.21.15.104:0/1387376501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a601e2270 msgr2=0x7f0a600a8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:32.029 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.027+0000 7f0a6500d640 1 --2- 172.21.15.104:0/1387376501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a601e2270 0x7f0a600a8a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400c390 tx=0x7f0a5400c850 comp rx=0 tx=0).stop 2023-09-13T02:12:32.030 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.027+0000 7f0a6500d640 1 -- 172.21.15.104:0/1387376501 shutdown_connections 2023-09-13T02:12:32.030 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.027+0000 7f0a6500d640 1 --2- 172.21.15.104:0/1387376501 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0a4c06a5f0 0x7f0a4c06cab0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.030 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.027+0000 7f0a6500d640 1 --2- 172.21.15.104:0/1387376501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a601e2270 0x7f0a600a8a30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.030 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.027+0000 7f0a6500d640 1 --2- 172.21.15.104:0/1387376501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a600b20e0 0x7f0a601e1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.030 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.027+0000 7f0a6500d640 1 --2- 172.21.15.104:0/1387376501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a60072420 0x7f0a6013f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.031 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.027+0000 7f0a6500d640 1 -- 172.21.15.104:0/1387376501 >> 172.21.15.104:0/1387376501 conn(0x7f0a600695a0 msgr2=0x7f0a60139430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:32.031 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.028+0000 7f0a6500d640 1 -- 172.21.15.104:0/1387376501 shutdown_connections 2023-09-13T02:12:32.031 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.028+0000 7f0a6500d640 1 -- 172.21.15.104:0/1387376501 wait complete. 2023-09-13T02:12:32.032 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.028+0000 7f2174e39640 1 -- 172.21.15.104:0/2466654873 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f215c06a4f0 msgr2=0x7f215c06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:32.032 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.028+0000 7f2174e39640 1 --2- 172.21.15.104:0/2466654873 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f215c06a4f0 0x7f215c06c9b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f216403e000 tx=0x7f2164004730 comp rx=0 tx=0).stop 2023-09-13T02:12:32.032 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.028+0000 7f2174e39640 1 -- 172.21.15.104:0/2466654873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21700af8e0 msgr2=0x7f21701da710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:32.032 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.028+0000 7f2174e39640 1 --2- 172.21.15.104:0/2466654873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21700af8e0 0x7f21701da710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f216000c500 tx=0x7f216000c9c0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.033 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.028+0000 7f2174e39640 1 -- 172.21.15.104:0/2466654873 shutdown_connections 2023-09-13T02:12:32.033 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.028+0000 7f2174e39640 1 --2- 172.21.15.104:0/2466654873 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f215c06a4f0 0x7f215c06c9b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.033 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.028+0000 7f2174e39640 1 --2- 172.21.15.104:0/2466654873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2170143880 0x7f21700ac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.033 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.028+0000 7f2174e39640 1 --2- 172.21.15.104:0/2466654873 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21700b1020 0x7f217013ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.033 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.028+0000 7f2174e39640 1 --2- 172.21.15.104:0/2466654873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21700af8e0 0x7f21701da710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.034 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.028+0000 7f2174e39640 1 -- 172.21.15.104:0/2466654873 >> 172.21.15.104:0/2466654873 conn(0x7f21700b66a0 msgr2=0x7f21700b1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:32.034 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.028+0000 7f2174e39640 1 -- 172.21.15.104:0/2466654873 shutdown_connections 2023-09-13T02:12:32.034 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.028+0000 7f2174e39640 1 -- 172.21.15.104:0/2466654873 wait complete. 2023-09-13T02:12:32.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-09-13T02:12:32.045 DEBUG:teuthology.parallel:result is None 2023-09-13T02:12:32.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-09-13T02:12:32.045 DEBUG:teuthology.parallel:result is None 2023-09-13T02:12:32.046 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-13T02:12:32.046 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T02:12:32.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.186+0000 7f01c642f640 1 -- 172.21.15.104:0/2736743086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01a8003970 msgr2=0x7f01a8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:32.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.186+0000 7f01c642f640 1 --2- 172.21.15.104:0/2736743086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01a8003970 0x7f01a8003d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f01b0006fa0 tx=0x7f01a80057f0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.186+0000 7f01c642f640 1 -- 172.21.15.104:0/2736743086 shutdown_connections 2023-09-13T02:12:32.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.186+0000 7f01c642f640 1 --2- 172.21.15.104:0/2736743086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01a8003970 0x7f01a8003d90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.186+0000 7f01c642f640 1 -- 172.21.15.104:0/2736743086 >> 172.21.15.104:0/2736743086 conn(0x7f01c00b67f0 msgr2=0x7f01c00b6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:32.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.186+0000 7f01c642f640 1 -- 172.21.15.104:0/2736743086 shutdown_connections 2023-09-13T02:12:32.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.186+0000 7f01c642f640 1 -- 172.21.15.104:0/2736743086 wait complete. 2023-09-13T02:12:32.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.187+0000 7f01c642f640 1 Processor -- start 2023-09-13T02:12:32.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.187+0000 7f01c642f640 1 -- start start 2023-09-13T02:12:32.193 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.187+0000 7f01c642f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01a8003970 0x7f01c0144660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:32.193 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.187+0000 7f01c642f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01c01db2b0 0x7f01c01db710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:32.193 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.187+0000 7f01c642f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01c0137cd0 0x7f01c0138150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:32.193 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.187+0000 7f01c642f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c01dbc50 con 0x7f01a8003970 2023-09-13T02:12:32.194 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.187+0000 7f01c642f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c013db20 con 0x7f01c0137cd0 2023-09-13T02:12:32.194 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.187+0000 7f01c642f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c0144d30 con 0x7f01c01db2b0 2023-09-13T02:12:32.194 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.187+0000 7f01bffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01a8003970 0x7f01c0144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:32.194 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.187+0000 7f01bffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01a8003970 0x7f01c0144660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47468/0 (socket says 172.21.15.104:47468) 2023-09-13T02:12:32.195 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.187+0000 7f01bffff640 1 -- 172.21.15.104:0/2662102853 learned_addr learned my addr 172.21.15.104:0/2662102853 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:32.195 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.188+0000 7f01bf7fe640 1 --2- 172.21.15.104:0/2662102853 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01c01db2b0 0x7f01c01db710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:32.195 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.188+0000 7f01c49cc640 1 --2- 172.21.15.104:0/2662102853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01c0137cd0 0x7f01c0138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:32.195 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.188+0000 7f01bffff640 1 -- 172.21.15.104:0/2662102853 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01c01db2b0 msgr2=0x7f01c01db710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:32.196 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.188+0000 7f01bffff640 1 --2- 172.21.15.104:0/2662102853 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01c01db2b0 0x7f01c01db710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.196 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.188+0000 7f01bffff640 1 -- 172.21.15.104:0/2662102853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01c0137cd0 msgr2=0x7f01c0138150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:32.196 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.188+0000 7f01bffff640 1 --2- 172.21.15.104:0/2662102853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01c0137cd0 0x7f01c0138150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.196 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.188+0000 7f01bffff640 1 -- 172.21.15.104:0/2662102853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c01dad90 con 0x7f01a8003970 2023-09-13T02:12:32.197 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.188+0000 7f01bffff640 1 --2- 172.21.15.104:0/2662102853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01a8003970 0x7f01c0144660 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f01b000c320 tx=0x7f01b0001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:32.197 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.188+0000 7f01bcff9640 1 -- 172.21.15.104:0/2662102853 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0006230 con 0x7f01a8003970 2023-09-13T02:12:32.197 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.188+0000 7f01bcff9640 1 -- 172.21.15.104:0/2662102853 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f01b0006390 con 0x7f01a8003970 2023-09-13T02:12:32.197 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.188+0000 7f01c642f640 1 -- 172.21.15.104:0/2662102853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c013d840 con 0x7f01a8003970 2023-09-13T02:12:32.197 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.188+0000 7f01bcff9640 1 -- 172.21.15.104:0/2662102853 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b00035f0 con 0x7f01a8003970 2023-09-13T02:12:32.198 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.188+0000 7f01c642f640 1 -- 172.21.15.104:0/2662102853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c013c9d0 con 0x7f01a8003970 2023-09-13T02:12:32.198 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.189+0000 7f01c642f640 1 -- 172.21.15.104:0/2662102853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c0144e70 con 0x7f01a8003970 2023-09-13T02:12:32.198 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.190+0000 7f01bcff9640 1 -- 172.21.15.104:0/2662102853 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f01b0031030 con 0x7f01a8003970 2023-09-13T02:12:32.198 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.190+0000 7f01bcff9640 1 --2- 172.21.15.104:0/2662102853 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f01ac06a4f0 0x7f01ac06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:32.198 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.190+0000 7f01bf7fe640 1 --2- 172.21.15.104:0/2662102853 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f01ac06a4f0 0x7f01ac06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:32.199 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.190+0000 7f01bcff9640 1 -- 172.21.15.104:0/2662102853 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01b00a9970 con 0x7f01a8003970 2023-09-13T02:12:32.199 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.191+0000 7f01bf7fe640 1 --2- 172.21.15.104:0/2662102853 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f01ac06a4f0 0x7f01ac06c9b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f01c01cdb10 tx=0x7f01b4005f90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:32.200 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.194+0000 7f01bcff9640 1 -- 172.21.15.104:0/2662102853 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f01c0144e70 con 0x7f01a8003970 2023-09-13T02:12:32.358 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.357+0000 7f01c642f640 1 -- 172.21.15.104:0/2662102853 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01c0145650 con 0x7f01ac06a4f0 2023-09-13T02:12:32.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.363+0000 7f01bcff9640 1 -- 172.21.15.104:0/2662102853 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264520 (secure 0 0 0) 0x7f01b4013a30 con 0x7f01ac06a4f0 2023-09-13T02:12:32.367 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:32.369 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2023-09-13T02:12:32.371 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.367+0000 7f01c642f640 1 -- 172.21.15.104:0/2662102853 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f01ac06a4f0 msgr2=0x7f01ac06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:32.371 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.367+0000 7f01c642f640 1 --2- 172.21.15.104:0/2662102853 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f01ac06a4f0 0x7f01ac06c9b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f01c01cdb10 tx=0x7f01b4005f90 comp rx=0 tx=0).stop 2023-09-13T02:12:32.371 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.367+0000 7f01c642f640 1 -- 172.21.15.104:0/2662102853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01a8003970 msgr2=0x7f01c0144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:32.371 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.367+0000 7f01c642f640 1 --2- 172.21.15.104:0/2662102853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01a8003970 0x7f01c0144660 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f01b000c320 tx=0x7f01b0001700 comp rx=0 tx=0).stop 2023-09-13T02:12:32.372 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.367+0000 7f01c642f640 1 -- 172.21.15.104:0/2662102853 shutdown_connections 2023-09-13T02:12:32.372 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.367+0000 7f01c642f640 1 --2- 172.21.15.104:0/2662102853 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f01ac06a4f0 0x7f01ac06c9b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.372 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.367+0000 7f01c642f640 1 --2- 172.21.15.104:0/2662102853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01c0137cd0 0x7f01c0138150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.372 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.367+0000 7f01c642f640 1 --2- 172.21.15.104:0/2662102853 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01c01db2b0 0x7f01c01db710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.372 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.367+0000 7f01c642f640 1 --2- 172.21.15.104:0/2662102853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01a8003970 0x7f01c0144660 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.373 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.367+0000 7f01c642f640 1 -- 172.21.15.104:0/2662102853 >> 172.21.15.104:0/2662102853 conn(0x7f01c00b67f0 msgr2=0x7f01c0140880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:32.373 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.367+0000 7f01c642f640 1 -- 172.21.15.104:0/2662102853 shutdown_connections 2023-09-13T02:12:32.373 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.367+0000 7f01c642f640 1 -- 172.21.15.104:0/2662102853 wait complete. 2023-09-13T02:12:32.378 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-09-13T02:12:32.032157+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2887680,"data_stored":1751721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001698"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258274+0000","last_change":"2023-09-13T02:12:24.593673+0000","last_active":"2023-09-13T02:12:26.258274+0000","last_peered":"2023-09-13T02:12:26.258274+0000","last_clean":"2023-09-13T02:12:26.258274+0000","last_became_active":"2023-09-13T02:12:24.592754+0000","last_became_peered":"2023-09-13T02:12:24.592754+0000","last_unstale":"2023-09-13T02:12:26.258274+0000","last_undegraded":"2023-09-13T02:12:26.258274+0000","last_fullsized":"2023-09-13T02:12:26.258274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:43:34.341442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578839+0000","last_change":"2023-09-13T02:12:24.580108+0000","last_active":"2023-09-13T02:12:25.578839+0000","last_peered":"2023-09-13T02:12:25.578839+0000","last_clean":"2023-09-13T02:12:25.578839+0000","last_became_active":"2023-09-13T02:12:24.579873+0000","last_became_peered":"2023-09-13T02:12:24.579873+0000","last_unstale":"2023-09-13T02:12:25.578839+0000","last_undegraded":"2023-09-13T02:12:25.578839+0000","last_fullsized":"2023-09-13T02:12:25.578839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607687+0000","last_change":"2023-09-13T02:12:24.584533+0000","last_active":"2023-09-13T02:12:25.607687+0000","last_peered":"2023-09-13T02:12:25.607687+0000","last_clean":"2023-09-13T02:12:25.607687+0000","last_became_active":"2023-09-13T02:12:24.584249+0000","last_became_peered":"2023-09-13T02:12:24.584249+0000","last_unstale":"2023-09-13T02:12:25.607687+0000","last_undegraded":"2023-09-13T02:12:25.607687+0000","last_fullsized":"2023-09-13T02:12:25.607687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658105+0000","last_change":"2023-09-13T02:12:24.596092+0000","last_active":"2023-09-13T02:12:25.658105+0000","last_peered":"2023-09-13T02:12:25.658105+0000","last_clean":"2023-09-13T02:12:25.658105+0000","last_became_active":"2023-09-13T02:12:24.595817+0000","last_became_peered":"2023-09-13T02:12:24.595817+0000","last_unstale":"2023-09-13T02:12:25.658105+0000","last_undegraded":"2023-09-13T02:12:25.658105+0000","last_fullsized":"2023-09-13T02:12:25.658105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:15.246952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257924+0000","last_change":"2023-09-13T02:12:24.592410+0000","last_active":"2023-09-13T02:12:26.257924+0000","last_peered":"2023-09-13T02:12:26.257924+0000","last_clean":"2023-09-13T02:12:26.257924+0000","last_became_active":"2023-09-13T02:12:24.591503+0000","last_became_peered":"2023-09-13T02:12:24.591503+0000","last_unstale":"2023-09-13T02:12:26.257924+0000","last_undegraded":"2023-09-13T02:12:26.257924+0000","last_fullsized":"2023-09-13T02:12:26.257924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:43:26.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657920+0000","last_change":"2023-09-13T02:12:24.594084+0000","last_active":"2023-09-13T02:12:25.657920+0000","last_peered":"2023-09-13T02:12:25.657920+0000","last_clean":"2023-09-13T02:12:25.657920+0000","last_became_active":"2023-09-13T02:12:24.592530+0000","last_became_peered":"2023-09-13T02:12:24.592530+0000","last_unstale":"2023-09-13T02:12:25.657920+0000","last_undegraded":"2023-09-13T02:12:25.657920+0000","last_fullsized":"2023-09-13T02:12:25.657920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257688+0000","last_change":"2023-09-13T02:12:24.591304+0000","last_active":"2023-09-13T02:12:26.257688+0000","last_peered":"2023-09-13T02:12:26.257688+0000","last_clean":"2023-09-13T02:12:26.257688+0000","last_became_active":"2023-09-13T02:12:24.590654+0000","last_became_peered":"2023-09-13T02:12:24.590654+0000","last_unstale":"2023-09-13T02:12:26.257688+0000","last_undegraded":"2023-09-13T02:12:26.257688+0000","last_fullsized":"2023-09-13T02:12:26.257688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:15.246952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.758902+0000","last_change":"2023-09-13T02:12:24.588844+0000","last_active":"2023-09-13T02:12:25.758902+0000","last_peered":"2023-09-13T02:12:25.758902+0000","last_clean":"2023-09-13T02:12:25.758902+0000","last_became_active":"2023-09-13T02:12:24.588438+0000","last_became_peered":"2023-09-13T02:12:24.588438+0000","last_unstale":"2023-09-13T02:12:25.758902+0000","last_undegraded":"2023-09-13T02:12:25.758902+0000","last_fullsized":"2023-09-13T02:12:25.758902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:37.796406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258329+0000","last_change":"2023-09-13T02:12:24.589946+0000","last_active":"2023-09-13T02:12:26.258329+0000","last_peered":"2023-09-13T02:12:26.258329+0000","last_clean":"2023-09-13T02:12:26.258329+0000","last_became_active":"2023-09-13T02:12:24.589606+0000","last_became_peered":"2023-09-13T02:12:24.589606+0000","last_unstale":"2023-09-13T02:12:26.258329+0000","last_undegraded":"2023-09-13T02:12:26.258329+0000","last_fullsized":"2023-09-13T02:12:26.258329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:41.609166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757491+0000","last_change":"2023-09-13T02:12:24.588874+0000","last_active":"2023-09-13T02:12:25.757491+0000","last_peered":"2023-09-13T02:12:25.757491+0000","last_clean":"2023-09-13T02:12:25.757491+0000","last_became_active":"2023-09-13T02:12:24.588522+0000","last_became_peered":"2023-09-13T02:12:24.588522+0000","last_unstale":"2023-09-13T02:12:25.757491+0000","last_undegraded":"2023-09-13T02:12:25.757491+0000","last_fullsized":"2023-09-13T02:12:25.757491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757356+0000","last_change":"2023-09-13T02:12:24.589173+0000","last_active":"2023-09-13T02:12:25.757356+0000","last_peered":"2023-09-13T02:12:25.757356+0000","last_clean":"2023-09-13T02:12:25.757356+0000","last_became_active":"2023-09-13T02:12:24.588891+0000","last_became_peered":"2023-09-13T02:12:24.588891+0000","last_unstale":"2023-09-13T02:12:25.757356+0000","last_undegraded":"2023-09-13T02:12:25.757356+0000","last_fullsized":"2023-09-13T02:12:25.757356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579243+0000","last_change":"2023-09-13T02:12:24.587494+0000","last_active":"2023-09-13T02:12:25.579243+0000","last_peered":"2023-09-13T02:12:25.579243+0000","last_clean":"2023-09-13T02:12:25.579243+0000","last_became_active":"2023-09-13T02:12:24.587023+0000","last_became_peered":"2023-09-13T02:12:24.587023+0000","last_unstale":"2023-09-13T02:12:25.579243+0000","last_undegraded":"2023-09-13T02:12:25.579243+0000","last_fullsized":"2023-09-13T02:12:25.579243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:41.175280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759132+0000","last_change":"2023-09-13T02:12:24.588000+0000","last_active":"2023-09-13T02:12:25.759132+0000","last_peered":"2023-09-13T02:12:25.759132+0000","last_clean":"2023-09-13T02:12:25.759132+0000","last_became_active":"2023-09-13T02:12:24.587730+0000","last_became_peered":"2023-09-13T02:12:24.587730+0000","last_unstale":"2023-09-13T02:12:25.759132+0000","last_undegraded":"2023-09-13T02:12:25.759132+0000","last_fullsized":"2023-09-13T02:12:25.759132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607517+0000","last_change":"2023-09-13T02:12:24.584985+0000","last_active":"2023-09-13T02:12:25.607517+0000","last_peered":"2023-09-13T02:12:25.607517+0000","last_clean":"2023-09-13T02:12:25.607517+0000","last_became_active":"2023-09-13T02:12:24.584734+0000","last_became_peered":"2023-09-13T02:12:24.584734+0000","last_unstale":"2023-09-13T02:12:25.607517+0000","last_undegraded":"2023-09-13T02:12:25.607517+0000","last_fullsized":"2023-09-13T02:12:25.607517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:37.796406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578570+0000","last_change":"2023-09-13T02:12:24.578832+0000","last_active":"2023-09-13T02:12:25.578570+0000","last_peered":"2023-09-13T02:12:25.578570+0000","last_clean":"2023-09-13T02:12:25.578570+0000","last_became_active":"2023-09-13T02:12:24.578553+0000","last_became_peered":"2023-09-13T02:12:24.578553+0000","last_unstale":"2023-09-13T02:12:25.578570+0000","last_undegraded":"2023-09-13T02:12:25.578570+0000","last_fullsized":"2023-09-13T02:12:25.578570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657829+0000","last_change":"2023-09-13T02:12:24.591151+0000","last_active":"2023-09-13T02:12:25.657829+0000","last_peered":"2023-09-13T02:12:25.657829+0000","last_clean":"2023-09-13T02:12:25.657829+0000","last_became_active":"2023-09-13T02:12:24.590871+0000","last_became_peered":"2023-09-13T02:12:24.590871+0000","last_unstale":"2023-09-13T02:12:25.657829+0000","last_undegraded":"2023-09-13T02:12:25.657829+0000","last_fullsized":"2023-09-13T02:12:25.657829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658468+0000","last_change":"2023-09-13T02:12:24.592615+0000","last_active":"2023-09-13T02:12:25.658468+0000","last_peered":"2023-09-13T02:12:25.658468+0000","last_clean":"2023-09-13T02:12:25.658468+0000","last_became_active":"2023-09-13T02:12:24.592325+0000","last_became_peered":"2023-09-13T02:12:24.592325+0000","last_unstale":"2023-09-13T02:12:25.658468+0000","last_undegraded":"2023-09-13T02:12:25.658468+0000","last_fullsized":"2023-09-13T02:12:25.658468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:19:41.872878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575609+0000","last_change":"2023-09-13T02:12:24.587859+0000","last_active":"2023-09-13T02:12:25.575609+0000","last_peered":"2023-09-13T02:12:25.575609+0000","last_clean":"2023-09-13T02:12:25.575609+0000","last_became_active":"2023-09-13T02:12:24.587552+0000","last_became_peered":"2023-09-13T02:12:24.587552+0000","last_unstale":"2023-09-13T02:12:25.575609+0000","last_undegraded":"2023-09-13T02:12:25.575609+0000","last_fullsized":"2023-09-13T02:12:25.575609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:39.029452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258196+0000","last_change":"2023-09-13T02:12:24.591593+0000","last_active":"2023-09-13T02:12:26.258196+0000","last_peered":"2023-09-13T02:12:26.258196+0000","last_clean":"2023-09-13T02:12:26.258196+0000","last_became_active":"2023-09-13T02:12:24.590670+0000","last_became_peered":"2023-09-13T02:12:24.590670+0000","last_unstale":"2023-09-13T02:12:26.258196+0000","last_undegraded":"2023-09-13T02:12:26.258196+0000","last_fullsized":"2023-09-13T02:12:26.258196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:19:41.872878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757332+0000","last_change":"2023-09-13T02:12:24.593278+0000","last_active":"2023-09-13T02:12:25.757332+0000","last_peered":"2023-09-13T02:12:25.757332+0000","last_clean":"2023-09-13T02:12:25.757332+0000","last_became_active":"2023-09-13T02:12:24.591065+0000","last_became_peered":"2023-09-13T02:12:24.591065+0000","last_unstale":"2023-09-13T02:12:25.757332+0000","last_undegraded":"2023-09-13T02:12:25.757332+0000","last_fullsized":"2023-09-13T02:12:25.757332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607717+0000","last_change":"2023-09-13T02:12:24.587352+0000","last_active":"2023-09-13T02:12:25.607717+0000","last_peered":"2023-09-13T02:12:25.607717+0000","last_clean":"2023-09-13T02:12:25.607717+0000","last_became_active":"2023-09-13T02:12:24.586981+0000","last_became_peered":"2023-09-13T02:12:24.586981+0000","last_unstale":"2023-09-13T02:12:25.607717+0000","last_undegraded":"2023-09-13T02:12:25.607717+0000","last_fullsized":"2023-09-13T02:12:25.607717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657949+0000","last_change":"2023-09-13T02:12:24.595423+0000","last_active":"2023-09-13T02:12:25.657949+0000","last_peered":"2023-09-13T02:12:25.657949+0000","last_clean":"2023-09-13T02:12:25.657949+0000","last_became_active":"2023-09-13T02:12:24.594351+0000","last_became_peered":"2023-09-13T02:12:24.594351+0000","last_unstale":"2023-09-13T02:12:25.657949+0000","last_undegraded":"2023-09-13T02:12:25.657949+0000","last_fullsized":"2023-09-13T02:12:25.657949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:18.256464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.758931+0000","last_change":"2023-09-13T02:12:24.590553+0000","last_active":"2023-09-13T02:12:25.758931+0000","last_peered":"2023-09-13T02:12:25.758931+0000","last_clean":"2023-09-13T02:12:25.758931+0000","last_became_active":"2023-09-13T02:12:24.590295+0000","last_became_peered":"2023-09-13T02:12:24.590295+0000","last_unstale":"2023-09-13T02:12:25.758931+0000","last_undegraded":"2023-09-13T02:12:25.758931+0000","last_fullsized":"2023-09-13T02:12:25.758931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657922+0000","last_change":"2023-09-13T02:12:24.593925+0000","last_active":"2023-09-13T02:12:25.657922+0000","last_peered":"2023-09-13T02:12:25.657922+0000","last_clean":"2023-09-13T02:12:25.657922+0000","last_became_active":"2023-09-13T02:12:24.593673+0000","last_became_peered":"2023-09-13T02:12:24.593673+0000","last_unstale":"2023-09-13T02:12:25.657922+0000","last_undegraded":"2023-09-13T02:12:25.657922+0000","last_fullsized":"2023-09-13T02:12:25.657922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759249+0000","last_change":"2023-09-13T02:12:24.590496+0000","last_active":"2023-09-13T02:12:25.759249+0000","last_peered":"2023-09-13T02:12:25.759249+0000","last_clean":"2023-09-13T02:12:25.759249+0000","last_became_active":"2023-09-13T02:12:24.590231+0000","last_became_peered":"2023-09-13T02:12:24.590231+0000","last_unstale":"2023-09-13T02:12:25.759249+0000","last_undegraded":"2023-09-13T02:12:25.759249+0000","last_fullsized":"2023-09-13T02:12:25.759249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757555+0000","last_change":"2023-09-13T02:12:24.590251+0000","last_active":"2023-09-13T02:12:25.757555+0000","last_peered":"2023-09-13T02:12:25.757555+0000","last_clean":"2023-09-13T02:12:25.757555+0000","last_became_active":"2023-09-13T02:12:24.589975+0000","last_became_peered":"2023-09-13T02:12:24.589975+0000","last_unstale":"2023-09-13T02:12:25.757555+0000","last_undegraded":"2023-09-13T02:12:25.757555+0000","last_fullsized":"2023-09-13T02:12:25.757555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578681+0000","last_change":"2023-09-13T02:12:24.584028+0000","last_active":"2023-09-13T02:12:25.578681+0000","last_peered":"2023-09-13T02:12:25.578681+0000","last_clean":"2023-09-13T02:12:25.578681+0000","last_became_active":"2023-09-13T02:12:24.583782+0000","last_became_peered":"2023-09-13T02:12:24.583782+0000","last_unstale":"2023-09-13T02:12:25.578681+0000","last_undegraded":"2023-09-13T02:12:25.578681+0000","last_fullsized":"2023-09-13T02:12:25.578681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759313+0000","last_change":"2023-09-13T02:12:24.590548+0000","last_active":"2023-09-13T02:12:25.759313+0000","last_peered":"2023-09-13T02:12:25.759313+0000","last_clean":"2023-09-13T02:12:25.759313+0000","last_became_active":"2023-09-13T02:12:24.590189+0000","last_became_peered":"2023-09-13T02:12:24.590189+0000","last_unstale":"2023-09-13T02:12:25.759313+0000","last_undegraded":"2023-09-13T02:12:25.759313+0000","last_fullsized":"2023-09-13T02:12:25.759313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607812+0000","last_change":"2023-09-13T02:12:24.583749+0000","last_active":"2023-09-13T02:12:25.607812+0000","last_peered":"2023-09-13T02:12:25.607812+0000","last_clean":"2023-09-13T02:12:25.607812+0000","last_became_active":"2023-09-13T02:12:24.583453+0000","last_became_peered":"2023-09-13T02:12:24.583453+0000","last_unstale":"2023-09-13T02:12:25.607812+0000","last_undegraded":"2023-09-13T02:12:25.607812+0000","last_fullsized":"2023-09-13T02:12:25.607812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658110+0000","last_change":"2023-09-13T02:12:24.595007+0000","last_active":"2023-09-13T02:12:25.658110+0000","last_peered":"2023-09-13T02:12:25.658110+0000","last_clean":"2023-09-13T02:12:25.658110+0000","last_became_active":"2023-09-13T02:12:24.592875+0000","last_became_peered":"2023-09-13T02:12:24.592875+0000","last_unstale":"2023-09-13T02:12:25.658110+0000","last_undegraded":"2023-09-13T02:12:25.658110+0000","last_fullsized":"2023-09-13T02:12:25.658110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575574+0000","last_change":"2023-09-13T02:12:24.588586+0000","last_active":"2023-09-13T02:12:25.575574+0000","last_peered":"2023-09-13T02:12:25.575574+0000","last_clean":"2023-09-13T02:12:25.575574+0000","last_became_active":"2023-09-13T02:12:24.588173+0000","last_became_peered":"2023-09-13T02:12:24.588173+0000","last_unstale":"2023-09-13T02:12:25.575574+0000","last_undegraded":"2023-09-13T02:12:25.575574+0000","last_fullsized":"2023-09-13T02:12:25.575574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:50.824236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757216+0000","last_change":"2023-09-13T02:12:24.590981+0000","last_active":"2023-09-13T02:12:25.757216+0000","last_peered":"2023-09-13T02:12:25.757216+0000","last_clean":"2023-09-13T02:12:25.757216+0000","last_became_active":"2023-09-13T02:12:24.590677+0000","last_became_peered":"2023-09-13T02:12:24.590677+0000","last_unstale":"2023-09-13T02:12:25.757216+0000","last_undegraded":"2023-09-13T02:12:25.757216+0000","last_fullsized":"2023-09-13T02:12:25.757216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579025+0000","last_change":"2023-09-13T02:12:24.586738+0000","last_active":"2023-09-13T02:12:25.579025+0000","last_peered":"2023-09-13T02:12:25.579025+0000","last_clean":"2023-09-13T02:12:25.579025+0000","last_became_active":"2023-09-13T02:12:24.586251+0000","last_became_peered":"2023-09-13T02:12:24.586251+0000","last_unstale":"2023-09-13T02:12:25.579025+0000","last_undegraded":"2023-09-13T02:12:25.579025+0000","last_fullsized":"2023-09-13T02:12:25.579025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:25.830036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759212+0000","last_change":"2023-09-13T02:12:23.579164+0000","last_active":"2023-09-13T02:12:25.759212+0000","last_peered":"2023-09-13T02:12:25.759212+0000","last_clean":"2023-09-13T02:12:25.759212+0000","last_became_active":"2023-09-13T02:12:23.578889+0000","last_became_peered":"2023-09-13T02:12:23.578889+0000","last_unstale":"2023-09-13T02:12:25.759212+0000","last_undegraded":"2023-09-13T02:12:25.759212+0000","last_fullsized":"2023-09-13T02:12:25.759212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607827+0000","last_change":"2023-09-13T02:12:24.579559+0000","last_active":"2023-09-13T02:12:25.607827+0000","last_peered":"2023-09-13T02:12:25.607827+0000","last_clean":"2023-09-13T02:12:25.607827+0000","last_became_active":"2023-09-13T02:12:24.579243+0000","last_became_peered":"2023-09-13T02:12:24.579243+0000","last_unstale":"2023-09-13T02:12:25.607827+0000","last_undegraded":"2023-09-13T02:12:25.607827+0000","last_fullsized":"2023-09-13T02:12:25.607827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757122+0000","last_change":"2023-09-13T02:12:23.577022+0000","last_active":"2023-09-13T02:12:25.757122+0000","last_peered":"2023-09-13T02:12:25.757122+0000","last_clean":"2023-09-13T02:12:25.757122+0000","last_became_active":"2023-09-13T02:12:23.576754+0000","last_became_peered":"2023-09-13T02:12:23.576754+0000","last_unstale":"2023-09-13T02:12:25.757122+0000","last_undegraded":"2023-09-13T02:12:25.757122+0000","last_fullsized":"2023-09-13T02:12:25.757122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:49.820358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.758996+0000","last_change":"2023-09-13T02:12:23.579634+0000","last_active":"2023-09-13T02:12:25.758996+0000","last_peered":"2023-09-13T02:12:25.758996+0000","last_clean":"2023-09-13T02:12:25.758996+0000","last_became_active":"2023-09-13T02:12:23.579351+0000","last_became_peered":"2023-09-13T02:12:23.579351+0000","last_unstale":"2023-09-13T02:12:25.758996+0000","last_undegraded":"2023-09-13T02:12:25.758996+0000","last_fullsized":"2023-09-13T02:12:25.758996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:24.826159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.758949+0000","last_change":"2023-09-13T02:12:24.590474+0000","last_active":"2023-09-13T02:12:25.758949+0000","last_peered":"2023-09-13T02:12:25.758949+0000","last_clean":"2023-09-13T02:12:25.758949+0000","last_became_active":"2023-09-13T02:12:24.590126+0000","last_became_peered":"2023-09-13T02:12:24.590126+0000","last_unstale":"2023-09-13T02:12:25.758949+0000","last_undegraded":"2023-09-13T02:12:25.758949+0000","last_fullsized":"2023-09-13T02:12:25.758949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657959+0000","last_change":"2023-09-13T02:12:23.586264+0000","last_active":"2023-09-13T02:12:25.657959+0000","last_peered":"2023-09-13T02:12:25.657959+0000","last_clean":"2023-09-13T02:12:25.657959+0000","last_became_active":"2023-09-13T02:12:23.585953+0000","last_became_peered":"2023-09-13T02:12:23.585953+0000","last_unstale":"2023-09-13T02:12:25.657959+0000","last_undegraded":"2023-09-13T02:12:25.657959+0000","last_fullsized":"2023-09-13T02:12:25.657959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:27.359818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578575+0000","last_change":"2023-09-13T02:12:24.585138+0000","last_active":"2023-09-13T02:12:25.578575+0000","last_peered":"2023-09-13T02:12:25.578575+0000","last_clean":"2023-09-13T02:12:25.578575+0000","last_became_active":"2023-09-13T02:12:24.584901+0000","last_became_peered":"2023-09-13T02:12:24.584901+0000","last_unstale":"2023-09-13T02:12:25.578575+0000","last_undegraded":"2023-09-13T02:12:25.578575+0000","last_fullsized":"2023-09-13T02:12:25.578575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757459+0000","last_change":"2023-09-13T02:12:23.583663+0000","last_active":"2023-09-13T02:12:25.757459+0000","last_peered":"2023-09-13T02:12:25.757459+0000","last_clean":"2023-09-13T02:12:25.757459+0000","last_became_active":"2023-09-13T02:12:23.583305+0000","last_became_peered":"2023-09-13T02:12:23.583305+0000","last_unstale":"2023-09-13T02:12:25.757459+0000","last_undegraded":"2023-09-13T02:12:25.757459+0000","last_fullsized":"2023-09-13T02:12:25.757459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:32.660244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658293+0000","last_change":"2023-09-13T02:12:24.595264+0000","last_active":"2023-09-13T02:12:25.658293+0000","last_peered":"2023-09-13T02:12:25.658293+0000","last_clean":"2023-09-13T02:12:25.658293+0000","last_became_active":"2023-09-13T02:12:24.594434+0000","last_became_peered":"2023-09-13T02:12:24.594434+0000","last_unstale":"2023-09-13T02:12:25.658293+0000","last_undegraded":"2023-09-13T02:12:25.658293+0000","last_fullsized":"2023-09-13T02:12:25.658293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:17:30.897344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658326+0000","last_change":"2023-09-13T02:12:23.584935+0000","last_active":"2023-09-13T02:12:25.658326+0000","last_peered":"2023-09-13T02:12:25.658326+0000","last_clean":"2023-09-13T02:12:25.658326+0000","last_became_active":"2023-09-13T02:12:23.584657+0000","last_became_peered":"2023-09-13T02:12:23.584657+0000","last_unstale":"2023-09-13T02:12:25.658326+0000","last_undegraded":"2023-09-13T02:12:25.658326+0000","last_fullsized":"2023-09-13T02:12:25.658326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:36.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607761+0000","last_change":"2023-09-13T02:12:24.588694+0000","last_active":"2023-09-13T02:12:25.607761+0000","last_peered":"2023-09-13T02:12:25.607761+0000","last_clean":"2023-09-13T02:12:25.607761+0000","last_became_active":"2023-09-13T02:12:24.588455+0000","last_became_peered":"2023-09-13T02:12:24.588455+0000","last_unstale":"2023-09-13T02:12:25.607761+0000","last_undegraded":"2023-09-13T02:12:25.607761+0000","last_fullsized":"2023-09-13T02:12:25.607761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578696+0000","last_change":"2023-09-13T02:12:23.582781+0000","last_active":"2023-09-13T02:12:25.578696+0000","last_peered":"2023-09-13T02:12:25.578696+0000","last_clean":"2023-09-13T02:12:25.578696+0000","last_became_active":"2023-09-13T02:12:23.582506+0000","last_became_peered":"2023-09-13T02:12:23.582506+0000","last_unstale":"2023-09-13T02:12:25.578696+0000","last_undegraded":"2023-09-13T02:12:25.578696+0000","last_fullsized":"2023-09-13T02:12:25.578696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:03.890491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579403+0000","last_change":"2023-09-13T02:12:24.594514+0000","last_active":"2023-09-13T02:12:25.579403+0000","last_peered":"2023-09-13T02:12:25.579403+0000","last_clean":"2023-09-13T02:12:25.579403+0000","last_became_active":"2023-09-13T02:12:24.592367+0000","last_became_peered":"2023-09-13T02:12:24.592367+0000","last_unstale":"2023-09-13T02:12:25.579403+0000","last_undegraded":"2023-09-13T02:12:25.579403+0000","last_fullsized":"2023-09-13T02:12:25.579403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:08.045218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757371+0000","last_change":"2023-09-13T02:12:23.579000+0000","last_active":"2023-09-13T02:12:25.757371+0000","last_peered":"2023-09-13T02:12:25.757371+0000","last_clean":"2023-09-13T02:12:25.757371+0000","last_became_active":"2023-09-13T02:12:23.578748+0000","last_became_peered":"2023-09-13T02:12:23.578748+0000","last_unstale":"2023-09-13T02:12:25.757371+0000","last_undegraded":"2023-09-13T02:12:25.757371+0000","last_fullsized":"2023-09-13T02:12:25.757371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:38.025574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257924+0000","last_change":"2023-09-13T02:12:24.593514+0000","last_active":"2023-09-13T02:12:26.257924+0000","last_peered":"2023-09-13T02:12:26.257924+0000","last_clean":"2023-09-13T02:12:26.257924+0000","last_became_active":"2023-09-13T02:12:24.593092+0000","last_became_peered":"2023-09-13T02:12:24.593092+0000","last_unstale":"2023-09-13T02:12:26.257924+0000","last_undegraded":"2023-09-13T02:12:26.257924+0000","last_fullsized":"2023-09-13T02:12:26.257924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:18:08.378805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607886+0000","last_change":"2023-09-13T02:12:23.579348+0000","last_active":"2023-09-13T02:12:25.607886+0000","last_peered":"2023-09-13T02:12:25.607886+0000","last_clean":"2023-09-13T02:12:25.607886+0000","last_became_active":"2023-09-13T02:12:23.579079+0000","last_became_peered":"2023-09-13T02:12:23.579079+0000","last_unstale":"2023-09-13T02:12:25.607886+0000","last_undegraded":"2023-09-13T02:12:25.607886+0000","last_fullsized":"2023-09-13T02:12:25.607886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:07.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607669+0000","last_change":"2023-09-13T02:12:24.587235+0000","last_active":"2023-09-13T02:12:25.607669+0000","last_peered":"2023-09-13T02:12:25.607669+0000","last_clean":"2023-09-13T02:12:25.607669+0000","last_became_active":"2023-09-13T02:12:24.586930+0000","last_became_peered":"2023-09-13T02:12:24.586930+0000","last_unstale":"2023-09-13T02:12:25.607669+0000","last_undegraded":"2023-09-13T02:12:25.607669+0000","last_fullsized":"2023-09-13T02:12:25.607669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658035+0000","last_change":"2023-09-13T02:12:23.585680+0000","last_active":"2023-09-13T02:12:25.658035+0000","last_peered":"2023-09-13T02:12:25.658035+0000","last_clean":"2023-09-13T02:12:25.658035+0000","last_became_active":"2023-09-13T02:12:23.585417+0000","last_became_peered":"2023-09-13T02:12:23.585417+0000","last_unstale":"2023-09-13T02:12:25.658035+0000","last_undegraded":"2023-09-13T02:12:25.658035+0000","last_fullsized":"2023-09-13T02:12:25.658035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:03.890491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257950+0000","last_change":"2023-09-13T02:12:24.592703+0000","last_active":"2023-09-13T02:12:26.257950+0000","last_peered":"2023-09-13T02:12:26.257950+0000","last_clean":"2023-09-13T02:12:26.257950+0000","last_became_active":"2023-09-13T02:12:24.591849+0000","last_became_peered":"2023-09-13T02:12:24.591849+0000","last_unstale":"2023-09-13T02:12:26.257950+0000","last_undegraded":"2023-09-13T02:12:26.257950+0000","last_fullsized":"2023-09-13T02:12:26.257950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:17:30.897344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757127+0000","last_change":"2023-09-13T02:12:23.576659+0000","last_active":"2023-09-13T02:12:25.757127+0000","last_peered":"2023-09-13T02:12:25.757127+0000","last_clean":"2023-09-13T02:12:25.757127+0000","last_became_active":"2023-09-13T02:12:23.576022+0000","last_became_peered":"2023-09-13T02:12:23.576022+0000","last_unstale":"2023-09-13T02:12:25.757127+0000","last_undegraded":"2023-09-13T02:12:25.757127+0000","last_fullsized":"2023-09-13T02:12:25.757127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:51.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757259+0000","last_change":"2023-09-13T02:12:24.591552+0000","last_active":"2023-09-13T02:12:25.757259+0000","last_peered":"2023-09-13T02:12:25.757259+0000","last_clean":"2023-09-13T02:12:25.757259+0000","last_became_active":"2023-09-13T02:12:24.591247+0000","last_became_peered":"2023-09-13T02:12:24.591247+0000","last_unstale":"2023-09-13T02:12:25.757259+0000","last_undegraded":"2023-09-13T02:12:25.757259+0000","last_fullsized":"2023-09-13T02:12:25.757259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575456+0000","last_change":"2023-09-13T02:12:23.570753+0000","last_active":"2023-09-13T02:12:25.575456+0000","last_peered":"2023-09-13T02:12:25.575456+0000","last_clean":"2023-09-13T02:12:25.575456+0000","last_became_active":"2023-09-13T02:12:23.570461+0000","last_became_peered":"2023-09-13T02:12:23.570461+0000","last_unstale":"2023-09-13T02:12:25.575456+0000","last_undegraded":"2023-09-13T02:12:25.575456+0000","last_fullsized":"2023-09-13T02:12:25.575456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257684+0000","last_change":"2023-09-13T02:12:24.591474+0000","last_active":"2023-09-13T02:12:26.257684+0000","last_peered":"2023-09-13T02:12:26.257684+0000","last_clean":"2023-09-13T02:12:26.257684+0000","last_became_active":"2023-09-13T02:12:24.591036+0000","last_became_peered":"2023-09-13T02:12:24.591036+0000","last_unstale":"2023-09-13T02:12:26.257684+0000","last_undegraded":"2023-09-13T02:12:26.257684+0000","last_fullsized":"2023-09-13T02:12:26.257684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579539+0000","last_change":"2023-09-13T02:12:23.584508+0000","last_active":"2023-09-13T02:12:25.579539+0000","last_peered":"2023-09-13T02:12:25.579539+0000","last_clean":"2023-09-13T02:12:25.579539+0000","last_became_active":"2023-09-13T02:12:23.584235+0000","last_became_peered":"2023-09-13T02:12:23.584235+0000","last_unstale":"2023-09-13T02:12:25.579539+0000","last_undegraded":"2023-09-13T02:12:25.579539+0000","last_fullsized":"2023-09-13T02:12:25.579539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258168+0000","last_change":"2023-09-13T02:12:24.593312+0000","last_active":"2023-09-13T02:12:26.258168+0000","last_peered":"2023-09-13T02:12:26.258168+0000","last_clean":"2023-09-13T02:12:26.258168+0000","last_became_active":"2023-09-13T02:12:24.592242+0000","last_became_peered":"2023-09-13T02:12:24.592242+0000","last_unstale":"2023-09-13T02:12:26.258168+0000","last_undegraded":"2023-09-13T02:12:26.258168+0000","last_fullsized":"2023-09-13T02:12:26.258168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:03:12.365120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575647+0000","last_change":"2023-09-13T02:12:23.578204+0000","last_active":"2023-09-13T02:12:25.575647+0000","last_peered":"2023-09-13T02:12:25.575647+0000","last_clean":"2023-09-13T02:12:25.575647+0000","last_became_active":"2023-09-13T02:12:23.577918+0000","last_became_peered":"2023-09-13T02:12:23.577918+0000","last_unstale":"2023-09-13T02:12:25.575647+0000","last_undegraded":"2023-09-13T02:12:25.575647+0000","last_fullsized":"2023-09-13T02:12:25.575647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:24.826159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258382+0000","last_change":"2023-09-13T02:12:24.595748+0000","last_active":"2023-09-13T02:12:26.258382+0000","last_peered":"2023-09-13T02:12:26.258382+0000","last_clean":"2023-09-13T02:12:26.258382+0000","last_became_active":"2023-09-13T02:12:24.595462+0000","last_became_peered":"2023-09-13T02:12:24.595462+0000","last_unstale":"2023-09-13T02:12:26.258382+0000","last_undegraded":"2023-09-13T02:12:26.258382+0000","last_fullsized":"2023-09-13T02:12:26.258382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:52:10.210519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578762+0000","last_change":"2023-09-13T02:12:23.570346+0000","last_active":"2023-09-13T02:12:25.578762+0000","last_peered":"2023-09-13T02:12:25.578762+0000","last_clean":"2023-09-13T02:12:25.578762+0000","last_became_active":"2023-09-13T02:12:23.570066+0000","last_became_peered":"2023-09-13T02:12:23.570066+0000","last_unstale":"2023-09-13T02:12:25.578762+0000","last_undegraded":"2023-09-13T02:12:25.578762+0000","last_fullsized":"2023-09-13T02:12:25.578762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:36.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658261+0000","last_change":"2023-09-13T02:12:24.595650+0000","last_active":"2023-09-13T02:12:25.658261+0000","last_peered":"2023-09-13T02:12:25.658261+0000","last_clean":"2023-09-13T02:12:25.658261+0000","last_became_active":"2023-09-13T02:12:24.595327+0000","last_became_peered":"2023-09-13T02:12:24.595327+0000","last_unstale":"2023-09-13T02:12:25.658261+0000","last_undegraded":"2023-09-13T02:12:25.658261+0000","last_fullsized":"2023-09-13T02:12:25.658261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:43:26.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575622+0000","last_change":"2023-09-13T02:12:23.583113+0000","last_active":"2023-09-13T02:12:25.575622+0000","last_peered":"2023-09-13T02:12:25.575622+0000","last_clean":"2023-09-13T02:12:25.575622+0000","last_became_active":"2023-09-13T02:12:23.582841+0000","last_became_peered":"2023-09-13T02:12:23.582841+0000","last_unstale":"2023-09-13T02:12:25.575622+0000","last_undegraded":"2023-09-13T02:12:25.575622+0000","last_fullsized":"2023-09-13T02:12:25.575622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257997+0000","last_change":"2023-09-13T02:12:24.590616+0000","last_active":"2023-09-13T02:12:26.257997+0000","last_peered":"2023-09-13T02:12:26.257997+0000","last_clean":"2023-09-13T02:12:26.257997+0000","last_became_active":"2023-09-13T02:12:24.590343+0000","last_became_peered":"2023-09-13T02:12:24.590343+0000","last_unstale":"2023-09-13T02:12:26.257997+0000","last_undegraded":"2023-09-13T02:12:26.257997+0000","last_fullsized":"2023-09-13T02:12:26.257997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:15.126313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-13T02:12:24.581028+0000","last_change":"2023-09-13T02:12:13.261542+0000","last_active":"2023-09-13T02:12:24.581028+0000","last_peered":"2023-09-13T02:12:24.581028+0000","last_clean":"2023-09-13T02:12:24.581028+0000","last_became_active":"2023-09-13T02:12:13.260630+0000","last_became_peered":"2023-09-13T02:12:13.260630+0000","last_unstale":"2023-09-13T02:12:24.581028+0000","last_undegraded":"2023-09-13T02:12:24.581028+0000","last_fullsized":"2023-09-13T02:12:24.581028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:12.209844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:12.209844+0000","last_clean_scrub_stamp":"2023-09-13T02:12:12.209844+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:07:47.139624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657930+0000","last_change":"2023-09-13T02:12:23.584227+0000","last_active":"2023-09-13T02:12:25.657930+0000","last_peered":"2023-09-13T02:12:25.657930+0000","last_clean":"2023-09-13T02:12:25.657930+0000","last_became_active":"2023-09-13T02:12:23.583874+0000","last_became_peered":"2023-09-13T02:12:23.583874+0000","last_unstale":"2023-09-13T02:12:25.657930+0000","last_undegraded":"2023-09-13T02:12:25.657930+0000","last_fullsized":"2023-09-13T02:12:25.657930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759254+0000","last_change":"2023-09-13T02:12:24.588833+0000","last_active":"2023-09-13T02:12:25.759254+0000","last_peered":"2023-09-13T02:12:25.759254+0000","last_clean":"2023-09-13T02:12:25.759254+0000","last_became_active":"2023-09-13T02:12:24.588586+0000","last_became_peered":"2023-09-13T02:12:24.588586+0000","last_unstale":"2023-09-13T02:12:25.759254+0000","last_undegraded":"2023-09-13T02:12:25.759254+0000","last_fullsized":"2023-09-13T02:12:25.759254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257567+0000","last_change":"2023-09-13T02:12:23.580928+0000","last_active":"2023-09-13T02:12:26.257567+0000","last_peered":"2023-09-13T02:12:26.257567+0000","last_clean":"2023-09-13T02:12:26.257567+0000","last_became_active":"2023-09-13T02:12:23.580670+0000","last_became_peered":"2023-09-13T02:12:23.580670+0000","last_unstale":"2023-09-13T02:12:26.257567+0000","last_undegraded":"2023-09-13T02:12:26.257567+0000","last_fullsized":"2023-09-13T02:12:26.257567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607517+0000","last_change":"2023-09-13T02:12:24.579008+0000","last_active":"2023-09-13T02:12:25.607517+0000","last_peered":"2023-09-13T02:12:25.607517+0000","last_clean":"2023-09-13T02:12:25.607517+0000","last_became_active":"2023-09-13T02:12:24.578715+0000","last_became_peered":"2023-09-13T02:12:24.578715+0000","last_unstale":"2023-09-13T02:12:25.607517+0000","last_undegraded":"2023-09-13T02:12:25.607517+0000","last_fullsized":"2023-09-13T02:12:25.607517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:04.894368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575647+0000","last_change":"2023-09-13T02:12:23.578080+0000","last_active":"2023-09-13T02:12:25.575647+0000","last_peered":"2023-09-13T02:12:25.575647+0000","last_clean":"2023-09-13T02:12:25.575647+0000","last_became_active":"2023-09-13T02:12:23.577786+0000","last_became_peered":"2023-09-13T02:12:23.577786+0000","last_unstale":"2023-09-13T02:12:25.575647+0000","last_undegraded":"2023-09-13T02:12:25.575647+0000","last_fullsized":"2023-09-13T02:12:25.575647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:51.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578694+0000","last_change":"2023-09-13T02:12:24.582717+0000","last_active":"2023-09-13T02:12:25.578694+0000","last_peered":"2023-09-13T02:12:25.578694+0000","last_clean":"2023-09-13T02:12:25.578694+0000","last_became_active":"2023-09-13T02:12:24.582439+0000","last_became_peered":"2023-09-13T02:12:24.582439+0000","last_unstale":"2023-09-13T02:12:25.578694+0000","last_undegraded":"2023-09-13T02:12:25.578694+0000","last_fullsized":"2023-09-13T02:12:25.578694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658155+0000","last_change":"2023-09-13T02:12:23.585601+0000","last_active":"2023-09-13T02:12:25.658155+0000","last_peered":"2023-09-13T02:12:25.658155+0000","last_clean":"2023-09-13T02:12:25.658155+0000","last_became_active":"2023-09-13T02:12:23.585349+0000","last_became_peered":"2023-09-13T02:12:23.585349+0000","last_unstale":"2023-09-13T02:12:25.658155+0000","last_undegraded":"2023-09-13T02:12:25.658155+0000","last_fullsized":"2023-09-13T02:12:25.658155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:38.820251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579475+0000","last_change":"2023-09-13T02:12:24.586175+0000","last_active":"2023-09-13T02:12:25.579475+0000","last_peered":"2023-09-13T02:12:25.579475+0000","last_clean":"2023-09-13T02:12:25.579475+0000","last_became_active":"2023-09-13T02:12:24.585054+0000","last_became_peered":"2023-09-13T02:12:24.585054+0000","last_unstale":"2023-09-13T02:12:25.579475+0000","last_undegraded":"2023-09-13T02:12:25.579475+0000","last_fullsized":"2023-09-13T02:12:25.579475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:39.029452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578671+0000","last_change":"2023-09-13T02:12:23.580143+0000","last_active":"2023-09-13T02:12:25.578671+0000","last_peered":"2023-09-13T02:12:25.578671+0000","last_clean":"2023-09-13T02:12:25.578671+0000","last_became_active":"2023-09-13T02:12:23.579844+0000","last_became_peered":"2023-09-13T02:12:23.579844+0000","last_unstale":"2023-09-13T02:12:25.578671+0000","last_undegraded":"2023-09-13T02:12:25.578671+0000","last_fullsized":"2023-09-13T02:12:25.578671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:21:49.468231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658375+0000","last_change":"2023-09-13T02:12:24.592756+0000","last_active":"2023-09-13T02:12:25.658375+0000","last_peered":"2023-09-13T02:12:25.658375+0000","last_clean":"2023-09-13T02:12:25.658375+0000","last_became_active":"2023-09-13T02:12:24.592436+0000","last_became_peered":"2023-09-13T02:12:24.592436+0000","last_unstale":"2023-09-13T02:12:25.658375+0000","last_undegraded":"2023-09-13T02:12:25.658375+0000","last_fullsized":"2023-09-13T02:12:25.658375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:03:12.365120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258168+0000","last_change":"2023-09-13T02:12:23.585605+0000","last_active":"2023-09-13T02:12:26.258168+0000","last_peered":"2023-09-13T02:12:26.258168+0000","last_clean":"2023-09-13T02:12:26.258168+0000","last_became_active":"2023-09-13T02:12:23.585411+0000","last_became_peered":"2023-09-13T02:12:23.585411+0000","last_unstale":"2023-09-13T02:12:26.258168+0000","last_undegraded":"2023-09-13T02:12:26.258168+0000","last_fullsized":"2023-09-13T02:12:26.258168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:40.286050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578716+0000","last_change":"2023-09-13T02:12:24.582796+0000","last_active":"2023-09-13T02:12:25.578716+0000","last_peered":"2023-09-13T02:12:25.578716+0000","last_clean":"2023-09-13T02:12:25.578716+0000","last_became_active":"2023-09-13T02:12:24.582517+0000","last_became_peered":"2023-09-13T02:12:24.582517+0000","last_unstale":"2023-09-13T02:12:25.578716+0000","last_undegraded":"2023-09-13T02:12:25.578716+0000","last_fullsized":"2023-09-13T02:12:25.578716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:27.101414+0000","last_change":"2023-09-13T02:12:23.576140+0000","last_active":"2023-09-13T02:12:27.101414+0000","last_peered":"2023-09-13T02:12:27.101414+0000","last_clean":"2023-09-13T02:12:27.101414+0000","last_became_active":"2023-09-13T02:12:23.575875+0000","last_became_peered":"2023-09-13T02:12:23.575875+0000","last_unstale":"2023-09-13T02:12:27.101414+0000","last_undegraded":"2023-09-13T02:12:27.101414+0000","last_fullsized":"2023-09-13T02:12:27.101414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:07.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759378+0000","last_change":"2023-09-13T02:12:24.592556+0000","last_active":"2023-09-13T02:12:25.759378+0000","last_peered":"2023-09-13T02:12:25.759378+0000","last_clean":"2023-09-13T02:12:25.759378+0000","last_became_active":"2023-09-13T02:12:24.592247+0000","last_became_peered":"2023-09-13T02:12:24.592247+0000","last_unstale":"2023-09-13T02:12:25.759378+0000","last_undegraded":"2023-09-13T02:12:25.759378+0000","last_fullsized":"2023-09-13T02:12:25.759378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757473+0000","last_change":"2023-09-13T02:12:23.579687+0000","last_active":"2023-09-13T02:12:25.757473+0000","last_peered":"2023-09-13T02:12:25.757473+0000","last_clean":"2023-09-13T02:12:25.757473+0000","last_became_active":"2023-09-13T02:12:23.579389+0000","last_became_peered":"2023-09-13T02:12:23.579389+0000","last_unstale":"2023-09-13T02:12:25.757473+0000","last_undegraded":"2023-09-13T02:12:25.757473+0000","last_fullsized":"2023-09-13T02:12:25.757473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607754+0000","last_change":"2023-09-13T02:12:24.585029+0000","last_active":"2023-09-13T02:12:25.607754+0000","last_peered":"2023-09-13T02:12:25.607754+0000","last_clean":"2023-09-13T02:12:25.607754+0000","last_became_active":"2023-09-13T02:12:24.584791+0000","last_became_peered":"2023-09-13T02:12:24.584791+0000","last_unstale":"2023-09-13T02:12:25.607754+0000","last_undegraded":"2023-09-13T02:12:25.607754+0000","last_fullsized":"2023-09-13T02:12:25.607754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257573+0000","last_change":"2023-09-13T02:12:23.585601+0000","last_active":"2023-09-13T02:12:26.257573+0000","last_peered":"2023-09-13T02:12:26.257573+0000","last_clean":"2023-09-13T02:12:26.257573+0000","last_became_active":"2023-09-13T02:12:23.585321+0000","last_became_peered":"2023-09-13T02:12:23.585321+0000","last_unstale":"2023-09-13T02:12:26.257573+0000","last_undegraded":"2023-09-13T02:12:26.257573+0000","last_fullsized":"2023-09-13T02:12:26.257573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579437+0000","last_change":"2023-09-13T02:12:24.586947+0000","last_active":"2023-09-13T02:12:25.579437+0000","last_peered":"2023-09-13T02:12:25.579437+0000","last_clean":"2023-09-13T02:12:25.579437+0000","last_became_active":"2023-09-13T02:12:24.586072+0000","last_became_peered":"2023-09-13T02:12:24.586072+0000","last_unstale":"2023-09-13T02:12:25.579437+0000","last_undegraded":"2023-09-13T02:12:25.579437+0000","last_fullsized":"2023-09-13T02:12:25.579437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:50.824236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578663+0000","last_change":"2023-09-13T02:12:23.578914+0000","last_active":"2023-09-13T02:12:25.578663+0000","last_peered":"2023-09-13T02:12:25.578663+0000","last_clean":"2023-09-13T02:12:25.578663+0000","last_became_active":"2023-09-13T02:12:23.578649+0000","last_became_peered":"2023-09-13T02:12:23.578649+0000","last_unstale":"2023-09-13T02:12:25.578663+0000","last_undegraded":"2023-09-13T02:12:25.578663+0000","last_fullsized":"2023-09-13T02:12:25.578663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759041+0000","last_change":"2023-09-13T02:12:24.585743+0000","last_active":"2023-09-13T02:12:25.759041+0000","last_peered":"2023-09-13T02:12:25.759041+0000","last_clean":"2023-09-13T02:12:25.759041+0000","last_became_active":"2023-09-13T02:12:24.585508+0000","last_became_peered":"2023-09-13T02:12:24.585508+0000","last_unstale":"2023-09-13T02:12:25.759041+0000","last_undegraded":"2023-09-13T02:12:25.759041+0000","last_fullsized":"2023-09-13T02:12:25.759041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578790+0000","last_change":"2023-09-13T02:12:23.578387+0000","last_active":"2023-09-13T02:12:25.578790+0000","last_peered":"2023-09-13T02:12:25.578790+0000","last_clean":"2023-09-13T02:12:25.578790+0000","last_became_active":"2023-09-13T02:12:23.578121+0000","last_became_peered":"2023-09-13T02:12:23.578121+0000","last_unstale":"2023-09-13T02:12:25.578790+0000","last_undegraded":"2023-09-13T02:12:25.578790+0000","last_fullsized":"2023-09-13T02:12:25.578790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:32.660244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759336+0000","last_change":"2023-09-13T02:12:24.587304+0000","last_active":"2023-09-13T02:12:25.759336+0000","last_peered":"2023-09-13T02:12:25.759336+0000","last_clean":"2023-09-13T02:12:25.759336+0000","last_became_active":"2023-09-13T02:12:24.587040+0000","last_became_peered":"2023-09-13T02:12:24.587040+0000","last_unstale":"2023-09-13T02:12:25.759336+0000","last_undegraded":"2023-09-13T02:12:25.759336+0000","last_fullsized":"2023-09-13T02:12:25.759336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:18.256464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258112+0000","last_change":"2023-09-13T02:12:23.578623+0000","last_active":"2023-09-13T02:12:26.258112+0000","last_peered":"2023-09-13T02:12:26.258112+0000","last_clean":"2023-09-13T02:12:26.258112+0000","last_became_active":"2023-09-13T02:12:23.578258+0000","last_became_peered":"2023-09-13T02:12:23.578258+0000","last_unstale":"2023-09-13T02:12:26.258112+0000","last_undegraded":"2023-09-13T02:12:26.258112+0000","last_fullsized":"2023-09-13T02:12:26.258112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:18:54.951761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757225+0000","last_change":"2023-09-13T02:12:24.590763+0000","last_active":"2023-09-13T02:12:25.757225+0000","last_peered":"2023-09-13T02:12:25.757225+0000","last_clean":"2023-09-13T02:12:25.757225+0000","last_became_active":"2023-09-13T02:12:24.590494+0000","last_became_peered":"2023-09-13T02:12:24.590494+0000","last_unstale":"2023-09-13T02:12:25.757225+0000","last_undegraded":"2023-09-13T02:12:25.757225+0000","last_fullsized":"2023-09-13T02:12:25.757225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658298+0000","last_change":"2023-09-13T02:12:24.597290+0000","last_active":"2023-09-13T02:12:25.658298+0000","last_peered":"2023-09-13T02:12:25.658298+0000","last_clean":"2023-09-13T02:12:25.658298+0000","last_became_active":"2023-09-13T02:12:24.597024+0000","last_became_peered":"2023-09-13T02:12:24.597024+0000","last_unstale":"2023-09-13T02:12:25.658298+0000","last_undegraded":"2023-09-13T02:12:25.658298+0000","last_fullsized":"2023-09-13T02:12:25.658298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:15.126313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257895+0000","last_change":"2023-09-13T02:12:23.584941+0000","last_active":"2023-09-13T02:12:26.257895+0000","last_peered":"2023-09-13T02:12:26.257895+0000","last_clean":"2023-09-13T02:12:26.257895+0000","last_became_active":"2023-09-13T02:12:23.584671+0000","last_became_peered":"2023-09-13T02:12:23.584671+0000","last_unstale":"2023-09-13T02:12:26.257895+0000","last_undegraded":"2023-09-13T02:12:26.257895+0000","last_fullsized":"2023-09-13T02:12:26.257895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:38.089400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658128+0000","last_change":"2023-09-13T02:12:24.596615+0000","last_active":"2023-09-13T02:12:25.658128+0000","last_peered":"2023-09-13T02:12:25.658128+0000","last_clean":"2023-09-13T02:12:25.658128+0000","last_became_active":"2023-09-13T02:12:24.595918+0000","last_became_peered":"2023-09-13T02:12:24.595918+0000","last_unstale":"2023-09-13T02:12:25.658128+0000","last_undegraded":"2023-09-13T02:12:25.658128+0000","last_fullsized":"2023-09-13T02:12:25.658128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:18:08.378805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258039+0000","last_change":"2023-09-13T02:12:23.579507+0000","last_active":"2023-09-13T02:12:26.258039+0000","last_peered":"2023-09-13T02:12:26.258039+0000","last_clean":"2023-09-13T02:12:26.258039+0000","last_became_active":"2023-09-13T02:12:23.579239+0000","last_became_peered":"2023-09-13T02:12:23.579239+0000","last_unstale":"2023-09-13T02:12:26.258039+0000","last_undegraded":"2023-09-13T02:12:26.258039+0000","last_fullsized":"2023-09-13T02:12:26.258039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:11.224076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607799+0000","last_change":"2023-09-13T02:12:24.589292+0000","last_active":"2023-09-13T02:12:25.607799+0000","last_peered":"2023-09-13T02:12:25.607799+0000","last_clean":"2023-09-13T02:12:25.607799+0000","last_became_active":"2023-09-13T02:12:24.589039+0000","last_became_peered":"2023-09-13T02:12:24.589039+0000","last_unstale":"2023-09-13T02:12:25.607799+0000","last_undegraded":"2023-09-13T02:12:25.607799+0000","last_fullsized":"2023-09-13T02:12:25.607799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759226+0000","last_change":"2023-09-13T02:12:23.584177+0000","last_active":"2023-09-13T02:12:25.759226+0000","last_peered":"2023-09-13T02:12:25.759226+0000","last_clean":"2023-09-13T02:12:25.759226+0000","last_became_active":"2023-09-13T02:12:23.583920+0000","last_became_peered":"2023-09-13T02:12:23.583920+0000","last_unstale":"2023-09-13T02:12:25.759226+0000","last_undegraded":"2023-09-13T02:12:25.759226+0000","last_fullsized":"2023-09-13T02:12:25.759226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:21:49.468231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759093+0000","last_change":"2023-09-13T02:12:24.588205+0000","last_active":"2023-09-13T02:12:25.759093+0000","last_peered":"2023-09-13T02:12:25.759093+0000","last_clean":"2023-09-13T02:12:25.759093+0000","last_became_active":"2023-09-13T02:12:24.587697+0000","last_became_peered":"2023-09-13T02:12:24.587697+0000","last_unstale":"2023-09-13T02:12:25.759093+0000","last_undegraded":"2023-09-13T02:12:25.759093+0000","last_fullsized":"2023-09-13T02:12:25.759093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607876+0000","last_change":"2023-09-13T02:12:23.583748+0000","last_active":"2023-09-13T02:12:25.607876+0000","last_peered":"2023-09-13T02:12:25.607876+0000","last_clean":"2023-09-13T02:12:25.607876+0000","last_became_active":"2023-09-13T02:12:23.583443+0000","last_became_peered":"2023-09-13T02:12:23.583443+0000","last_unstale":"2023-09-13T02:12:25.607876+0000","last_undegraded":"2023-09-13T02:12:25.607876+0000","last_fullsized":"2023-09-13T02:12:25.607876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T02:12:32.384 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T02:12:32.521 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.519+0000 7fb14983f640 1 -- 172.21.15.104:0/2146665700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb144144ea0 msgr2=0x7fb1441452f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:32.521 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.519+0000 7fb14983f640 1 --2- 172.21.15.104:0/2146665700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb144144ea0 0x7fb1441452f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009830 tx=0x7fb13c02bc30 comp rx=0 tx=0).stop 2023-09-13T02:12:32.521 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.519+0000 7fb14983f640 1 -- 172.21.15.104:0/2146665700 shutdown_connections 2023-09-13T02:12:32.521 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.519+0000 7fb14983f640 1 --2- 172.21.15.104:0/2146665700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb144144ea0 0x7fb1441452f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.522 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.519+0000 7fb14983f640 1 --2- 172.21.15.104:0/2146665700 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440b66c0 0x7fb1440acc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.522 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.519+0000 7fb14983f640 1 -- 172.21.15.104:0/2146665700 >> 172.21.15.104:0/2146665700 conn(0x7fb1440708b0 msgr2=0x7fb144070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:32.522 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.519+0000 7fb14983f640 1 -- 172.21.15.104:0/2146665700 shutdown_connections 2023-09-13T02:12:32.522 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.519+0000 7fb14983f640 1 -- 172.21.15.104:0/2146665700 wait complete. 2023-09-13T02:12:32.526 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.520+0000 7fb14983f640 1 Processor -- start 2023-09-13T02:12:32.526 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.520+0000 7fb14983f640 1 -- start start 2023-09-13T02:12:32.526 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb14983f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440ad140 0x7fb14413f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:32.527 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb14983f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1440b66c0 0x7fb1440a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:32.527 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb14983f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144144ea0 0x7fb1440a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:32.527 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb14983f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440a8f90 con 0x7fb144144ea0 2023-09-13T02:12:32.527 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb14983f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440a8960 con 0x7fb1440b66c0 2023-09-13T02:12:32.528 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb14983f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb144146840 con 0x7fb1440ad140 2023-09-13T02:12:32.528 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb1437fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144144ea0 0x7fb1440a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:32.528 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb1437fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144144ea0 0x7fb1440a69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47476/0 (socket says 172.21.15.104:47476) 2023-09-13T02:12:32.528 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb1437fe640 1 -- 172.21.15.104:0/3373537802 learned_addr learned my addr 172.21.15.104:0/3373537802 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:32.528 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb142ffd640 1 --2- 172.21.15.104:0/3373537802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440ad140 0x7fb14413f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:32.529 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb1427fc640 1 --2- 172.21.15.104:0/3373537802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1440b66c0 0x7fb1440a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:32.529 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb1437fe640 1 -- 172.21.15.104:0/3373537802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440ad140 msgr2=0x7fb14413f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:32.529 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb1437fe640 1 --2- 172.21.15.104:0/3373537802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440ad140 0x7fb14413f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.529 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb1437fe640 1 -- 172.21.15.104:0/3373537802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1440b66c0 msgr2=0x7fb1440a6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:32.530 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb1437fe640 1 --2- 172.21.15.104:0/3373537802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1440b66c0 0x7fb1440a6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.530 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb1437fe640 1 -- 172.21.15.104:0/3373537802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb134009900 con 0x7fb144144ea0 2023-09-13T02:12:32.530 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb142ffd640 1 --2- 172.21.15.104:0/3373537802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440ad140 0x7fb14413f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:32.530 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.521+0000 7fb1427fc640 1 --2- 172.21.15.104:0/3373537802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1440b66c0 0x7fb1440a6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:32.531 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.522+0000 7fb1437fe640 1 --2- 172.21.15.104:0/3373537802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144144ea0 0x7fb1440a69b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009950 tx=0x7fb13c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:32.531 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.522+0000 7fb13bfff640 1 -- 172.21.15.104:0/3373537802 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c005220 con 0x7fb144144ea0 2023-09-13T02:12:32.531 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.522+0000 7fb13bfff640 1 -- 172.21.15.104:0/3373537802 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb13c005470 con 0x7fb144144ea0 2023-09-13T02:12:32.531 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.522+0000 7fb14983f640 1 -- 172.21.15.104:0/3373537802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13c009490 con 0x7fb144144ea0 2023-09-13T02:12:32.532 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.522+0000 7fb13bfff640 1 -- 172.21.15.104:0/3373537802 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c003a60 con 0x7fb144144ea0 2023-09-13T02:12:32.532 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.522+0000 7fb14983f640 1 -- 172.21.15.104:0/3373537802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14413fa80 con 0x7fb144144ea0 2023-09-13T02:12:32.532 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.523+0000 7fb14983f640 1 -- 172.21.15.104:0/3373537802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1440a9140 con 0x7fb144144ea0 2023-09-13T02:12:32.532 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.523+0000 7fb13bfff640 1 -- 172.21.15.104:0/3373537802 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb13c003bc0 con 0x7fb144144ea0 2023-09-13T02:12:32.532 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.523+0000 7fb13bfff640 1 --2- 172.21.15.104:0/3373537802 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb12406a4f0 0x7fb12406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:32.533 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.524+0000 7fb142ffd640 1 --2- 172.21.15.104:0/3373537802 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb12406a4f0 0x7fb12406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:32.533 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.524+0000 7fb13bfff640 1 -- 172.21.15.104:0/3373537802 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb13c0aa990 con 0x7fb144144ea0 2023-09-13T02:12:32.533 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.524+0000 7fb142ffd640 1 --2- 172.21.15.104:0/3373537802 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb12406a4f0 0x7fb12406c9b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb134005fd0 tx=0x7fb1340095c0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:32.534 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.528+0000 7fb13bfff640 1 -- 172.21.15.104:0/3373537802 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb1440a9140 con 0x7fb144144ea0 2023-09-13T02:12:32.698 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.697+0000 7fb14983f640 1 -- 172.21.15.104:0/3373537802 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb14404e100 con 0x7fb12406a4f0 2023-09-13T02:12:32.704 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.703+0000 7fb13bfff640 1 -- 172.21.15.104:0/3373537802 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264520 (secure 0 0 0) 0x7fb14404e100 con 0x7fb12406a4f0 2023-09-13T02:12:32.707 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:32.709 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2023-09-13T02:12:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.706+0000 7fb14983f640 1 -- 172.21.15.104:0/3373537802 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb12406a4f0 msgr2=0x7fb12406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.706+0000 7fb14983f640 1 --2- 172.21.15.104:0/3373537802 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb12406a4f0 0x7fb12406c9b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb134005fd0 tx=0x7fb1340095c0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.706+0000 7fb14983f640 1 -- 172.21.15.104:0/3373537802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144144ea0 msgr2=0x7fb1440a69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.706+0000 7fb14983f640 1 --2- 172.21.15.104:0/3373537802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144144ea0 0x7fb1440a69b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009950 tx=0x7fb13c004360 comp rx=0 tx=0).stop 2023-09-13T02:12:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.706+0000 7fb14983f640 1 -- 172.21.15.104:0/3373537802 shutdown_connections 2023-09-13T02:12:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.706+0000 7fb14983f640 1 --2- 172.21.15.104:0/3373537802 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb12406a4f0 0x7fb12406c9b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.706+0000 7fb14983f640 1 --2- 172.21.15.104:0/3373537802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144144ea0 0x7fb1440a69b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.706+0000 7fb14983f640 1 --2- 172.21.15.104:0/3373537802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1440b66c0 0x7fb1440a6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.706+0000 7fb14983f640 1 --2- 172.21.15.104:0/3373537802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440ad140 0x7fb14413f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.713 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.706+0000 7fb14983f640 1 -- 172.21.15.104:0/3373537802 >> 172.21.15.104:0/3373537802 conn(0x7fb1440708b0 msgr2=0x7fb144140370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:32.713 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.706+0000 7fb14983f640 1 -- 172.21.15.104:0/3373537802 shutdown_connections 2023-09-13T02:12:32.713 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.706+0000 7fb14983f640 1 -- 172.21.15.104:0/3373537802 wait complete. 2023-09-13T02:12:32.718 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-09-13T02:12:32.032157+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2887680,"data_stored":1751721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001698"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258274+0000","last_change":"2023-09-13T02:12:24.593673+0000","last_active":"2023-09-13T02:12:26.258274+0000","last_peered":"2023-09-13T02:12:26.258274+0000","last_clean":"2023-09-13T02:12:26.258274+0000","last_became_active":"2023-09-13T02:12:24.592754+0000","last_became_peered":"2023-09-13T02:12:24.592754+0000","last_unstale":"2023-09-13T02:12:26.258274+0000","last_undegraded":"2023-09-13T02:12:26.258274+0000","last_fullsized":"2023-09-13T02:12:26.258274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:43:34.341442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578839+0000","last_change":"2023-09-13T02:12:24.580108+0000","last_active":"2023-09-13T02:12:25.578839+0000","last_peered":"2023-09-13T02:12:25.578839+0000","last_clean":"2023-09-13T02:12:25.578839+0000","last_became_active":"2023-09-13T02:12:24.579873+0000","last_became_peered":"2023-09-13T02:12:24.579873+0000","last_unstale":"2023-09-13T02:12:25.578839+0000","last_undegraded":"2023-09-13T02:12:25.578839+0000","last_fullsized":"2023-09-13T02:12:25.578839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607687+0000","last_change":"2023-09-13T02:12:24.584533+0000","last_active":"2023-09-13T02:12:25.607687+0000","last_peered":"2023-09-13T02:12:25.607687+0000","last_clean":"2023-09-13T02:12:25.607687+0000","last_became_active":"2023-09-13T02:12:24.584249+0000","last_became_peered":"2023-09-13T02:12:24.584249+0000","last_unstale":"2023-09-13T02:12:25.607687+0000","last_undegraded":"2023-09-13T02:12:25.607687+0000","last_fullsized":"2023-09-13T02:12:25.607687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658105+0000","last_change":"2023-09-13T02:12:24.596092+0000","last_active":"2023-09-13T02:12:25.658105+0000","last_peered":"2023-09-13T02:12:25.658105+0000","last_clean":"2023-09-13T02:12:25.658105+0000","last_became_active":"2023-09-13T02:12:24.595817+0000","last_became_peered":"2023-09-13T02:12:24.595817+0000","last_unstale":"2023-09-13T02:12:25.658105+0000","last_undegraded":"2023-09-13T02:12:25.658105+0000","last_fullsized":"2023-09-13T02:12:25.658105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:15.246952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257924+0000","last_change":"2023-09-13T02:12:24.592410+0000","last_active":"2023-09-13T02:12:26.257924+0000","last_peered":"2023-09-13T02:12:26.257924+0000","last_clean":"2023-09-13T02:12:26.257924+0000","last_became_active":"2023-09-13T02:12:24.591503+0000","last_became_peered":"2023-09-13T02:12:24.591503+0000","last_unstale":"2023-09-13T02:12:26.257924+0000","last_undegraded":"2023-09-13T02:12:26.257924+0000","last_fullsized":"2023-09-13T02:12:26.257924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:43:26.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657920+0000","last_change":"2023-09-13T02:12:24.594084+0000","last_active":"2023-09-13T02:12:25.657920+0000","last_peered":"2023-09-13T02:12:25.657920+0000","last_clean":"2023-09-13T02:12:25.657920+0000","last_became_active":"2023-09-13T02:12:24.592530+0000","last_became_peered":"2023-09-13T02:12:24.592530+0000","last_unstale":"2023-09-13T02:12:25.657920+0000","last_undegraded":"2023-09-13T02:12:25.657920+0000","last_fullsized":"2023-09-13T02:12:25.657920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257688+0000","last_change":"2023-09-13T02:12:24.591304+0000","last_active":"2023-09-13T02:12:26.257688+0000","last_peered":"2023-09-13T02:12:26.257688+0000","last_clean":"2023-09-13T02:12:26.257688+0000","last_became_active":"2023-09-13T02:12:24.590654+0000","last_became_peered":"2023-09-13T02:12:24.590654+0000","last_unstale":"2023-09-13T02:12:26.257688+0000","last_undegraded":"2023-09-13T02:12:26.257688+0000","last_fullsized":"2023-09-13T02:12:26.257688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:15.246952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.758902+0000","last_change":"2023-09-13T02:12:24.588844+0000","last_active":"2023-09-13T02:12:25.758902+0000","last_peered":"2023-09-13T02:12:25.758902+0000","last_clean":"2023-09-13T02:12:25.758902+0000","last_became_active":"2023-09-13T02:12:24.588438+0000","last_became_peered":"2023-09-13T02:12:24.588438+0000","last_unstale":"2023-09-13T02:12:25.758902+0000","last_undegraded":"2023-09-13T02:12:25.758902+0000","last_fullsized":"2023-09-13T02:12:25.758902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:37.796406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258329+0000","last_change":"2023-09-13T02:12:24.589946+0000","last_active":"2023-09-13T02:12:26.258329+0000","last_peered":"2023-09-13T02:12:26.258329+0000","last_clean":"2023-09-13T02:12:26.258329+0000","last_became_active":"2023-09-13T02:12:24.589606+0000","last_became_peered":"2023-09-13T02:12:24.589606+0000","last_unstale":"2023-09-13T02:12:26.258329+0000","last_undegraded":"2023-09-13T02:12:26.258329+0000","last_fullsized":"2023-09-13T02:12:26.258329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:41.609166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757491+0000","last_change":"2023-09-13T02:12:24.588874+0000","last_active":"2023-09-13T02:12:25.757491+0000","last_peered":"2023-09-13T02:12:25.757491+0000","last_clean":"2023-09-13T02:12:25.757491+0000","last_became_active":"2023-09-13T02:12:24.588522+0000","last_became_peered":"2023-09-13T02:12:24.588522+0000","last_unstale":"2023-09-13T02:12:25.757491+0000","last_undegraded":"2023-09-13T02:12:25.757491+0000","last_fullsized":"2023-09-13T02:12:25.757491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757356+0000","last_change":"2023-09-13T02:12:24.589173+0000","last_active":"2023-09-13T02:12:25.757356+0000","last_peered":"2023-09-13T02:12:25.757356+0000","last_clean":"2023-09-13T02:12:25.757356+0000","last_became_active":"2023-09-13T02:12:24.588891+0000","last_became_peered":"2023-09-13T02:12:24.588891+0000","last_unstale":"2023-09-13T02:12:25.757356+0000","last_undegraded":"2023-09-13T02:12:25.757356+0000","last_fullsized":"2023-09-13T02:12:25.757356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579243+0000","last_change":"2023-09-13T02:12:24.587494+0000","last_active":"2023-09-13T02:12:25.579243+0000","last_peered":"2023-09-13T02:12:25.579243+0000","last_clean":"2023-09-13T02:12:25.579243+0000","last_became_active":"2023-09-13T02:12:24.587023+0000","last_became_peered":"2023-09-13T02:12:24.587023+0000","last_unstale":"2023-09-13T02:12:25.579243+0000","last_undegraded":"2023-09-13T02:12:25.579243+0000","last_fullsized":"2023-09-13T02:12:25.579243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:41.175280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759132+0000","last_change":"2023-09-13T02:12:24.588000+0000","last_active":"2023-09-13T02:12:25.759132+0000","last_peered":"2023-09-13T02:12:25.759132+0000","last_clean":"2023-09-13T02:12:25.759132+0000","last_became_active":"2023-09-13T02:12:24.587730+0000","last_became_peered":"2023-09-13T02:12:24.587730+0000","last_unstale":"2023-09-13T02:12:25.759132+0000","last_undegraded":"2023-09-13T02:12:25.759132+0000","last_fullsized":"2023-09-13T02:12:25.759132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607517+0000","last_change":"2023-09-13T02:12:24.584985+0000","last_active":"2023-09-13T02:12:25.607517+0000","last_peered":"2023-09-13T02:12:25.607517+0000","last_clean":"2023-09-13T02:12:25.607517+0000","last_became_active":"2023-09-13T02:12:24.584734+0000","last_became_peered":"2023-09-13T02:12:24.584734+0000","last_unstale":"2023-09-13T02:12:25.607517+0000","last_undegraded":"2023-09-13T02:12:25.607517+0000","last_fullsized":"2023-09-13T02:12:25.607517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:37.796406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578570+0000","last_change":"2023-09-13T02:12:24.578832+0000","last_active":"2023-09-13T02:12:25.578570+0000","last_peered":"2023-09-13T02:12:25.578570+0000","last_clean":"2023-09-13T02:12:25.578570+0000","last_became_active":"2023-09-13T02:12:24.578553+0000","last_became_peered":"2023-09-13T02:12:24.578553+0000","last_unstale":"2023-09-13T02:12:25.578570+0000","last_undegraded":"2023-09-13T02:12:25.578570+0000","last_fullsized":"2023-09-13T02:12:25.578570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657829+0000","last_change":"2023-09-13T02:12:24.591151+0000","last_active":"2023-09-13T02:12:25.657829+0000","last_peered":"2023-09-13T02:12:25.657829+0000","last_clean":"2023-09-13T02:12:25.657829+0000","last_became_active":"2023-09-13T02:12:24.590871+0000","last_became_peered":"2023-09-13T02:12:24.590871+0000","last_unstale":"2023-09-13T02:12:25.657829+0000","last_undegraded":"2023-09-13T02:12:25.657829+0000","last_fullsized":"2023-09-13T02:12:25.657829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658468+0000","last_change":"2023-09-13T02:12:24.592615+0000","last_active":"2023-09-13T02:12:25.658468+0000","last_peered":"2023-09-13T02:12:25.658468+0000","last_clean":"2023-09-13T02:12:25.658468+0000","last_became_active":"2023-09-13T02:12:24.592325+0000","last_became_peered":"2023-09-13T02:12:24.592325+0000","last_unstale":"2023-09-13T02:12:25.658468+0000","last_undegraded":"2023-09-13T02:12:25.658468+0000","last_fullsized":"2023-09-13T02:12:25.658468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:19:41.872878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575609+0000","last_change":"2023-09-13T02:12:24.587859+0000","last_active":"2023-09-13T02:12:25.575609+0000","last_peered":"2023-09-13T02:12:25.575609+0000","last_clean":"2023-09-13T02:12:25.575609+0000","last_became_active":"2023-09-13T02:12:24.587552+0000","last_became_peered":"2023-09-13T02:12:24.587552+0000","last_unstale":"2023-09-13T02:12:25.575609+0000","last_undegraded":"2023-09-13T02:12:25.575609+0000","last_fullsized":"2023-09-13T02:12:25.575609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:39.029452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258196+0000","last_change":"2023-09-13T02:12:24.591593+0000","last_active":"2023-09-13T02:12:26.258196+0000","last_peered":"2023-09-13T02:12:26.258196+0000","last_clean":"2023-09-13T02:12:26.258196+0000","last_became_active":"2023-09-13T02:12:24.590670+0000","last_became_peered":"2023-09-13T02:12:24.590670+0000","last_unstale":"2023-09-13T02:12:26.258196+0000","last_undegraded":"2023-09-13T02:12:26.258196+0000","last_fullsized":"2023-09-13T02:12:26.258196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:19:41.872878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757332+0000","last_change":"2023-09-13T02:12:24.593278+0000","last_active":"2023-09-13T02:12:25.757332+0000","last_peered":"2023-09-13T02:12:25.757332+0000","last_clean":"2023-09-13T02:12:25.757332+0000","last_became_active":"2023-09-13T02:12:24.591065+0000","last_became_peered":"2023-09-13T02:12:24.591065+0000","last_unstale":"2023-09-13T02:12:25.757332+0000","last_undegraded":"2023-09-13T02:12:25.757332+0000","last_fullsized":"2023-09-13T02:12:25.757332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607717+0000","last_change":"2023-09-13T02:12:24.587352+0000","last_active":"2023-09-13T02:12:25.607717+0000","last_peered":"2023-09-13T02:12:25.607717+0000","last_clean":"2023-09-13T02:12:25.607717+0000","last_became_active":"2023-09-13T02:12:24.586981+0000","last_became_peered":"2023-09-13T02:12:24.586981+0000","last_unstale":"2023-09-13T02:12:25.607717+0000","last_undegraded":"2023-09-13T02:12:25.607717+0000","last_fullsized":"2023-09-13T02:12:25.607717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657949+0000","last_change":"2023-09-13T02:12:24.595423+0000","last_active":"2023-09-13T02:12:25.657949+0000","last_peered":"2023-09-13T02:12:25.657949+0000","last_clean":"2023-09-13T02:12:25.657949+0000","last_became_active":"2023-09-13T02:12:24.594351+0000","last_became_peered":"2023-09-13T02:12:24.594351+0000","last_unstale":"2023-09-13T02:12:25.657949+0000","last_undegraded":"2023-09-13T02:12:25.657949+0000","last_fullsized":"2023-09-13T02:12:25.657949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:18.256464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.758931+0000","last_change":"2023-09-13T02:12:24.590553+0000","last_active":"2023-09-13T02:12:25.758931+0000","last_peered":"2023-09-13T02:12:25.758931+0000","last_clean":"2023-09-13T02:12:25.758931+0000","last_became_active":"2023-09-13T02:12:24.590295+0000","last_became_peered":"2023-09-13T02:12:24.590295+0000","last_unstale":"2023-09-13T02:12:25.758931+0000","last_undegraded":"2023-09-13T02:12:25.758931+0000","last_fullsized":"2023-09-13T02:12:25.758931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657922+0000","last_change":"2023-09-13T02:12:24.593925+0000","last_active":"2023-09-13T02:12:25.657922+0000","last_peered":"2023-09-13T02:12:25.657922+0000","last_clean":"2023-09-13T02:12:25.657922+0000","last_became_active":"2023-09-13T02:12:24.593673+0000","last_became_peered":"2023-09-13T02:12:24.593673+0000","last_unstale":"2023-09-13T02:12:25.657922+0000","last_undegraded":"2023-09-13T02:12:25.657922+0000","last_fullsized":"2023-09-13T02:12:25.657922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759249+0000","last_change":"2023-09-13T02:12:24.590496+0000","last_active":"2023-09-13T02:12:25.759249+0000","last_peered":"2023-09-13T02:12:25.759249+0000","last_clean":"2023-09-13T02:12:25.759249+0000","last_became_active":"2023-09-13T02:12:24.590231+0000","last_became_peered":"2023-09-13T02:12:24.590231+0000","last_unstale":"2023-09-13T02:12:25.759249+0000","last_undegraded":"2023-09-13T02:12:25.759249+0000","last_fullsized":"2023-09-13T02:12:25.759249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757555+0000","last_change":"2023-09-13T02:12:24.590251+0000","last_active":"2023-09-13T02:12:25.757555+0000","last_peered":"2023-09-13T02:12:25.757555+0000","last_clean":"2023-09-13T02:12:25.757555+0000","last_became_active":"2023-09-13T02:12:24.589975+0000","last_became_peered":"2023-09-13T02:12:24.589975+0000","last_unstale":"2023-09-13T02:12:25.757555+0000","last_undegraded":"2023-09-13T02:12:25.757555+0000","last_fullsized":"2023-09-13T02:12:25.757555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578681+0000","last_change":"2023-09-13T02:12:24.584028+0000","last_active":"2023-09-13T02:12:25.578681+0000","last_peered":"2023-09-13T02:12:25.578681+0000","last_clean":"2023-09-13T02:12:25.578681+0000","last_became_active":"2023-09-13T02:12:24.583782+0000","last_became_peered":"2023-09-13T02:12:24.583782+0000","last_unstale":"2023-09-13T02:12:25.578681+0000","last_undegraded":"2023-09-13T02:12:25.578681+0000","last_fullsized":"2023-09-13T02:12:25.578681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759313+0000","last_change":"2023-09-13T02:12:24.590548+0000","last_active":"2023-09-13T02:12:25.759313+0000","last_peered":"2023-09-13T02:12:25.759313+0000","last_clean":"2023-09-13T02:12:25.759313+0000","last_became_active":"2023-09-13T02:12:24.590189+0000","last_became_peered":"2023-09-13T02:12:24.590189+0000","last_unstale":"2023-09-13T02:12:25.759313+0000","last_undegraded":"2023-09-13T02:12:25.759313+0000","last_fullsized":"2023-09-13T02:12:25.759313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607812+0000","last_change":"2023-09-13T02:12:24.583749+0000","last_active":"2023-09-13T02:12:25.607812+0000","last_peered":"2023-09-13T02:12:25.607812+0000","last_clean":"2023-09-13T02:12:25.607812+0000","last_became_active":"2023-09-13T02:12:24.583453+0000","last_became_peered":"2023-09-13T02:12:24.583453+0000","last_unstale":"2023-09-13T02:12:25.607812+0000","last_undegraded":"2023-09-13T02:12:25.607812+0000","last_fullsized":"2023-09-13T02:12:25.607812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658110+0000","last_change":"2023-09-13T02:12:24.595007+0000","last_active":"2023-09-13T02:12:25.658110+0000","last_peered":"2023-09-13T02:12:25.658110+0000","last_clean":"2023-09-13T02:12:25.658110+0000","last_became_active":"2023-09-13T02:12:24.592875+0000","last_became_peered":"2023-09-13T02:12:24.592875+0000","last_unstale":"2023-09-13T02:12:25.658110+0000","last_undegraded":"2023-09-13T02:12:25.658110+0000","last_fullsized":"2023-09-13T02:12:25.658110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575574+0000","last_change":"2023-09-13T02:12:24.588586+0000","last_active":"2023-09-13T02:12:25.575574+0000","last_peered":"2023-09-13T02:12:25.575574+0000","last_clean":"2023-09-13T02:12:25.575574+0000","last_became_active":"2023-09-13T02:12:24.588173+0000","last_became_peered":"2023-09-13T02:12:24.588173+0000","last_unstale":"2023-09-13T02:12:25.575574+0000","last_undegraded":"2023-09-13T02:12:25.575574+0000","last_fullsized":"2023-09-13T02:12:25.575574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:50.824236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757216+0000","last_change":"2023-09-13T02:12:24.590981+0000","last_active":"2023-09-13T02:12:25.757216+0000","last_peered":"2023-09-13T02:12:25.757216+0000","last_clean":"2023-09-13T02:12:25.757216+0000","last_became_active":"2023-09-13T02:12:24.590677+0000","last_became_peered":"2023-09-13T02:12:24.590677+0000","last_unstale":"2023-09-13T02:12:25.757216+0000","last_undegraded":"2023-09-13T02:12:25.757216+0000","last_fullsized":"2023-09-13T02:12:25.757216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579025+0000","last_change":"2023-09-13T02:12:24.586738+0000","last_active":"2023-09-13T02:12:25.579025+0000","last_peered":"2023-09-13T02:12:25.579025+0000","last_clean":"2023-09-13T02:12:25.579025+0000","last_became_active":"2023-09-13T02:12:24.586251+0000","last_became_peered":"2023-09-13T02:12:24.586251+0000","last_unstale":"2023-09-13T02:12:25.579025+0000","last_undegraded":"2023-09-13T02:12:25.579025+0000","last_fullsized":"2023-09-13T02:12:25.579025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:25.830036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759212+0000","last_change":"2023-09-13T02:12:23.579164+0000","last_active":"2023-09-13T02:12:25.759212+0000","last_peered":"2023-09-13T02:12:25.759212+0000","last_clean":"2023-09-13T02:12:25.759212+0000","last_became_active":"2023-09-13T02:12:23.578889+0000","last_became_peered":"2023-09-13T02:12:23.578889+0000","last_unstale":"2023-09-13T02:12:25.759212+0000","last_undegraded":"2023-09-13T02:12:25.759212+0000","last_fullsized":"2023-09-13T02:12:25.759212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607827+0000","last_change":"2023-09-13T02:12:24.579559+0000","last_active":"2023-09-13T02:12:25.607827+0000","last_peered":"2023-09-13T02:12:25.607827+0000","last_clean":"2023-09-13T02:12:25.607827+0000","last_became_active":"2023-09-13T02:12:24.579243+0000","last_became_peered":"2023-09-13T02:12:24.579243+0000","last_unstale":"2023-09-13T02:12:25.607827+0000","last_undegraded":"2023-09-13T02:12:25.607827+0000","last_fullsized":"2023-09-13T02:12:25.607827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757122+0000","last_change":"2023-09-13T02:12:23.577022+0000","last_active":"2023-09-13T02:12:25.757122+0000","last_peered":"2023-09-13T02:12:25.757122+0000","last_clean":"2023-09-13T02:12:25.757122+0000","last_became_active":"2023-09-13T02:12:23.576754+0000","last_became_peered":"2023-09-13T02:12:23.576754+0000","last_unstale":"2023-09-13T02:12:25.757122+0000","last_undegraded":"2023-09-13T02:12:25.757122+0000","last_fullsized":"2023-09-13T02:12:25.757122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:49.820358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.758996+0000","last_change":"2023-09-13T02:12:23.579634+0000","last_active":"2023-09-13T02:12:25.758996+0000","last_peered":"2023-09-13T02:12:25.758996+0000","last_clean":"2023-09-13T02:12:25.758996+0000","last_became_active":"2023-09-13T02:12:23.579351+0000","last_became_peered":"2023-09-13T02:12:23.579351+0000","last_unstale":"2023-09-13T02:12:25.758996+0000","last_undegraded":"2023-09-13T02:12:25.758996+0000","last_fullsized":"2023-09-13T02:12:25.758996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:24.826159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.758949+0000","last_change":"2023-09-13T02:12:24.590474+0000","last_active":"2023-09-13T02:12:25.758949+0000","last_peered":"2023-09-13T02:12:25.758949+0000","last_clean":"2023-09-13T02:12:25.758949+0000","last_became_active":"2023-09-13T02:12:24.590126+0000","last_became_peered":"2023-09-13T02:12:24.590126+0000","last_unstale":"2023-09-13T02:12:25.758949+0000","last_undegraded":"2023-09-13T02:12:25.758949+0000","last_fullsized":"2023-09-13T02:12:25.758949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657959+0000","last_change":"2023-09-13T02:12:23.586264+0000","last_active":"2023-09-13T02:12:25.657959+0000","last_peered":"2023-09-13T02:12:25.657959+0000","last_clean":"2023-09-13T02:12:25.657959+0000","last_became_active":"2023-09-13T02:12:23.585953+0000","last_became_peered":"2023-09-13T02:12:23.585953+0000","last_unstale":"2023-09-13T02:12:25.657959+0000","last_undegraded":"2023-09-13T02:12:25.657959+0000","last_fullsized":"2023-09-13T02:12:25.657959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:27.359818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578575+0000","last_change":"2023-09-13T02:12:24.585138+0000","last_active":"2023-09-13T02:12:25.578575+0000","last_peered":"2023-09-13T02:12:25.578575+0000","last_clean":"2023-09-13T02:12:25.578575+0000","last_became_active":"2023-09-13T02:12:24.584901+0000","last_became_peered":"2023-09-13T02:12:24.584901+0000","last_unstale":"2023-09-13T02:12:25.578575+0000","last_undegraded":"2023-09-13T02:12:25.578575+0000","last_fullsized":"2023-09-13T02:12:25.578575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757459+0000","last_change":"2023-09-13T02:12:23.583663+0000","last_active":"2023-09-13T02:12:25.757459+0000","last_peered":"2023-09-13T02:12:25.757459+0000","last_clean":"2023-09-13T02:12:25.757459+0000","last_became_active":"2023-09-13T02:12:23.583305+0000","last_became_peered":"2023-09-13T02:12:23.583305+0000","last_unstale":"2023-09-13T02:12:25.757459+0000","last_undegraded":"2023-09-13T02:12:25.757459+0000","last_fullsized":"2023-09-13T02:12:25.757459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:32.660244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658293+0000","last_change":"2023-09-13T02:12:24.595264+0000","last_active":"2023-09-13T02:12:25.658293+0000","last_peered":"2023-09-13T02:12:25.658293+0000","last_clean":"2023-09-13T02:12:25.658293+0000","last_became_active":"2023-09-13T02:12:24.594434+0000","last_became_peered":"2023-09-13T02:12:24.594434+0000","last_unstale":"2023-09-13T02:12:25.658293+0000","last_undegraded":"2023-09-13T02:12:25.658293+0000","last_fullsized":"2023-09-13T02:12:25.658293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:17:30.897344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658326+0000","last_change":"2023-09-13T02:12:23.584935+0000","last_active":"2023-09-13T02:12:25.658326+0000","last_peered":"2023-09-13T02:12:25.658326+0000","last_clean":"2023-09-13T02:12:25.658326+0000","last_became_active":"2023-09-13T02:12:23.584657+0000","last_became_peered":"2023-09-13T02:12:23.584657+0000","last_unstale":"2023-09-13T02:12:25.658326+0000","last_undegraded":"2023-09-13T02:12:25.658326+0000","last_fullsized":"2023-09-13T02:12:25.658326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:36.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607761+0000","last_change":"2023-09-13T02:12:24.588694+0000","last_active":"2023-09-13T02:12:25.607761+0000","last_peered":"2023-09-13T02:12:25.607761+0000","last_clean":"2023-09-13T02:12:25.607761+0000","last_became_active":"2023-09-13T02:12:24.588455+0000","last_became_peered":"2023-09-13T02:12:24.588455+0000","last_unstale":"2023-09-13T02:12:25.607761+0000","last_undegraded":"2023-09-13T02:12:25.607761+0000","last_fullsized":"2023-09-13T02:12:25.607761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578696+0000","last_change":"2023-09-13T02:12:23.582781+0000","last_active":"2023-09-13T02:12:25.578696+0000","last_peered":"2023-09-13T02:12:25.578696+0000","last_clean":"2023-09-13T02:12:25.578696+0000","last_became_active":"2023-09-13T02:12:23.582506+0000","last_became_peered":"2023-09-13T02:12:23.582506+0000","last_unstale":"2023-09-13T02:12:25.578696+0000","last_undegraded":"2023-09-13T02:12:25.578696+0000","last_fullsized":"2023-09-13T02:12:25.578696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:03.890491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579403+0000","last_change":"2023-09-13T02:12:24.594514+0000","last_active":"2023-09-13T02:12:25.579403+0000","last_peered":"2023-09-13T02:12:25.579403+0000","last_clean":"2023-09-13T02:12:25.579403+0000","last_became_active":"2023-09-13T02:12:24.592367+0000","last_became_peered":"2023-09-13T02:12:24.592367+0000","last_unstale":"2023-09-13T02:12:25.579403+0000","last_undegraded":"2023-09-13T02:12:25.579403+0000","last_fullsized":"2023-09-13T02:12:25.579403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:08.045218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757371+0000","last_change":"2023-09-13T02:12:23.579000+0000","last_active":"2023-09-13T02:12:25.757371+0000","last_peered":"2023-09-13T02:12:25.757371+0000","last_clean":"2023-09-13T02:12:25.757371+0000","last_became_active":"2023-09-13T02:12:23.578748+0000","last_became_peered":"2023-09-13T02:12:23.578748+0000","last_unstale":"2023-09-13T02:12:25.757371+0000","last_undegraded":"2023-09-13T02:12:25.757371+0000","last_fullsized":"2023-09-13T02:12:25.757371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:38.025574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257924+0000","last_change":"2023-09-13T02:12:24.593514+0000","last_active":"2023-09-13T02:12:26.257924+0000","last_peered":"2023-09-13T02:12:26.257924+0000","last_clean":"2023-09-13T02:12:26.257924+0000","last_became_active":"2023-09-13T02:12:24.593092+0000","last_became_peered":"2023-09-13T02:12:24.593092+0000","last_unstale":"2023-09-13T02:12:26.257924+0000","last_undegraded":"2023-09-13T02:12:26.257924+0000","last_fullsized":"2023-09-13T02:12:26.257924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:18:08.378805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607886+0000","last_change":"2023-09-13T02:12:23.579348+0000","last_active":"2023-09-13T02:12:25.607886+0000","last_peered":"2023-09-13T02:12:25.607886+0000","last_clean":"2023-09-13T02:12:25.607886+0000","last_became_active":"2023-09-13T02:12:23.579079+0000","last_became_peered":"2023-09-13T02:12:23.579079+0000","last_unstale":"2023-09-13T02:12:25.607886+0000","last_undegraded":"2023-09-13T02:12:25.607886+0000","last_fullsized":"2023-09-13T02:12:25.607886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:07.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607669+0000","last_change":"2023-09-13T02:12:24.587235+0000","last_active":"2023-09-13T02:12:25.607669+0000","last_peered":"2023-09-13T02:12:25.607669+0000","last_clean":"2023-09-13T02:12:25.607669+0000","last_became_active":"2023-09-13T02:12:24.586930+0000","last_became_peered":"2023-09-13T02:12:24.586930+0000","last_unstale":"2023-09-13T02:12:25.607669+0000","last_undegraded":"2023-09-13T02:12:25.607669+0000","last_fullsized":"2023-09-13T02:12:25.607669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658035+0000","last_change":"2023-09-13T02:12:23.585680+0000","last_active":"2023-09-13T02:12:25.658035+0000","last_peered":"2023-09-13T02:12:25.658035+0000","last_clean":"2023-09-13T02:12:25.658035+0000","last_became_active":"2023-09-13T02:12:23.585417+0000","last_became_peered":"2023-09-13T02:12:23.585417+0000","last_unstale":"2023-09-13T02:12:25.658035+0000","last_undegraded":"2023-09-13T02:12:25.658035+0000","last_fullsized":"2023-09-13T02:12:25.658035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:03.890491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257950+0000","last_change":"2023-09-13T02:12:24.592703+0000","last_active":"2023-09-13T02:12:26.257950+0000","last_peered":"2023-09-13T02:12:26.257950+0000","last_clean":"2023-09-13T02:12:26.257950+0000","last_became_active":"2023-09-13T02:12:24.591849+0000","last_became_peered":"2023-09-13T02:12:24.591849+0000","last_unstale":"2023-09-13T02:12:26.257950+0000","last_undegraded":"2023-09-13T02:12:26.257950+0000","last_fullsized":"2023-09-13T02:12:26.257950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:17:30.897344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757127+0000","last_change":"2023-09-13T02:12:23.576659+0000","last_active":"2023-09-13T02:12:25.757127+0000","last_peered":"2023-09-13T02:12:25.757127+0000","last_clean":"2023-09-13T02:12:25.757127+0000","last_became_active":"2023-09-13T02:12:23.576022+0000","last_became_peered":"2023-09-13T02:12:23.576022+0000","last_unstale":"2023-09-13T02:12:25.757127+0000","last_undegraded":"2023-09-13T02:12:25.757127+0000","last_fullsized":"2023-09-13T02:12:25.757127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:51.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757259+0000","last_change":"2023-09-13T02:12:24.591552+0000","last_active":"2023-09-13T02:12:25.757259+0000","last_peered":"2023-09-13T02:12:25.757259+0000","last_clean":"2023-09-13T02:12:25.757259+0000","last_became_active":"2023-09-13T02:12:24.591247+0000","last_became_peered":"2023-09-13T02:12:24.591247+0000","last_unstale":"2023-09-13T02:12:25.757259+0000","last_undegraded":"2023-09-13T02:12:25.757259+0000","last_fullsized":"2023-09-13T02:12:25.757259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575456+0000","last_change":"2023-09-13T02:12:23.570753+0000","last_active":"2023-09-13T02:12:25.575456+0000","last_peered":"2023-09-13T02:12:25.575456+0000","last_clean":"2023-09-13T02:12:25.575456+0000","last_became_active":"2023-09-13T02:12:23.570461+0000","last_became_peered":"2023-09-13T02:12:23.570461+0000","last_unstale":"2023-09-13T02:12:25.575456+0000","last_undegraded":"2023-09-13T02:12:25.575456+0000","last_fullsized":"2023-09-13T02:12:25.575456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257684+0000","last_change":"2023-09-13T02:12:24.591474+0000","last_active":"2023-09-13T02:12:26.257684+0000","last_peered":"2023-09-13T02:12:26.257684+0000","last_clean":"2023-09-13T02:12:26.257684+0000","last_became_active":"2023-09-13T02:12:24.591036+0000","last_became_peered":"2023-09-13T02:12:24.591036+0000","last_unstale":"2023-09-13T02:12:26.257684+0000","last_undegraded":"2023-09-13T02:12:26.257684+0000","last_fullsized":"2023-09-13T02:12:26.257684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579539+0000","last_change":"2023-09-13T02:12:23.584508+0000","last_active":"2023-09-13T02:12:25.579539+0000","last_peered":"2023-09-13T02:12:25.579539+0000","last_clean":"2023-09-13T02:12:25.579539+0000","last_became_active":"2023-09-13T02:12:23.584235+0000","last_became_peered":"2023-09-13T02:12:23.584235+0000","last_unstale":"2023-09-13T02:12:25.579539+0000","last_undegraded":"2023-09-13T02:12:25.579539+0000","last_fullsized":"2023-09-13T02:12:25.579539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258168+0000","last_change":"2023-09-13T02:12:24.593312+0000","last_active":"2023-09-13T02:12:26.258168+0000","last_peered":"2023-09-13T02:12:26.258168+0000","last_clean":"2023-09-13T02:12:26.258168+0000","last_became_active":"2023-09-13T02:12:24.592242+0000","last_became_peered":"2023-09-13T02:12:24.592242+0000","last_unstale":"2023-09-13T02:12:26.258168+0000","last_undegraded":"2023-09-13T02:12:26.258168+0000","last_fullsized":"2023-09-13T02:12:26.258168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:03:12.365120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575647+0000","last_change":"2023-09-13T02:12:23.578204+0000","last_active":"2023-09-13T02:12:25.575647+0000","last_peered":"2023-09-13T02:12:25.575647+0000","last_clean":"2023-09-13T02:12:25.575647+0000","last_became_active":"2023-09-13T02:12:23.577918+0000","last_became_peered":"2023-09-13T02:12:23.577918+0000","last_unstale":"2023-09-13T02:12:25.575647+0000","last_undegraded":"2023-09-13T02:12:25.575647+0000","last_fullsized":"2023-09-13T02:12:25.575647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:24.826159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258382+0000","last_change":"2023-09-13T02:12:24.595748+0000","last_active":"2023-09-13T02:12:26.258382+0000","last_peered":"2023-09-13T02:12:26.258382+0000","last_clean":"2023-09-13T02:12:26.258382+0000","last_became_active":"2023-09-13T02:12:24.595462+0000","last_became_peered":"2023-09-13T02:12:24.595462+0000","last_unstale":"2023-09-13T02:12:26.258382+0000","last_undegraded":"2023-09-13T02:12:26.258382+0000","last_fullsized":"2023-09-13T02:12:26.258382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:52:10.210519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578762+0000","last_change":"2023-09-13T02:12:23.570346+0000","last_active":"2023-09-13T02:12:25.578762+0000","last_peered":"2023-09-13T02:12:25.578762+0000","last_clean":"2023-09-13T02:12:25.578762+0000","last_became_active":"2023-09-13T02:12:23.570066+0000","last_became_peered":"2023-09-13T02:12:23.570066+0000","last_unstale":"2023-09-13T02:12:25.578762+0000","last_undegraded":"2023-09-13T02:12:25.578762+0000","last_fullsized":"2023-09-13T02:12:25.578762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:36.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658261+0000","last_change":"2023-09-13T02:12:24.595650+0000","last_active":"2023-09-13T02:12:25.658261+0000","last_peered":"2023-09-13T02:12:25.658261+0000","last_clean":"2023-09-13T02:12:25.658261+0000","last_became_active":"2023-09-13T02:12:24.595327+0000","last_became_peered":"2023-09-13T02:12:24.595327+0000","last_unstale":"2023-09-13T02:12:25.658261+0000","last_undegraded":"2023-09-13T02:12:25.658261+0000","last_fullsized":"2023-09-13T02:12:25.658261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:43:26.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575622+0000","last_change":"2023-09-13T02:12:23.583113+0000","last_active":"2023-09-13T02:12:25.575622+0000","last_peered":"2023-09-13T02:12:25.575622+0000","last_clean":"2023-09-13T02:12:25.575622+0000","last_became_active":"2023-09-13T02:12:23.582841+0000","last_became_peered":"2023-09-13T02:12:23.582841+0000","last_unstale":"2023-09-13T02:12:25.575622+0000","last_undegraded":"2023-09-13T02:12:25.575622+0000","last_fullsized":"2023-09-13T02:12:25.575622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257997+0000","last_change":"2023-09-13T02:12:24.590616+0000","last_active":"2023-09-13T02:12:26.257997+0000","last_peered":"2023-09-13T02:12:26.257997+0000","last_clean":"2023-09-13T02:12:26.257997+0000","last_became_active":"2023-09-13T02:12:24.590343+0000","last_became_peered":"2023-09-13T02:12:24.590343+0000","last_unstale":"2023-09-13T02:12:26.257997+0000","last_undegraded":"2023-09-13T02:12:26.257997+0000","last_fullsized":"2023-09-13T02:12:26.257997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:15.126313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-13T02:12:24.581028+0000","last_change":"2023-09-13T02:12:13.261542+0000","last_active":"2023-09-13T02:12:24.581028+0000","last_peered":"2023-09-13T02:12:24.581028+0000","last_clean":"2023-09-13T02:12:24.581028+0000","last_became_active":"2023-09-13T02:12:13.260630+0000","last_became_peered":"2023-09-13T02:12:13.260630+0000","last_unstale":"2023-09-13T02:12:24.581028+0000","last_undegraded":"2023-09-13T02:12:24.581028+0000","last_fullsized":"2023-09-13T02:12:24.581028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:12.209844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:12.209844+0000","last_clean_scrub_stamp":"2023-09-13T02:12:12.209844+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:07:47.139624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.657930+0000","last_change":"2023-09-13T02:12:23.584227+0000","last_active":"2023-09-13T02:12:25.657930+0000","last_peered":"2023-09-13T02:12:25.657930+0000","last_clean":"2023-09-13T02:12:25.657930+0000","last_became_active":"2023-09-13T02:12:23.583874+0000","last_became_peered":"2023-09-13T02:12:23.583874+0000","last_unstale":"2023-09-13T02:12:25.657930+0000","last_undegraded":"2023-09-13T02:12:25.657930+0000","last_fullsized":"2023-09-13T02:12:25.657930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759254+0000","last_change":"2023-09-13T02:12:24.588833+0000","last_active":"2023-09-13T02:12:25.759254+0000","last_peered":"2023-09-13T02:12:25.759254+0000","last_clean":"2023-09-13T02:12:25.759254+0000","last_became_active":"2023-09-13T02:12:24.588586+0000","last_became_peered":"2023-09-13T02:12:24.588586+0000","last_unstale":"2023-09-13T02:12:25.759254+0000","last_undegraded":"2023-09-13T02:12:25.759254+0000","last_fullsized":"2023-09-13T02:12:25.759254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257567+0000","last_change":"2023-09-13T02:12:23.580928+0000","last_active":"2023-09-13T02:12:26.257567+0000","last_peered":"2023-09-13T02:12:26.257567+0000","last_clean":"2023-09-13T02:12:26.257567+0000","last_became_active":"2023-09-13T02:12:23.580670+0000","last_became_peered":"2023-09-13T02:12:23.580670+0000","last_unstale":"2023-09-13T02:12:26.257567+0000","last_undegraded":"2023-09-13T02:12:26.257567+0000","last_fullsized":"2023-09-13T02:12:26.257567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607517+0000","last_change":"2023-09-13T02:12:24.579008+0000","last_active":"2023-09-13T02:12:25.607517+0000","last_peered":"2023-09-13T02:12:25.607517+0000","last_clean":"2023-09-13T02:12:25.607517+0000","last_became_active":"2023-09-13T02:12:24.578715+0000","last_became_peered":"2023-09-13T02:12:24.578715+0000","last_unstale":"2023-09-13T02:12:25.607517+0000","last_undegraded":"2023-09-13T02:12:25.607517+0000","last_fullsized":"2023-09-13T02:12:25.607517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:04.894368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.575647+0000","last_change":"2023-09-13T02:12:23.578080+0000","last_active":"2023-09-13T02:12:25.575647+0000","last_peered":"2023-09-13T02:12:25.575647+0000","last_clean":"2023-09-13T02:12:25.575647+0000","last_became_active":"2023-09-13T02:12:23.577786+0000","last_became_peered":"2023-09-13T02:12:23.577786+0000","last_unstale":"2023-09-13T02:12:25.575647+0000","last_undegraded":"2023-09-13T02:12:25.575647+0000","last_fullsized":"2023-09-13T02:12:25.575647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:51.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578694+0000","last_change":"2023-09-13T02:12:24.582717+0000","last_active":"2023-09-13T02:12:25.578694+0000","last_peered":"2023-09-13T02:12:25.578694+0000","last_clean":"2023-09-13T02:12:25.578694+0000","last_became_active":"2023-09-13T02:12:24.582439+0000","last_became_peered":"2023-09-13T02:12:24.582439+0000","last_unstale":"2023-09-13T02:12:25.578694+0000","last_undegraded":"2023-09-13T02:12:25.578694+0000","last_fullsized":"2023-09-13T02:12:25.578694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658155+0000","last_change":"2023-09-13T02:12:23.585601+0000","last_active":"2023-09-13T02:12:25.658155+0000","last_peered":"2023-09-13T02:12:25.658155+0000","last_clean":"2023-09-13T02:12:25.658155+0000","last_became_active":"2023-09-13T02:12:23.585349+0000","last_became_peered":"2023-09-13T02:12:23.585349+0000","last_unstale":"2023-09-13T02:12:25.658155+0000","last_undegraded":"2023-09-13T02:12:25.658155+0000","last_fullsized":"2023-09-13T02:12:25.658155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:38.820251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579475+0000","last_change":"2023-09-13T02:12:24.586175+0000","last_active":"2023-09-13T02:12:25.579475+0000","last_peered":"2023-09-13T02:12:25.579475+0000","last_clean":"2023-09-13T02:12:25.579475+0000","last_became_active":"2023-09-13T02:12:24.585054+0000","last_became_peered":"2023-09-13T02:12:24.585054+0000","last_unstale":"2023-09-13T02:12:25.579475+0000","last_undegraded":"2023-09-13T02:12:25.579475+0000","last_fullsized":"2023-09-13T02:12:25.579475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:39.029452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578671+0000","last_change":"2023-09-13T02:12:23.580143+0000","last_active":"2023-09-13T02:12:25.578671+0000","last_peered":"2023-09-13T02:12:25.578671+0000","last_clean":"2023-09-13T02:12:25.578671+0000","last_became_active":"2023-09-13T02:12:23.579844+0000","last_became_peered":"2023-09-13T02:12:23.579844+0000","last_unstale":"2023-09-13T02:12:25.578671+0000","last_undegraded":"2023-09-13T02:12:25.578671+0000","last_fullsized":"2023-09-13T02:12:25.578671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:21:49.468231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658375+0000","last_change":"2023-09-13T02:12:24.592756+0000","last_active":"2023-09-13T02:12:25.658375+0000","last_peered":"2023-09-13T02:12:25.658375+0000","last_clean":"2023-09-13T02:12:25.658375+0000","last_became_active":"2023-09-13T02:12:24.592436+0000","last_became_peered":"2023-09-13T02:12:24.592436+0000","last_unstale":"2023-09-13T02:12:25.658375+0000","last_undegraded":"2023-09-13T02:12:25.658375+0000","last_fullsized":"2023-09-13T02:12:25.658375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:03:12.365120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258168+0000","last_change":"2023-09-13T02:12:23.585605+0000","last_active":"2023-09-13T02:12:26.258168+0000","last_peered":"2023-09-13T02:12:26.258168+0000","last_clean":"2023-09-13T02:12:26.258168+0000","last_became_active":"2023-09-13T02:12:23.585411+0000","last_became_peered":"2023-09-13T02:12:23.585411+0000","last_unstale":"2023-09-13T02:12:26.258168+0000","last_undegraded":"2023-09-13T02:12:26.258168+0000","last_fullsized":"2023-09-13T02:12:26.258168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:40.286050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578716+0000","last_change":"2023-09-13T02:12:24.582796+0000","last_active":"2023-09-13T02:12:25.578716+0000","last_peered":"2023-09-13T02:12:25.578716+0000","last_clean":"2023-09-13T02:12:25.578716+0000","last_became_active":"2023-09-13T02:12:24.582517+0000","last_became_peered":"2023-09-13T02:12:24.582517+0000","last_unstale":"2023-09-13T02:12:25.578716+0000","last_undegraded":"2023-09-13T02:12:25.578716+0000","last_fullsized":"2023-09-13T02:12:25.578716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:27.101414+0000","last_change":"2023-09-13T02:12:23.576140+0000","last_active":"2023-09-13T02:12:27.101414+0000","last_peered":"2023-09-13T02:12:27.101414+0000","last_clean":"2023-09-13T02:12:27.101414+0000","last_became_active":"2023-09-13T02:12:23.575875+0000","last_became_peered":"2023-09-13T02:12:23.575875+0000","last_unstale":"2023-09-13T02:12:27.101414+0000","last_undegraded":"2023-09-13T02:12:27.101414+0000","last_fullsized":"2023-09-13T02:12:27.101414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:07.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759378+0000","last_change":"2023-09-13T02:12:24.592556+0000","last_active":"2023-09-13T02:12:25.759378+0000","last_peered":"2023-09-13T02:12:25.759378+0000","last_clean":"2023-09-13T02:12:25.759378+0000","last_became_active":"2023-09-13T02:12:24.592247+0000","last_became_peered":"2023-09-13T02:12:24.592247+0000","last_unstale":"2023-09-13T02:12:25.759378+0000","last_undegraded":"2023-09-13T02:12:25.759378+0000","last_fullsized":"2023-09-13T02:12:25.759378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757473+0000","last_change":"2023-09-13T02:12:23.579687+0000","last_active":"2023-09-13T02:12:25.757473+0000","last_peered":"2023-09-13T02:12:25.757473+0000","last_clean":"2023-09-13T02:12:25.757473+0000","last_became_active":"2023-09-13T02:12:23.579389+0000","last_became_peered":"2023-09-13T02:12:23.579389+0000","last_unstale":"2023-09-13T02:12:25.757473+0000","last_undegraded":"2023-09-13T02:12:25.757473+0000","last_fullsized":"2023-09-13T02:12:25.757473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607754+0000","last_change":"2023-09-13T02:12:24.585029+0000","last_active":"2023-09-13T02:12:25.607754+0000","last_peered":"2023-09-13T02:12:25.607754+0000","last_clean":"2023-09-13T02:12:25.607754+0000","last_became_active":"2023-09-13T02:12:24.584791+0000","last_became_peered":"2023-09-13T02:12:24.584791+0000","last_unstale":"2023-09-13T02:12:25.607754+0000","last_undegraded":"2023-09-13T02:12:25.607754+0000","last_fullsized":"2023-09-13T02:12:25.607754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257573+0000","last_change":"2023-09-13T02:12:23.585601+0000","last_active":"2023-09-13T02:12:26.257573+0000","last_peered":"2023-09-13T02:12:26.257573+0000","last_clean":"2023-09-13T02:12:26.257573+0000","last_became_active":"2023-09-13T02:12:23.585321+0000","last_became_peered":"2023-09-13T02:12:23.585321+0000","last_unstale":"2023-09-13T02:12:26.257573+0000","last_undegraded":"2023-09-13T02:12:26.257573+0000","last_fullsized":"2023-09-13T02:12:26.257573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.579437+0000","last_change":"2023-09-13T02:12:24.586947+0000","last_active":"2023-09-13T02:12:25.579437+0000","last_peered":"2023-09-13T02:12:25.579437+0000","last_clean":"2023-09-13T02:12:25.579437+0000","last_became_active":"2023-09-13T02:12:24.586072+0000","last_became_peered":"2023-09-13T02:12:24.586072+0000","last_unstale":"2023-09-13T02:12:25.579437+0000","last_undegraded":"2023-09-13T02:12:25.579437+0000","last_fullsized":"2023-09-13T02:12:25.579437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:50.824236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578663+0000","last_change":"2023-09-13T02:12:23.578914+0000","last_active":"2023-09-13T02:12:25.578663+0000","last_peered":"2023-09-13T02:12:25.578663+0000","last_clean":"2023-09-13T02:12:25.578663+0000","last_became_active":"2023-09-13T02:12:23.578649+0000","last_became_peered":"2023-09-13T02:12:23.578649+0000","last_unstale":"2023-09-13T02:12:25.578663+0000","last_undegraded":"2023-09-13T02:12:25.578663+0000","last_fullsized":"2023-09-13T02:12:25.578663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759041+0000","last_change":"2023-09-13T02:12:24.585743+0000","last_active":"2023-09-13T02:12:25.759041+0000","last_peered":"2023-09-13T02:12:25.759041+0000","last_clean":"2023-09-13T02:12:25.759041+0000","last_became_active":"2023-09-13T02:12:24.585508+0000","last_became_peered":"2023-09-13T02:12:24.585508+0000","last_unstale":"2023-09-13T02:12:25.759041+0000","last_undegraded":"2023-09-13T02:12:25.759041+0000","last_fullsized":"2023-09-13T02:12:25.759041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.578790+0000","last_change":"2023-09-13T02:12:23.578387+0000","last_active":"2023-09-13T02:12:25.578790+0000","last_peered":"2023-09-13T02:12:25.578790+0000","last_clean":"2023-09-13T02:12:25.578790+0000","last_became_active":"2023-09-13T02:12:23.578121+0000","last_became_peered":"2023-09-13T02:12:23.578121+0000","last_unstale":"2023-09-13T02:12:25.578790+0000","last_undegraded":"2023-09-13T02:12:25.578790+0000","last_fullsized":"2023-09-13T02:12:25.578790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:32.660244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759336+0000","last_change":"2023-09-13T02:12:24.587304+0000","last_active":"2023-09-13T02:12:25.759336+0000","last_peered":"2023-09-13T02:12:25.759336+0000","last_clean":"2023-09-13T02:12:25.759336+0000","last_became_active":"2023-09-13T02:12:24.587040+0000","last_became_peered":"2023-09-13T02:12:24.587040+0000","last_unstale":"2023-09-13T02:12:25.759336+0000","last_undegraded":"2023-09-13T02:12:25.759336+0000","last_fullsized":"2023-09-13T02:12:25.759336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:18.256464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258112+0000","last_change":"2023-09-13T02:12:23.578623+0000","last_active":"2023-09-13T02:12:26.258112+0000","last_peered":"2023-09-13T02:12:26.258112+0000","last_clean":"2023-09-13T02:12:26.258112+0000","last_became_active":"2023-09-13T02:12:23.578258+0000","last_became_peered":"2023-09-13T02:12:23.578258+0000","last_unstale":"2023-09-13T02:12:26.258112+0000","last_undegraded":"2023-09-13T02:12:26.258112+0000","last_fullsized":"2023-09-13T02:12:26.258112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:18:54.951761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.757225+0000","last_change":"2023-09-13T02:12:24.590763+0000","last_active":"2023-09-13T02:12:25.757225+0000","last_peered":"2023-09-13T02:12:25.757225+0000","last_clean":"2023-09-13T02:12:25.757225+0000","last_became_active":"2023-09-13T02:12:24.590494+0000","last_became_peered":"2023-09-13T02:12:24.590494+0000","last_unstale":"2023-09-13T02:12:25.757225+0000","last_undegraded":"2023-09-13T02:12:25.757225+0000","last_fullsized":"2023-09-13T02:12:25.757225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658298+0000","last_change":"2023-09-13T02:12:24.597290+0000","last_active":"2023-09-13T02:12:25.658298+0000","last_peered":"2023-09-13T02:12:25.658298+0000","last_clean":"2023-09-13T02:12:25.658298+0000","last_became_active":"2023-09-13T02:12:24.597024+0000","last_became_peered":"2023-09-13T02:12:24.597024+0000","last_unstale":"2023-09-13T02:12:25.658298+0000","last_undegraded":"2023-09-13T02:12:25.658298+0000","last_fullsized":"2023-09-13T02:12:25.658298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:15.126313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.257895+0000","last_change":"2023-09-13T02:12:23.584941+0000","last_active":"2023-09-13T02:12:26.257895+0000","last_peered":"2023-09-13T02:12:26.257895+0000","last_clean":"2023-09-13T02:12:26.257895+0000","last_became_active":"2023-09-13T02:12:23.584671+0000","last_became_peered":"2023-09-13T02:12:23.584671+0000","last_unstale":"2023-09-13T02:12:26.257895+0000","last_undegraded":"2023-09-13T02:12:26.257895+0000","last_fullsized":"2023-09-13T02:12:26.257895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:38.089400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.658128+0000","last_change":"2023-09-13T02:12:24.596615+0000","last_active":"2023-09-13T02:12:25.658128+0000","last_peered":"2023-09-13T02:12:25.658128+0000","last_clean":"2023-09-13T02:12:25.658128+0000","last_became_active":"2023-09-13T02:12:24.595918+0000","last_became_peered":"2023-09-13T02:12:24.595918+0000","last_unstale":"2023-09-13T02:12:25.658128+0000","last_undegraded":"2023-09-13T02:12:25.658128+0000","last_fullsized":"2023-09-13T02:12:25.658128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:18:08.378805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:26.258039+0000","last_change":"2023-09-13T02:12:23.579507+0000","last_active":"2023-09-13T02:12:26.258039+0000","last_peered":"2023-09-13T02:12:26.258039+0000","last_clean":"2023-09-13T02:12:26.258039+0000","last_became_active":"2023-09-13T02:12:23.579239+0000","last_became_peered":"2023-09-13T02:12:23.579239+0000","last_unstale":"2023-09-13T02:12:26.258039+0000","last_undegraded":"2023-09-13T02:12:26.258039+0000","last_fullsized":"2023-09-13T02:12:26.258039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:11.224076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607799+0000","last_change":"2023-09-13T02:12:24.589292+0000","last_active":"2023-09-13T02:12:25.607799+0000","last_peered":"2023-09-13T02:12:25.607799+0000","last_clean":"2023-09-13T02:12:25.607799+0000","last_became_active":"2023-09-13T02:12:24.589039+0000","last_became_peered":"2023-09-13T02:12:24.589039+0000","last_unstale":"2023-09-13T02:12:25.607799+0000","last_undegraded":"2023-09-13T02:12:25.607799+0000","last_fullsized":"2023-09-13T02:12:25.607799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759226+0000","last_change":"2023-09-13T02:12:23.584177+0000","last_active":"2023-09-13T02:12:25.759226+0000","last_peered":"2023-09-13T02:12:25.759226+0000","last_clean":"2023-09-13T02:12:25.759226+0000","last_became_active":"2023-09-13T02:12:23.583920+0000","last_became_peered":"2023-09-13T02:12:23.583920+0000","last_unstale":"2023-09-13T02:12:25.759226+0000","last_undegraded":"2023-09-13T02:12:25.759226+0000","last_fullsized":"2023-09-13T02:12:25.759226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:21:49.468231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.759093+0000","last_change":"2023-09-13T02:12:24.588205+0000","last_active":"2023-09-13T02:12:25.759093+0000","last_peered":"2023-09-13T02:12:25.759093+0000","last_clean":"2023-09-13T02:12:25.759093+0000","last_became_active":"2023-09-13T02:12:24.587697+0000","last_became_peered":"2023-09-13T02:12:24.587697+0000","last_unstale":"2023-09-13T02:12:25.759093+0000","last_undegraded":"2023-09-13T02:12:25.759093+0000","last_fullsized":"2023-09-13T02:12:25.759093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T02:12:25.607876+0000","last_change":"2023-09-13T02:12:23.583748+0000","last_active":"2023-09-13T02:12:25.607876+0000","last_peered":"2023-09-13T02:12:25.607876+0000","last_clean":"2023-09-13T02:12:25.607876+0000","last_became_active":"2023-09-13T02:12:23.583443+0000","last_became_peered":"2023-09-13T02:12:23.583443+0000","last_unstale":"2023-09-13T02:12:25.607876+0000","last_undegraded":"2023-09-13T02:12:25.607876+0000","last_fullsized":"2023-09-13T02:12:25.607876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T02:12:32.723 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-13T02:12:32.724 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-13T02:12:32.724 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-13T02:12:32.725 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-13T02:12:32.859 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.858+0000 7f0ef2446640 1 -- 172.21.15.104:0/637010868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ed4003970 msgr2=0x7f0ed4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:32.860 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.858+0000 7f0ef2446640 1 --2- 172.21.15.104:0/637010868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ed4003970 0x7f0ed4003d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00baf0 tx=0x7f0ed40057f0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.860 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.858+0000 7f0ef09e3640 1 -- 172.21.15.104:0/637010868 reap_dead start 2023-09-13T02:12:32.860 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.858+0000 7f0ef2446640 1 -- 172.21.15.104:0/637010868 shutdown_connections 2023-09-13T02:12:32.861 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.858+0000 7f0ef2446640 1 -- 172.21.15.104:0/637010868 >> 172.21.15.104:0/637010868 conn(0x7f0eec0b6860 msgr2=0x7f0eec0b6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:32.861 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.858+0000 7f0ef2446640 1 -- 172.21.15.104:0/637010868 shutdown_connections 2023-09-13T02:12:32.861 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.858+0000 7f0ef2446640 1 -- 172.21.15.104:0/637010868 wait complete. 2023-09-13T02:12:32.864 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.859+0000 7f0ef2446640 1 Processor -- start 2023-09-13T02:12:32.864 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.859+0000 7f0ef2446640 1 -- start start 2023-09-13T02:12:32.864 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0ef2446640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ed4003970 0x7f0eec1d6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:32.864 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0ef2446640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0eec135530 0x7f0eec1da9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:32.865 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0ef2446640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0eec13bb30 0x7f0eec12f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:32.865 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0ef2446640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec1359b0 con 0x7f0eec135530 2023-09-13T02:12:32.865 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0ef2446640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec13bfb0 con 0x7f0eec13bb30 2023-09-13T02:12:32.865 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0ef2446640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec1d9ef0 con 0x7f0ed4003970 2023-09-13T02:12:32.865 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0eec135530 0x7f0eec1da9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:32.866 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0eec135530 0x7f0eec1da9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47486/0 (socket says 172.21.15.104:47486) 2023-09-13T02:12:32.866 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0eeb7fe640 1 -- 172.21.15.104:0/1863243852 learned_addr learned my addr 172.21.15.104:0/1863243852 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:32.866 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0eebfff640 1 --2- 172.21.15.104:0/1863243852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ed4003970 0x7f0eec1d6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:32.866 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0ef09e3640 1 --2- 172.21.15.104:0/1863243852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0eec13bb30 0x7f0eec12f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:32.866 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0eeb7fe640 1 -- 172.21.15.104:0/1863243852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ed4003970 msgr2=0x7f0eec1d6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:32.867 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0eeb7fe640 1 --2- 172.21.15.104:0/1863243852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ed4003970 0x7f0eec1d6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.867 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0eeb7fe640 1 -- 172.21.15.104:0/1863243852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0eec13bb30 msgr2=0x7f0eec12f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:32.867 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0eeb7fe640 1 --2- 172.21.15.104:0/1863243852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0eec13bb30 0x7f0eec12f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:32.867 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0eeb7fe640 1 -- 172.21.15.104:0/1863243852 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec1da1b0 con 0x7f0eec135530 2023-09-13T02:12:32.867 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0eebfff640 1 --2- 172.21.15.104:0/1863243852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ed4003970 0x7f0eec1d6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:32.868 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0ef09e3640 1 --2- 172.21.15.104:0/1863243852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0eec13bb30 0x7f0eec12f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:32.868 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.860+0000 7f0eeb7fe640 1 --2- 172.21.15.104:0/1863243852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0eec135530 0x7f0eec1da9b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00066b0 tx=0x7f0ee00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:32.868 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.861+0000 7f0ee8ff9640 1 -- 172.21.15.104:0/1863243852 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0011900 con 0x7f0eec135530 2023-09-13T02:12:32.868 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.861+0000 7f0ee8ff9640 1 -- 172.21.15.104:0/1863243852 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ee0011a80 con 0x7f0eec135530 2023-09-13T02:12:32.869 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.861+0000 7f0ef2446640 1 -- 172.21.15.104:0/1863243852 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eec1da490 con 0x7f0eec135530 2023-09-13T02:12:32.869 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.861+0000 7f0ee8ff9640 1 -- 172.21.15.104:0/1863243852 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0011e90 con 0x7f0eec135530 2023-09-13T02:12:32.869 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.861+0000 7f0ef2446640 1 -- 172.21.15.104:0/1863243852 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec13b830 con 0x7f0eec135530 2023-09-13T02:12:32.869 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.862+0000 7f0ef2446640 1 -- 172.21.15.104:0/1863243852 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec1da6b0 con 0x7f0eec135530 2023-09-13T02:12:32.869 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.862+0000 7f0ee8ff9640 1 -- 172.21.15.104:0/1863243852 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f0ee0010420 con 0x7f0eec135530 2023-09-13T02:12:32.869 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.862+0000 7f0ee8ff9640 1 --2- 172.21.15.104:0/1863243852 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0ed806a4f0 0x7f0ed806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:32.870 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.863+0000 7f0eebfff640 1 --2- 172.21.15.104:0/1863243852 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0ed806a4f0 0x7f0ed806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:32.870 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.863+0000 7f0ee8ff9640 1 -- 172.21.15.104:0/1863243852 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ee0089c20 con 0x7f0eec135530 2023-09-13T02:12:32.870 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.863+0000 7f0eebfff640 1 --2- 172.21.15.104:0/1863243852 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0ed806a4f0 0x7f0ed806c9b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0edc037000 tx=0x7f0edc02e040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:32.871 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:32.867+0000 7f0ee8ff9640 1 -- 172.21.15.104:0/1863243852 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0ee00551b0 con 0x7f0eec135530 2023-09-13T02:12:33.068 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.067+0000 7f0ef2446640 1 -- 172.21.15.104:0/1863243852 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0eec0b09c0 con 0x7f0eec135530 2023-09-13T02:12:33.069 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.068+0000 7f0ee8ff9640 1 -- 172.21.15.104:0/1863243852 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0ee0015080 con 0x7f0eec135530 2023-09-13T02:12:33.069 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:33.069 INFO:teuthology.orchestra.run.smithi104.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-13T02:12:33.071 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.069+0000 7f0ef2446640 1 -- 172.21.15.104:0/1863243852 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0ed806a4f0 msgr2=0x7f0ed806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:33.071 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.069+0000 7f0ef2446640 1 --2- 172.21.15.104:0/1863243852 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0ed806a4f0 0x7f0ed806c9b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0edc037000 tx=0x7f0edc02e040 comp rx=0 tx=0).stop 2023-09-13T02:12:33.071 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.069+0000 7f0ef2446640 1 -- 172.21.15.104:0/1863243852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0eec135530 msgr2=0x7f0eec1da9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:33.071 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.069+0000 7f0ef2446640 1 --2- 172.21.15.104:0/1863243852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0eec135530 0x7f0eec1da9b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00066b0 tx=0x7f0ee00039c0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.071 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.069+0000 7f0ef2446640 1 -- 172.21.15.104:0/1863243852 shutdown_connections 2023-09-13T02:12:33.072 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.069+0000 7f0ef2446640 1 --2- 172.21.15.104:0/1863243852 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0ed806a4f0 0x7f0ed806c9b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.072 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.069+0000 7f0ef2446640 1 --2- 172.21.15.104:0/1863243852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0eec13bb30 0x7f0eec12f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.072 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.069+0000 7f0ef2446640 1 --2- 172.21.15.104:0/1863243852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0eec135530 0x7f0eec1da9b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.072 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.069+0000 7f0ef2446640 1 --2- 172.21.15.104:0/1863243852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ed4003970 0x7f0eec1d6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.072 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.069+0000 7f0ef2446640 1 -- 172.21.15.104:0/1863243852 >> 172.21.15.104:0/1863243852 conn(0x7f0eec0b6860 msgr2=0x7f0eec136a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:33.073 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.070+0000 7f0ef2446640 1 -- 172.21.15.104:0/1863243852 shutdown_connections 2023-09-13T02:12:33.073 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.070+0000 7f0ef2446640 1 -- 172.21.15.104:0/1863243852 wait complete. 2023-09-13T02:12:33.081 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-13T02:12:33.081 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T02:12:33.182 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.181+0000 7f282513e640 1 -- 172.21.15.104:0/680049844 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f282013a500 msgr2=0x7f282013a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:33.183 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.181+0000 7f282513e640 1 --2- 172.21.15.104:0/680049844 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f282013a500 0x7f282013a960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2820140d50 tx=0x7f281402d040 comp rx=0 tx=0).stop 2023-09-13T02:12:33.183 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.181+0000 7f282513e640 1 -- 172.21.15.104:0/680049844 shutdown_connections 2023-09-13T02:12:33.183 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.181+0000 7f282513e640 1 --2- 172.21.15.104:0/680049844 >> v2:172.21.15.119:3300/0 conn(0x7f2820143dc0 0x7f2820144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.183 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.181+0000 7f282513e640 1 --2- 172.21.15.104:0/680049844 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f282013a500 0x7f282013a960 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.183 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.181+0000 7f282513e640 1 -- 172.21.15.104:0/680049844 >> 172.21.15.104:0/680049844 conn(0x7f28200b56f0 msgr2=0x7f28200b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:33.184 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.181+0000 7f282513e640 1 -- 172.21.15.104:0/680049844 shutdown_connections 2023-09-13T02:12:33.184 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.181+0000 7f282513e640 1 -- 172.21.15.104:0/680049844 wait complete. 2023-09-13T02:12:33.186 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.182+0000 7f282513e640 1 Processor -- start 2023-09-13T02:12:33.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.182+0000 7f282513e640 1 -- start start 2023-09-13T02:12:33.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f282513e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28200b0ae0 0x7f282013f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:33.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f282513e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f282013a500 0x7f282006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:33.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f282513e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2820143dc0 0x7f282006f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:33.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f282513e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282013dc20 con 0x7f28200b0ae0 2023-09-13T02:12:33.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f282513e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282006fb90 con 0x7f2820143dc0 2023-09-13T02:12:33.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f282513e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282006e730 con 0x7f282013a500 2023-09-13T02:12:33.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f281ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28200b0ae0 0x7f282013f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:33.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f281ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28200b0ae0 0x7f282013f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47506/0 (socket says 172.21.15.104:47506) 2023-09-13T02:12:33.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f281ed9d640 1 -- 172.21.15.104:0/1342010138 learned_addr learned my addr 172.21.15.104:0/1342010138 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:33.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f281f59e640 1 --2- 172.21.15.104:0/1342010138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2820143dc0 0x7f282006f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:33.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f281e59c640 1 --2- 172.21.15.104:0/1342010138 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f282013a500 0x7f282006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:33.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f281ed9d640 1 -- 172.21.15.104:0/1342010138 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f282013a500 msgr2=0x7f282006f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:33.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f281ed9d640 1 --2- 172.21.15.104:0/1342010138 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f282013a500 0x7f282006f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f281ed9d640 1 -- 172.21.15.104:0/1342010138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2820143dc0 msgr2=0x7f282006f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:33.190 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f281ed9d640 1 --2- 172.21.15.104:0/1342010138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2820143dc0 0x7f282006f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.190 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f281ed9d640 1 -- 172.21.15.104:0/1342010138 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281400a670 con 0x7f28200b0ae0 2023-09-13T02:12:33.190 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f281f59e640 1 --2- 172.21.15.104:0/1342010138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2820143dc0 0x7f282006f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:33.190 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.183+0000 7f281ed9d640 1 --2- 172.21.15.104:0/1342010138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28200b0ae0 0x7f282013f9a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f281000c460 tx=0x7f281000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:33.191 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.184+0000 7f28077fe640 1 -- 172.21.15.104:0/1342010138 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810012830 con 0x7f28200b0ae0 2023-09-13T02:12:33.191 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.184+0000 7f28077fe640 1 -- 172.21.15.104:0/1342010138 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2810012ac0 con 0x7f28200b0ae0 2023-09-13T02:12:33.191 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.184+0000 7f282513e640 1 -- 172.21.15.104:0/1342010138 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282013d610 con 0x7f28200b0ae0 2023-09-13T02:12:33.191 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.184+0000 7f28077fe640 1 -- 172.21.15.104:0/1342010138 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810011380 con 0x7f28200b0ae0 2023-09-13T02:12:33.191 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.184+0000 7f282513e640 1 -- 172.21.15.104:0/1342010138 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282013d8b0 con 0x7f28200b0ae0 2023-09-13T02:12:33.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.185+0000 7f282513e640 1 -- 172.21.15.104:0/1342010138 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282013d470 con 0x7f28200b0ae0 2023-09-13T02:12:33.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.185+0000 7f28077fe640 1 -- 172.21.15.104:0/1342010138 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f28100114e0 con 0x7f28200b0ae0 2023-09-13T02:12:33.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.185+0000 7f28077fe640 1 --2- 172.21.15.104:0/1342010138 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f280c06a4f0 0x7f280c06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:33.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.185+0000 7f28077fe640 1 -- 172.21.15.104:0/1342010138 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2810088c10 con 0x7f28200b0ae0 2023-09-13T02:12:33.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.185+0000 7f281e59c640 1 --2- 172.21.15.104:0/1342010138 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f280c06a4f0 0x7f280c06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:33.193 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.186+0000 7f281e59c640 1 --2- 172.21.15.104:0/1342010138 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f280c06a4f0 0x7f280c06c9b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2814036000 tx=0x7f2814004730 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:33.193 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.189+0000 7f28077fe640 1 -- 172.21.15.104:0/1342010138 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f282013d470 con 0x7f28200b0ae0 2023-09-13T02:12:33.359 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.358+0000 7f282513e640 1 -- 172.21.15.104:0/1342010138 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f282013d470 con 0x7f28200b0ae0 2023-09-13T02:12:33.360 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.359+0000 7f28077fe640 1 -- 172.21.15.104:0/1342010138 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f282013d470 con 0x7f28200b0ae0 2023-09-13T02:12:33.361 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:33.361 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"ac1f5a95-0d3a-406e-b4ca-c8ea43282cab","created":"2023-09-13T02:11:59.067178+0000","modified":"2023-09-13T02:12:25.572652+0000","last_up_change":"2023-09-13T02:12:11.207888+0000","last_in_change":"2023-09-13T02:12:02.278796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T02:12:12.071023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T02:12:22.114609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T02:12:22.880593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67190066-4851-4b1f-aae8-bad59e79ebb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6801","nonce":3271772377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6803","nonce":3271772377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6807","nonce":3271772377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6805","nonce":3271772377}]},"public_addr":"172.21.15.104:6801/3271772377","cluster_addr":"172.21.15.104:6803/3271772377","heartbeat_back_addr":"172.21.15.104:6807/3271772377","heartbeat_front_addr":"172.21.15.104:6805/3271772377","state":["exists","up"]},{"osd":1,"uuid":"f1907075-bb97-4a19-8dd6-322232caaf4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6809","nonce":3786698894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6811","nonce":3786698894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6815","nonce":3786698894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6813","nonce":3786698894}]},"public_addr":"172.21.15.104:6809/3786698894","cluster_addr":"172.21.15.104:6811/3786698894","heartbeat_back_addr":"172.21.15.104:6815/3786698894","heartbeat_front_addr":"172.21.15.104:6813/3786698894","state":["exists","up"]},{"osd":2,"uuid":"8c323c83-330c-4181-b622-10177c81f975","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6819","nonce":2319361072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6822","nonce":2319361072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6827","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6829","nonce":2319361072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6826","nonce":2319361072}]},"public_addr":"172.21.15.104:6819/2319361072","cluster_addr":"172.21.15.104:6822/2319361072","heartbeat_back_addr":"172.21.15.104:6829/2319361072","heartbeat_front_addr":"172.21.15.104:6826/2319361072","state":["exists","up"]},{"osd":3,"uuid":"811457f5-c408-488d-a4ed-b947d1c55e82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6818","nonce":621253853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6823","nonce":621253853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6831","nonce":621253853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6825","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6828","nonce":621253853}]},"public_addr":"172.21.15.104:6818/621253853","cluster_addr":"172.21.15.104:6823/621253853","heartbeat_back_addr":"172.21.15.104:6831/621253853","heartbeat_front_addr":"172.21.15.104:6828/621253853","state":["exists","up"]},{"osd":4,"uuid":"552010ea-7d61-47c7-b4ac-657845e55e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6801","nonce":3049794634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6803","nonce":3049794634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6807","nonce":3049794634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6805","nonce":3049794634}]},"public_addr":"172.21.15.119:6801/3049794634","cluster_addr":"172.21.15.119:6803/3049794634","heartbeat_back_addr":"172.21.15.119:6807/3049794634","heartbeat_front_addr":"172.21.15.119:6805/3049794634","state":["exists","up"]},{"osd":5,"uuid":"41f415b0-6886-44ed-bccc-57c46cc975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6809","nonce":2918159428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6811","nonce":2918159428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6815","nonce":2918159428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6813","nonce":2918159428}]},"public_addr":"172.21.15.119:6809/2918159428","cluster_addr":"172.21.15.119:6811/2918159428","heartbeat_back_addr":"172.21.15.119:6815/2918159428","heartbeat_front_addr":"172.21.15.119:6813/2918159428","state":["exists","up"]},{"osd":6,"uuid":"1f415570-dbcc-4cb9-930a-ad31a96c3ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6825","nonce":3509665357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6827","nonce":3509665357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6831","nonce":3509665357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6829","nonce":3509665357}]},"public_addr":"172.21.15.119:6825/3509665357","cluster_addr":"172.21.15.119:6827/3509665357","heartbeat_back_addr":"172.21.15.119:6831/3509665357","heartbeat_front_addr":"172.21.15.119:6829/3509665357","state":["exists","up"]},{"osd":7,"uuid":"ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6817","nonce":892749725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6819","nonce":892749725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6823","nonce":892749725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6821","nonce":892749725}]},"public_addr":"172.21.15.119:6817/892749725","cluster_addr":"172.21.15.119:6819/892749725","heartbeat_back_addr":"172.21.15.119:6823/892749725","heartbeat_front_addr":"172.21.15.119:6821/892749725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.489481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.468615+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.485958+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.424425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.456308+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.427607+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T02:12:33.363 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.361+0000 7f282513e640 1 -- 172.21.15.104:0/1342010138 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f280c06a4f0 msgr2=0x7f280c06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:33.363 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.361+0000 7f282513e640 1 --2- 172.21.15.104:0/1342010138 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f280c06a4f0 0x7f280c06c9b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2814036000 tx=0x7f2814004730 comp rx=0 tx=0).stop 2023-09-13T02:12:33.363 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.361+0000 7f282513e640 1 -- 172.21.15.104:0/1342010138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28200b0ae0 msgr2=0x7f282013f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:33.363 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.361+0000 7f282513e640 1 --2- 172.21.15.104:0/1342010138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28200b0ae0 0x7f282013f9a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f281000c460 tx=0x7f281000c920 comp rx=0 tx=0).stop 2023-09-13T02:12:33.363 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.361+0000 7f282513e640 1 -- 172.21.15.104:0/1342010138 shutdown_connections 2023-09-13T02:12:33.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.361+0000 7f282513e640 1 --2- 172.21.15.104:0/1342010138 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f280c06a4f0 0x7f280c06c9b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.361+0000 7f282513e640 1 --2- 172.21.15.104:0/1342010138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2820143dc0 0x7f282006f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.361+0000 7f282513e640 1 --2- 172.21.15.104:0/1342010138 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f282013a500 0x7f282006f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.362+0000 7f282513e640 1 --2- 172.21.15.104:0/1342010138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28200b0ae0 0x7f282013f9a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.362+0000 7f282513e640 1 -- 172.21.15.104:0/1342010138 >> 172.21.15.104:0/1342010138 conn(0x7f28200b56f0 msgr2=0x7f28200aec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:33.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.362+0000 7f282513e640 1 -- 172.21.15.104:0/1342010138 shutdown_connections 2023-09-13T02:12:33.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.362+0000 7f282513e640 1 -- 172.21.15.104:0/1342010138 wait complete. 2023-09-13T02:12:33.374 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T02:12:12.071023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T02:12:22.114609+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T02:12:22.880593+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T02:12:33.374 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T02:12:33.478 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.477+0000 7fafdcba4640 1 -- 172.21.15.104:0/2159199543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafd80b1280 msgr2=0x7fafd813c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:33.479 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.477+0000 7fafdcba4640 1 --2- 172.21.15.104:0/2159199543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafd80b1280 0x7fafd813c460 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fafd806c110 tx=0x7fafc002bd30 comp rx=0 tx=0).stop 2023-09-13T02:12:33.479 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.477+0000 7fafdcba4640 1 -- 172.21.15.104:0/2159199543 shutdown_connections 2023-09-13T02:12:33.479 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.477+0000 7fafdcba4640 1 --2- 172.21.15.104:0/2159199543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafd80b1280 0x7fafd813c460 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.479 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.477+0000 7fafdcba4640 1 --2- 172.21.15.104:0/2159199543 >> v2:172.21.15.119:3300/0 conn(0x7fafd80aefb0 0x7fafd813bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.480 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.477+0000 7fafdcba4640 1 -- 172.21.15.104:0/2159199543 >> 172.21.15.104:0/2159199543 conn(0x7fafd80b56f0 msgr2=0x7fafd80b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:33.480 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.477+0000 7fafdcba4640 1 -- 172.21.15.104:0/2159199543 shutdown_connections 2023-09-13T02:12:33.480 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.477+0000 7fafdcba4640 1 -- 172.21.15.104:0/2159199543 wait complete. 2023-09-13T02:12:33.483 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.478+0000 7fafdcba4640 1 Processor -- start 2023-09-13T02:12:33.483 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafdcba4640 1 -- start start 2023-09-13T02:12:33.483 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafdcba4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafd80aefb0 0x7fafd813e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:33.483 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafdcba4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafd80b1280 0x7fafd8141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:33.484 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafdcba4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafd8142230 0x7fafd81db750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:33.484 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafdcba4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd813c9f0 con 0x7fafd8142230 2023-09-13T02:12:33.484 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafdcba4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd813ccd0 con 0x7fafd80b1280 2023-09-13T02:12:33.484 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafdcba4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd813f390 con 0x7fafd80aefb0 2023-09-13T02:12:33.484 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafd6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafd8142230 0x7fafd81db750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:33.485 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafd6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafd8142230 0x7fafd81db750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47524/0 (socket says 172.21.15.104:47524) 2023-09-13T02:12:33.485 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafd6d9d640 1 -- 172.21.15.104:0/3899465845 learned_addr learned my addr 172.21.15.104:0/3899465845 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:33.485 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafd659c640 1 --2- 172.21.15.104:0/3899465845 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafd80aefb0 0x7fafd813e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:33.485 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafcffff640 1 --2- 172.21.15.104:0/3899465845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafd80b1280 0x7fafd8141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:33.485 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafd6d9d640 1 -- 172.21.15.104:0/3899465845 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafd80aefb0 msgr2=0x7fafd813e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:33.486 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafd6d9d640 1 --2- 172.21.15.104:0/3899465845 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafd80aefb0 0x7fafd813e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.486 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafd6d9d640 1 -- 172.21.15.104:0/3899465845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafd80b1280 msgr2=0x7fafd8141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:33.486 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafd6d9d640 1 --2- 172.21.15.104:0/3899465845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafd80b1280 0x7fafd8141840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.486 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafd6d9d640 1 -- 172.21.15.104:0/3899465845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc0009560 con 0x7fafd8142230 2023-09-13T02:12:33.486 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.479+0000 7fafcffff640 1 --2- 172.21.15.104:0/3899465845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafd80b1280 0x7fafd8141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:33.487 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.480+0000 7fafd6d9d640 1 --2- 172.21.15.104:0/3899465845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafd8142230 0x7fafd81db750 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fafd000b9c0 tx=0x7fafd000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:33.487 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.480+0000 7fafceffd640 1 -- 172.21.15.104:0/3899465845 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd000cba0 con 0x7fafd8142230 2023-09-13T02:12:33.487 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.480+0000 7fafceffd640 1 -- 172.21.15.104:0/3899465845 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fafd000cdf0 con 0x7fafd8142230 2023-09-13T02:12:33.487 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.480+0000 7fafdcba4640 1 -- 172.21.15.104:0/3899465845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd813fc30 con 0x7fafd8142230 2023-09-13T02:12:33.487 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.480+0000 7fafceffd640 1 -- 172.21.15.104:0/3899465845 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd00146a0 con 0x7fafd8142230 2023-09-13T02:12:33.488 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.480+0000 7fafdcba4640 1 -- 172.21.15.104:0/3899465845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd80709b0 con 0x7fafd8142230 2023-09-13T02:12:33.488 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.481+0000 7fafdcba4640 1 -- 172.21.15.104:0/3899465845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd813df50 con 0x7fafd8142230 2023-09-13T02:12:33.488 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.481+0000 7fafceffd640 1 -- 172.21.15.104:0/3899465845 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fafd0007370 con 0x7fafd8142230 2023-09-13T02:12:33.488 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.481+0000 7fafceffd640 1 --2- 172.21.15.104:0/3899465845 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fafb806a4f0 0x7fafb806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:33.488 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.482+0000 7fafd659c640 1 --2- 172.21.15.104:0/3899465845 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fafb806a4f0 0x7fafb806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:33.489 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.482+0000 7fafceffd640 1 -- 172.21.15.104:0/3899465845 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafd0088c40 con 0x7fafd8142230 2023-09-13T02:12:33.489 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.482+0000 7fafd659c640 1 --2- 172.21.15.104:0/3899465845 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fafb806a4f0 0x7fafb806c9b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009890 tx=0x7fafc8008040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:33.489 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.486+0000 7fafceffd640 1 -- 172.21.15.104:0/3899465845 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fafd813df50 con 0x7fafd8142230 2023-09-13T02:12:33.652 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.652+0000 7fafdcba4640 1 -- 172.21.15.104:0/3899465845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fafd813df50 con 0x7fafd8142230 2023-09-13T02:12:33.653 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.652+0000 7fafceffd640 1 -- 172.21.15.104:0/3899465845 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fafd813df50 con 0x7fafd8142230 2023-09-13T02:12:33.653 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2023-09-13T02:12:33.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.654+0000 7fafdcba4640 1 -- 172.21.15.104:0/3899465845 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fafb806a4f0 msgr2=0x7fafb806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:33.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.654+0000 7fafdcba4640 1 --2- 172.21.15.104:0/3899465845 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fafb806a4f0 0x7fafb806c9b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009890 tx=0x7fafc8008040 comp rx=0 tx=0).stop 2023-09-13T02:12:33.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.654+0000 7fafdcba4640 1 -- 172.21.15.104:0/3899465845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafd8142230 msgr2=0x7fafd81db750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.654+0000 7fafdcba4640 1 --2- 172.21.15.104:0/3899465845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafd8142230 0x7fafd81db750 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fafd000b9c0 tx=0x7fafd000be80 comp rx=0 tx=0).stop 2023-09-13T02:12:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.654+0000 7fafdcba4640 1 -- 172.21.15.104:0/3899465845 shutdown_connections 2023-09-13T02:12:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.654+0000 7fafdcba4640 1 --2- 172.21.15.104:0/3899465845 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fafb806a4f0 0x7fafb806c9b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.654+0000 7fafdcba4640 1 --2- 172.21.15.104:0/3899465845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafd8142230 0x7fafd81db750 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.654+0000 7fafdcba4640 1 --2- 172.21.15.104:0/3899465845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafd80b1280 0x7fafd8141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.657 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.654+0000 7fafdcba4640 1 --2- 172.21.15.104:0/3899465845 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafd80aefb0 0x7fafd813e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.657 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.654+0000 7fafdcba4640 1 -- 172.21.15.104:0/3899465845 >> 172.21.15.104:0/3899465845 conn(0x7fafd80b56f0 msgr2=0x7fafd80aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:33.657 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.654+0000 7fafdcba4640 1 -- 172.21.15.104:0/3899465845 shutdown_connections 2023-09-13T02:12:33.657 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.654+0000 7fafdcba4640 1 -- 172.21.15.104:0/3899465845 wait complete. 2023-09-13T02:12:33.665 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T02:12:33.769 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.768+0000 7f1ddd4d7640 1 -- 172.21.15.104:0/4052763668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dd80b5ba0 msgr2=0x7f1dd814ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:33.770 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.768+0000 7f1ddd4d7640 1 --2- 172.21.15.104:0/4052763668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dd80b5ba0 0x7f1dd814ec50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0005fd0 tx=0x7f1dd002c1b0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.770 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.768+0000 7f1ddd4d7640 1 -- 172.21.15.104:0/4052763668 shutdown_connections 2023-09-13T02:12:33.770 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.768+0000 7f1ddd4d7640 1 --2- 172.21.15.104:0/4052763668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dd80b5ba0 0x7f1dd814ec50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.770 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.768+0000 7f1ddd4d7640 1 --2- 172.21.15.104:0/4052763668 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1dd80b1820 0x7f1dd81482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.768+0000 7f1ddd4d7640 1 -- 172.21.15.104:0/4052763668 >> 172.21.15.104:0/4052763668 conn(0x7f1dd80708b0 msgr2=0x7f1dd8070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:33.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.768+0000 7f1ddd4d7640 1 -- 172.21.15.104:0/4052763668 shutdown_connections 2023-09-13T02:12:33.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.768+0000 7f1ddd4d7640 1 -- 172.21.15.104:0/4052763668 wait complete. 2023-09-13T02:12:33.774 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.769+0000 7f1ddd4d7640 1 Processor -- start 2023-09-13T02:12:33.774 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.769+0000 7f1ddd4d7640 1 -- start start 2023-09-13T02:12:33.774 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1ddd4d7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dd80b5ba0 0x7f1dd8143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:33.774 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1ddd4d7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1dd8147b90 0x7f1dd8138360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:33.775 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1ddd4d7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dd81388a0 0x7f1dd8131bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:33.775 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1ddd4d7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd8137ed0 con 0x7f1dd80b5ba0 2023-09-13T02:12:33.775 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1ddd4d7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd8138d50 con 0x7f1dd81388a0 2023-09-13T02:12:33.775 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1ddd4d7640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd8144810 con 0x7f1dd8147b90 2023-09-13T02:12:33.775 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1dd6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dd80b5ba0 0x7f1dd8143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:33.776 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1dd6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dd80b5ba0 0x7f1dd8143ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47542/0 (socket says 172.21.15.104:47542) 2023-09-13T02:12:33.776 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1dd6ffd640 1 -- 172.21.15.104:0/3925183780 learned_addr learned my addr 172.21.15.104:0/3925183780 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:33.776 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1dd77fe640 1 --2- 172.21.15.104:0/3925183780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dd81388a0 0x7f1dd8131bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:33.776 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1dd67fc640 1 --2- 172.21.15.104:0/3925183780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1dd8147b90 0x7f1dd8138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:33.776 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1dd6ffd640 1 -- 172.21.15.104:0/3925183780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1dd8147b90 msgr2=0x7f1dd8138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1dd6ffd640 1 --2- 172.21.15.104:0/3925183780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1dd8147b90 0x7f1dd8138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1dd6ffd640 1 -- 172.21.15.104:0/3925183780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dd81388a0 msgr2=0x7f1dd8131bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1dd6ffd640 1 --2- 172.21.15.104:0/3925183780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dd81388a0 0x7f1dd8131bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1dd6ffd640 1 -- 172.21.15.104:0/3925183780 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd0009900 con 0x7f1dd80b5ba0 2023-09-13T02:12:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1dd77fe640 1 --2- 172.21.15.104:0/3925183780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dd81388a0 0x7f1dd8131bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:33.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1dd6ffd640 1 --2- 172.21.15.104:0/3925183780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dd80b5ba0 0x7f1dd8143ea0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800b410 tx=0x7f1dc800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:33.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1dbf7fe640 1 -- 172.21.15.104:0/3925183780 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8011830 con 0x7f1dd80b5ba0 2023-09-13T02:12:33.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1dbf7fe640 1 -- 172.21.15.104:0/3925183780 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1dc8011a80 con 0x7f1dd80b5ba0 2023-09-13T02:12:33.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.770+0000 7f1ddd4d7640 1 -- 172.21.15.104:0/3925183780 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd80b7dc0 con 0x7f1dd80b5ba0 2023-09-13T02:12:33.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.771+0000 7f1dbf7fe640 1 -- 172.21.15.104:0/3925183780 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8011e90 con 0x7f1dd80b5ba0 2023-09-13T02:12:33.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.771+0000 7f1ddd4d7640 1 -- 172.21.15.104:0/3925183780 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd80b7ae0 con 0x7f1dd80b5ba0 2023-09-13T02:12:33.779 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.772+0000 7f1ddd4d7640 1 -- 172.21.15.104:0/3925183780 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd804e100 con 0x7f1dd80b5ba0 2023-09-13T02:12:33.779 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.772+0000 7f1dbf7fe640 1 -- 172.21.15.104:0/3925183780 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f1dc801a410 con 0x7f1dd80b5ba0 2023-09-13T02:12:33.779 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.772+0000 7f1dbf7fe640 1 --2- 172.21.15.104:0/3925183780 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f1dc406a520 0x7f1dc406c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:33.779 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.772+0000 7f1dbf7fe640 1 -- 172.21.15.104:0/3925183780 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dc80888a0 con 0x7f1dd80b5ba0 2023-09-13T02:12:33.779 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.772+0000 7f1dd67fc640 1 --2- 172.21.15.104:0/3925183780 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f1dc406a520 0x7f1dc406c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:33.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.773+0000 7f1dd67fc640 1 --2- 172.21.15.104:0/3925183780 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f1dc406a520 0x7f1dc406c9e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8134740 tx=0x7f1dcc008040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:33.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.776+0000 7f1dbf7fe640 1 -- 172.21.15.104:0/3925183780 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f1dc8053eb0 con 0x7f1dd80b5ba0 2023-09-13T02:12:33.943 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.942+0000 7f1ddd4d7640 1 -- 172.21.15.104:0/3925183780 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1dd80b0f50 con 0x7f1dd80b5ba0 2023-09-13T02:12:33.944 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.942+0000 7f1dbf7fe640 1 -- 172.21.15.104:0/3925183780 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1dc80574d0 con 0x7f1dd80b5ba0 2023-09-13T02:12:33.944 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2023-09-13T02:12:33.945 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.944+0000 7f1ddd4d7640 1 -- 172.21.15.104:0/3925183780 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f1dc406a520 msgr2=0x7f1dc406c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:33.946 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.944+0000 7f1ddd4d7640 1 --2- 172.21.15.104:0/3925183780 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f1dc406a520 0x7f1dc406c9e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8134740 tx=0x7f1dcc008040 comp rx=0 tx=0).stop 2023-09-13T02:12:33.946 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.944+0000 7f1ddd4d7640 1 -- 172.21.15.104:0/3925183780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dd80b5ba0 msgr2=0x7f1dd8143ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:33.946 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.944+0000 7f1ddd4d7640 1 --2- 172.21.15.104:0/3925183780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dd80b5ba0 0x7f1dd8143ea0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800b410 tx=0x7f1dc800b8d0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.946 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.944+0000 7f1ddd4d7640 1 -- 172.21.15.104:0/3925183780 shutdown_connections 2023-09-13T02:12:33.946 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.944+0000 7f1ddd4d7640 1 --2- 172.21.15.104:0/3925183780 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f1dc406a520 0x7f1dc406c9e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.947 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.944+0000 7f1ddd4d7640 1 --2- 172.21.15.104:0/3925183780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dd81388a0 0x7f1dd8131bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.947 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.944+0000 7f1ddd4d7640 1 --2- 172.21.15.104:0/3925183780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1dd8147b90 0x7f1dd8138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.947 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.944+0000 7f1ddd4d7640 1 --2- 172.21.15.104:0/3925183780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dd80b5ba0 0x7f1dd8143ea0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:33.947 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.944+0000 7f1ddd4d7640 1 -- 172.21.15.104:0/3925183780 >> 172.21.15.104:0/3925183780 conn(0x7f1dd80708b0 msgr2=0x7f1dd80af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:33.947 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.944+0000 7f1ddd4d7640 1 -- 172.21.15.104:0/3925183780 shutdown_connections 2023-09-13T02:12:33.948 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:33.944+0000 7f1ddd4d7640 1 -- 172.21.15.104:0/3925183780 wait complete. 2023-09-13T02:12:33.956 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T02:12:34.060 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.059+0000 7f8c44da9640 1 -- 172.21.15.104:0/328593686 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c400b1820 msgr2=0x7f8c400afdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.061 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.059+0000 7f8c44da9640 1 --2- 172.21.15.104:0/328593686 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c400b1820 0x7f8c400afdc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009860 tx=0x7f8c2802bcb0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.061 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.059+0000 7f8c44da9640 1 -- 172.21.15.104:0/328593686 shutdown_connections 2023-09-13T02:12:34.061 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.059+0000 7f8c44da9640 1 --2- 172.21.15.104:0/328593686 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c400b1820 0x7f8c400afdc0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.061 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.059+0000 7f8c44da9640 1 --2- 172.21.15.104:0/328593686 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c40147b90 0x7f8c401482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.061 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.059+0000 7f8c44da9640 1 -- 172.21.15.104:0/328593686 >> 172.21.15.104:0/328593686 conn(0x7f8c400708b0 msgr2=0x7f8c40070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:34.062 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.059+0000 7f8c44da9640 1 -- 172.21.15.104:0/328593686 shutdown_connections 2023-09-13T02:12:34.062 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.059+0000 7f8c44da9640 1 -- 172.21.15.104:0/328593686 wait complete. 2023-09-13T02:12:34.065 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.060+0000 7f8c44da9640 1 Processor -- start 2023-09-13T02:12:34.065 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.060+0000 7f8c44da9640 1 -- start start 2023-09-13T02:12:34.065 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c44da9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c400b5ba0 0x7f8c40143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:34.066 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c44da9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c40147b90 0x7f8c401da0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:34.066 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c44da9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c401da5f0 0x7f8c40134c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:34.066 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c44da9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c401daaa0 con 0x7f8c40147b90 2023-09-13T02:12:34.066 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c44da9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c401cf260 con 0x7f8c400b5ba0 2023-09-13T02:12:34.067 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c44da9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c401cf540 con 0x7f8c401da5f0 2023-09-13T02:12:34.067 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c37fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c40147b90 0x7f8c401da0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:34.067 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c37fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c40147b90 0x7f8c401da0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47562/0 (socket says 172.21.15.104:47562) 2023-09-13T02:12:34.068 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c37fff640 1 -- 172.21.15.104:0/2133802926 learned_addr learned my addr 172.21.15.104:0/2133802926 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:34.068 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c37fff640 1 -- 172.21.15.104:0/2133802926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c401da5f0 msgr2=0x7f8c40134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.068 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c37fff640 1 --2- 172.21.15.104:0/2133802926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c401da5f0 0x7f8c40134c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.069 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c37fff640 1 -- 172.21.15.104:0/2133802926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c400b5ba0 msgr2=0x7f8c40143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.069 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c37fff640 1 --2- 172.21.15.104:0/2133802926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c400b5ba0 0x7f8c40143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.069 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c37fff640 1 -- 172.21.15.104:0/2133802926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c28009490 con 0x7f8c40147b90 2023-09-13T02:12:34.069 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c37fff640 1 --2- 172.21.15.104:0/2133802926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c40147b90 0x7f8c401da0b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8c28000c00 tx=0x7f8c280038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:34.070 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c36ffd640 1 -- 172.21.15.104:0/2133802926 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28003ea0 con 0x7f8c40147b90 2023-09-13T02:12:34.070 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c44da9640 1 -- 172.21.15.104:0/2133802926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c401cf820 con 0x7f8c40147b90 2023-09-13T02:12:34.070 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c36ffd640 1 -- 172.21.15.104:0/2133802926 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8c28034440 con 0x7f8c40147b90 2023-09-13T02:12:34.070 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c36ffd640 1 -- 172.21.15.104:0/2133802926 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28034850 con 0x7f8c40147b90 2023-09-13T02:12:34.071 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.061+0000 7f8c44da9640 1 -- 172.21.15.104:0/2133802926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c40135950 con 0x7f8c40147b90 2023-09-13T02:12:34.071 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.062+0000 7f8c44da9640 1 -- 172.21.15.104:0/2133802926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c4004e100 con 0x7f8c40147b90 2023-09-13T02:12:34.071 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.063+0000 7f8c36ffd640 1 -- 172.21.15.104:0/2133802926 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f8c280349b0 con 0x7f8c40147b90 2023-09-13T02:12:34.071 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.063+0000 7f8c36ffd640 1 --2- 172.21.15.104:0/2133802926 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8c2006a520 0x7f8c2006c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:34.071 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.063+0000 7f8c36ffd640 1 -- 172.21.15.104:0/2133802926 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c280ab310 con 0x7f8c40147b90 2023-09-13T02:12:34.071 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.063+0000 7f8c3e59c640 1 --2- 172.21.15.104:0/2133802926 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8c2006a520 0x7f8c2006c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:34.072 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.063+0000 7f8c3e59c640 1 --2- 172.21.15.104:0/2133802926 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8c2006a520 0x7f8c2006c9e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000b980 tx=0x7f8c30005db0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:34.072 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.067+0000 7f8c36ffd640 1 -- 172.21.15.104:0/2133802926 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8c280768a0 con 0x7f8c40147b90 2023-09-13T02:12:34.234 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.233+0000 7f8c44da9640 1 -- 172.21.15.104:0/2133802926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c401cf9e0 con 0x7f8c40147b90 2023-09-13T02:12:34.234 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.233+0000 7f8c36ffd640 1 -- 172.21.15.104:0/2133802926 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c28079ec0 con 0x7f8c40147b90 2023-09-13T02:12:34.235 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2023-09-13T02:12:34.236 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.235+0000 7f8c44da9640 1 -- 172.21.15.104:0/2133802926 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8c2006a520 msgr2=0x7f8c2006c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.236 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.235+0000 7f8c44da9640 1 --2- 172.21.15.104:0/2133802926 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8c2006a520 0x7f8c2006c9e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000b980 tx=0x7f8c30005db0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.237 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.235+0000 7f8c44da9640 1 -- 172.21.15.104:0/2133802926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c40147b90 msgr2=0x7f8c401da0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.237 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.235+0000 7f8c44da9640 1 --2- 172.21.15.104:0/2133802926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c40147b90 0x7f8c401da0b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8c28000c00 tx=0x7f8c280038a0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.237 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.235+0000 7f8c44da9640 1 -- 172.21.15.104:0/2133802926 shutdown_connections 2023-09-13T02:12:34.237 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.235+0000 7f8c44da9640 1 --2- 172.21.15.104:0/2133802926 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8c2006a520 0x7f8c2006c9e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.237 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.235+0000 7f8c44da9640 1 --2- 172.21.15.104:0/2133802926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c401da5f0 0x7f8c40134c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.238 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.235+0000 7f8c44da9640 1 --2- 172.21.15.104:0/2133802926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c40147b90 0x7f8c401da0b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.238 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.235+0000 7f8c44da9640 1 --2- 172.21.15.104:0/2133802926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c400b5ba0 0x7f8c40143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.238 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.235+0000 7f8c44da9640 1 -- 172.21.15.104:0/2133802926 >> 172.21.15.104:0/2133802926 conn(0x7f8c400708b0 msgr2=0x7f8c4013def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:34.238 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.235+0000 7f8c44da9640 1 -- 172.21.15.104:0/2133802926 shutdown_connections 2023-09-13T02:12:34.238 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.235+0000 7f8c44da9640 1 -- 172.21.15.104:0/2133802926 wait complete. 2023-09-13T02:12:34.247 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T02:12:34.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.347+0000 7f5c1fb7c640 1 -- 172.21.15.104:0/4171635004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c04003970 msgr2=0x7f5c04003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.347+0000 7f5c1fb7c640 1 --2- 172.21.15.104:0/4171635004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c04003970 0x7f5c04003d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000c260 tx=0x7f5c040057f0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.347+0000 7f5c1e119640 1 -- 172.21.15.104:0/4171635004 reap_dead start 2023-09-13T02:12:34.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.347+0000 7f5c1fb7c640 1 -- 172.21.15.104:0/4171635004 shutdown_connections 2023-09-13T02:12:34.350 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.347+0000 7f5c1fb7c640 1 -- 172.21.15.104:0/4171635004 >> 172.21.15.104:0/4171635004 conn(0x7f5c180b6860 msgr2=0x7f5c180b6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:34.350 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.347+0000 7f5c1fb7c640 1 -- 172.21.15.104:0/4171635004 shutdown_connections 2023-09-13T02:12:34.350 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.347+0000 7f5c1fb7c640 1 -- 172.21.15.104:0/4171635004 wait complete. 2023-09-13T02:12:34.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.348+0000 7f5c1fb7c640 1 Processor -- start 2023-09-13T02:12:34.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.348+0000 7f5c1fb7c640 1 -- start start 2023-09-13T02:12:34.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.349+0000 7f5c1fb7c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c04003970 0x7f5c181db4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:34.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.349+0000 7f5c1fb7c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c1813e410 0x7f5c18070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:34.354 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.349+0000 7f5c1fb7c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c1813d890 0x7f5c18134a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:34.354 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.349+0000 7f5c1fb7c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c18143bc0 con 0x7f5c1813e410 2023-09-13T02:12:34.354 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.349+0000 7f5c1fb7c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1813dd10 con 0x7f5c1813d890 2023-09-13T02:12:34.354 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.349+0000 7f5c1fb7c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c18142d60 con 0x7f5c04003970 2023-09-13T02:12:34.355 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.349+0000 7f5c1d117640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c1813e410 0x7f5c18070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:34.355 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.349+0000 7f5c1d117640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c1813e410 0x7f5c18070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47576/0 (socket says 172.21.15.104:47576) 2023-09-13T02:12:34.355 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.349+0000 7f5c1d117640 1 -- 172.21.15.104:0/451475928 learned_addr learned my addr 172.21.15.104:0/451475928 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:34.355 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.349+0000 7f5c1d918640 1 --2- 172.21.15.104:0/451475928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c04003970 0x7f5c181db4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:34.355 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.349+0000 7f5c1e119640 1 --2- 172.21.15.104:0/451475928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c1813d890 0x7f5c18134a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.349+0000 7f5c1d117640 1 -- 172.21.15.104:0/451475928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c04003970 msgr2=0x7f5c181db4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.349+0000 7f5c1d117640 1 --2- 172.21.15.104:0/451475928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c04003970 0x7f5c181db4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.349+0000 7f5c1d117640 1 -- 172.21.15.104:0/451475928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c1813d890 msgr2=0x7f5c18134a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.349+0000 7f5c1d117640 1 --2- 172.21.15.104:0/451475928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c1813d890 0x7f5c18134a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.349+0000 7f5c1d117640 1 -- 172.21.15.104:0/451475928 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c181424c0 con 0x7f5c1813e410 2023-09-13T02:12:34.357 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.350+0000 7f5c1d117640 1 --2- 172.21.15.104:0/451475928 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c1813e410 0x7f5c18070c30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5c08011ae0 tx=0x7f5c08009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:34.357 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.350+0000 7f5c0e7fc640 1 -- 172.21.15.104:0/451475928 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0800fc70 con 0x7f5c1813e410 2023-09-13T02:12:34.357 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.350+0000 7f5c0e7fc640 1 -- 172.21.15.104:0/451475928 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5c0800fdd0 con 0x7f5c1813e410 2023-09-13T02:12:34.357 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.350+0000 7f5c0e7fc640 1 -- 172.21.15.104:0/451475928 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08019670 con 0x7f5c1813e410 2023-09-13T02:12:34.357 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.350+0000 7f5c1fb7c640 1 -- 172.21.15.104:0/451475928 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c181427a0 con 0x7f5c1813e410 2023-09-13T02:12:34.358 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.350+0000 7f5c1fb7c640 1 -- 172.21.15.104:0/451475928 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c18143da0 con 0x7f5c1813e410 2023-09-13T02:12:34.358 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.351+0000 7f5c1fb7c640 1 -- 172.21.15.104:0/451475928 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1804e100 con 0x7f5c1813e410 2023-09-13T02:12:34.358 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.351+0000 7f5c0e7fc640 1 -- 172.21.15.104:0/451475928 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5c080197d0 con 0x7f5c1813e410 2023-09-13T02:12:34.359 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.352+0000 7f5c0e7fc640 1 --2- 172.21.15.104:0/451475928 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f5bfc06a4f0 0x7f5bfc06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:34.359 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.352+0000 7f5c0e7fc640 1 -- 172.21.15.104:0/451475928 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c08089440 con 0x7f5c1813e410 2023-09-13T02:12:34.360 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.352+0000 7f5c1d918640 1 --2- 172.21.15.104:0/451475928 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f5bfc06a4f0 0x7f5bfc06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:34.360 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.352+0000 7f5c1d918640 1 --2- 172.21.15.104:0/451475928 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f5bfc06a4f0 0x7f5bfc06c9b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5c10034000 tx=0x7f5c10000fe0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:34.361 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.356+0000 7f5c0e7fc640 1 -- 172.21.15.104:0/451475928 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5c08054b00 con 0x7f5c1813e410 2023-09-13T02:12:34.559 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.558+0000 7f5c1fb7c640 1 -- 172.21.15.104:0/451475928 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c1813d4b0 con 0x7f5c1813e410 2023-09-13T02:12:34.560 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.559+0000 7f5c0e7fc640 1 -- 172.21.15.104:0/451475928 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3330 (secure 0 0 0) 0x7f5c0801ed20 con 0x7f5c1813e410 2023-09-13T02:12:34.560 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:34.561 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/811188307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":811188307},{"type":"v1","addr":"172.21.15.119:6833","nonce":811188307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T02:12:23.916322+0000","modified":"2023-09-13T02:12:26.178874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1426622388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1426622388},{"type":"v1","addr":"172.21.15.104:6835","nonce":1426622388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T02:12:34.561 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 6 2023-09-13T02:12:34.562 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.561+0000 7f5c1fb7c640 1 -- 172.21.15.104:0/451475928 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f5bfc06a4f0 msgr2=0x7f5bfc06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.562 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.561+0000 7f5c1fb7c640 1 --2- 172.21.15.104:0/451475928 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f5bfc06a4f0 0x7f5bfc06c9b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5c10034000 tx=0x7f5c10000fe0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.561+0000 7f5c1fb7c640 1 -- 172.21.15.104:0/451475928 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c1813e410 msgr2=0x7f5c18070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.561+0000 7f5c1fb7c640 1 --2- 172.21.15.104:0/451475928 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c1813e410 0x7f5c18070c30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5c08011ae0 tx=0x7f5c08009eb0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.561+0000 7f5c1fb7c640 1 -- 172.21.15.104:0/451475928 shutdown_connections 2023-09-13T02:12:34.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.561+0000 7f5c1fb7c640 1 --2- 172.21.15.104:0/451475928 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f5bfc06a4f0 0x7f5bfc06c9b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.561+0000 7f5c1fb7c640 1 --2- 172.21.15.104:0/451475928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c1813d890 0x7f5c18134a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.561+0000 7f5c1fb7c640 1 --2- 172.21.15.104:0/451475928 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c1813e410 0x7f5c18070c30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.561+0000 7f5c1fb7c640 1 --2- 172.21.15.104:0/451475928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c04003970 0x7f5c181db4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.561+0000 7f5c1fb7c640 1 -- 172.21.15.104:0/451475928 >> 172.21.15.104:0/451475928 conn(0x7f5c180b6860 msgr2=0x7f5c181402d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:34.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.561+0000 7f5c1fb7c640 1 -- 172.21.15.104:0/451475928 shutdown_connections 2023-09-13T02:12:34.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.561+0000 7f5c1fb7c640 1 -- 172.21.15.104:0/451475928 wait complete. 2023-09-13T02:12:34.573 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T02:12:34.677 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.675+0000 7fddb7905640 1 -- 172.21.15.104:0/1701345498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd9c003f20 msgr2=0x7fdd9c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.677 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.675+0000 7fddb7905640 1 --2- 172.21.15.104:0/1701345498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd9c003f20 0x7fdd9c0047c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009b50 tx=0x7fdd9c0057f0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.677 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.675+0000 7fddb5ea2640 1 -- 172.21.15.104:0/1701345498 reap_dead start 2023-09-13T02:12:34.677 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.675+0000 7fddb7905640 1 -- 172.21.15.104:0/1701345498 shutdown_connections 2023-09-13T02:12:34.678 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.675+0000 7fddb7905640 1 -- 172.21.15.104:0/1701345498 >> 172.21.15.104:0/1701345498 conn(0x7fddb00708b0 msgr2=0x7fddb0070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:34.678 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.675+0000 7fddb7905640 1 -- 172.21.15.104:0/1701345498 shutdown_connections 2023-09-13T02:12:34.678 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.675+0000 7fddb7905640 1 -- 172.21.15.104:0/1701345498 wait complete. 2023-09-13T02:12:34.681 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.676+0000 7fddb7905640 1 Processor -- start 2023-09-13T02:12:34.681 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.676+0000 7fddb7905640 1 -- start start 2023-09-13T02:12:34.681 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb7905640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd9c003f20 0x7fddb013ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:34.681 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb7905640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddb013ef40 0x7fddb00a8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:34.681 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb7905640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb00a8d90 0x7fddb013acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:34.682 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb7905640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb013cf70 con 0x7fdd9c003f20 2023-09-13T02:12:34.682 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb7905640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00a9210 con 0x7fddb00a8d90 2023-09-13T02:12:34.682 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb7905640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb013e270 con 0x7fddb013ef40 2023-09-13T02:12:34.682 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb56a1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd9c003f20 0x7fddb013ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:34.682 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb56a1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd9c003f20 0x7fddb013ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47600/0 (socket says 172.21.15.104:47600) 2023-09-13T02:12:34.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb56a1640 1 -- 172.21.15.104:0/1390983841 learned_addr learned my addr 172.21.15.104:0/1390983841 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:34.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb4ea0640 1 --2- 172.21.15.104:0/1390983841 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddb013ef40 0x7fddb00a8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:34.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb5ea2640 1 --2- 172.21.15.104:0/1390983841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb00a8d90 0x7fddb013acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:34.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb56a1640 1 -- 172.21.15.104:0/1390983841 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddb013ef40 msgr2=0x7fddb00a8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.683 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb56a1640 1 --2- 172.21.15.104:0/1390983841 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddb013ef40 0x7fddb00a8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.684 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb56a1640 1 -- 172.21.15.104:0/1390983841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb00a8d90 msgr2=0x7fddb013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.684 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb56a1640 1 --2- 172.21.15.104:0/1390983841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb00a8d90 0x7fddb013acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.684 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb56a1640 1 -- 172.21.15.104:0/1390983841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb013c640 con 0x7fdd9c003f20 2023-09-13T02:12:34.684 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb4ea0640 1 --2- 172.21.15.104:0/1390983841 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddb013ef40 0x7fddb00a8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:34.684 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb5ea2640 1 --2- 172.21.15.104:0/1390983841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb00a8d90 0x7fddb013acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:34.685 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.677+0000 7fddb56a1640 1 --2- 172.21.15.104:0/1390983841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd9c003f20 0x7fddb013ea00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fddac006340 tx=0x7fddac006800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:34.685 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.678+0000 7fdda5ffb640 1 -- 172.21.15.104:0/1390983841 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac00fce0 con 0x7fdd9c003f20 2023-09-13T02:12:34.685 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.678+0000 7fdda5ffb640 1 -- 172.21.15.104:0/1390983841 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fddac006930 con 0x7fdd9c003f20 2023-09-13T02:12:34.685 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.678+0000 7fddb7905640 1 -- 172.21.15.104:0/1390983841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb013c920 con 0x7fdd9c003f20 2023-09-13T02:12:34.685 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.678+0000 7fdda5ffb640 1 -- 172.21.15.104:0/1390983841 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac011690 con 0x7fdd9c003f20 2023-09-13T02:12:34.686 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.678+0000 7fddb7905640 1 -- 172.21.15.104:0/1390983841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb013df90 con 0x7fdd9c003f20 2023-09-13T02:12:34.686 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.679+0000 7fddb7905640 1 -- 172.21.15.104:0/1390983841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb004e100 con 0x7fdd9c003f20 2023-09-13T02:12:34.686 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.679+0000 7fdda5ffb640 1 -- 172.21.15.104:0/1390983841 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fddac0117f0 con 0x7fdd9c003f20 2023-09-13T02:12:34.686 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.679+0000 7fdda5ffb640 1 --2- 172.21.15.104:0/1390983841 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdd9406a4f0 0x7fdd9406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:34.686 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.679+0000 7fddb4ea0640 1 --2- 172.21.15.104:0/1390983841 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdd9406a4f0 0x7fdd9406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:34.687 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.680+0000 7fdda5ffb640 1 -- 172.21.15.104:0/1390983841 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddac0899e0 con 0x7fdd9c003f20 2023-09-13T02:12:34.687 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.680+0000 7fddb4ea0640 1 --2- 172.21.15.104:0/1390983841 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdd9406a4f0 0x7fdd9406c9b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdda0036000 tx=0x7fdda00046c0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:34.687 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.684+0000 7fdda5ffb640 1 -- 172.21.15.104:0/1390983841 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fddac054ff0 con 0x7fdd9c003f20 2023-09-13T02:12:34.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.854+0000 7fddb7905640 1 -- 172.21.15.104:0/1390983841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fddb00b3e50 con 0x7fdd9c003f20 2023-09-13T02:12:34.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.855+0000 7fdda5ffb640 1 -- 172.21.15.104:0/1390983841 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fddac00fea0 con 0x7fdd9c003f20 2023-09-13T02:12:34.856 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:34.856 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"ac1f5a95-0d3a-406e-b4ca-c8ea43282cab","created":"2023-09-13T02:11:59.067178+0000","modified":"2023-09-13T02:12:25.572652+0000","last_up_change":"2023-09-13T02:12:11.207888+0000","last_in_change":"2023-09-13T02:12:02.278796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T02:12:12.071023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T02:12:22.114609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T02:12:22.880593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67190066-4851-4b1f-aae8-bad59e79ebb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6801","nonce":3271772377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6803","nonce":3271772377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6807","nonce":3271772377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6805","nonce":3271772377}]},"public_addr":"172.21.15.104:6801/3271772377","cluster_addr":"172.21.15.104:6803/3271772377","heartbeat_back_addr":"172.21.15.104:6807/3271772377","heartbeat_front_addr":"172.21.15.104:6805/3271772377","state":["exists","up"]},{"osd":1,"uuid":"f1907075-bb97-4a19-8dd6-322232caaf4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6809","nonce":3786698894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6811","nonce":3786698894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6815","nonce":3786698894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6813","nonce":3786698894}]},"public_addr":"172.21.15.104:6809/3786698894","cluster_addr":"172.21.15.104:6811/3786698894","heartbeat_back_addr":"172.21.15.104:6815/3786698894","heartbeat_front_addr":"172.21.15.104:6813/3786698894","state":["exists","up"]},{"osd":2,"uuid":"8c323c83-330c-4181-b622-10177c81f975","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6819","nonce":2319361072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6822","nonce":2319361072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6827","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6829","nonce":2319361072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6826","nonce":2319361072}]},"public_addr":"172.21.15.104:6819/2319361072","cluster_addr":"172.21.15.104:6822/2319361072","heartbeat_back_addr":"172.21.15.104:6829/2319361072","heartbeat_front_addr":"172.21.15.104:6826/2319361072","state":["exists","up"]},{"osd":3,"uuid":"811457f5-c408-488d-a4ed-b947d1c55e82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6818","nonce":621253853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6823","nonce":621253853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6831","nonce":621253853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6825","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6828","nonce":621253853}]},"public_addr":"172.21.15.104:6818/621253853","cluster_addr":"172.21.15.104:6823/621253853","heartbeat_back_addr":"172.21.15.104:6831/621253853","heartbeat_front_addr":"172.21.15.104:6828/621253853","state":["exists","up"]},{"osd":4,"uuid":"552010ea-7d61-47c7-b4ac-657845e55e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6801","nonce":3049794634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6803","nonce":3049794634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6807","nonce":3049794634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6805","nonce":3049794634}]},"public_addr":"172.21.15.119:6801/3049794634","cluster_addr":"172.21.15.119:6803/3049794634","heartbeat_back_addr":"172.21.15.119:6807/3049794634","heartbeat_front_addr":"172.21.15.119:6805/3049794634","state":["exists","up"]},{"osd":5,"uuid":"41f415b0-6886-44ed-bccc-57c46cc975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6809","nonce":2918159428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6811","nonce":2918159428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6815","nonce":2918159428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6813","nonce":2918159428}]},"public_addr":"172.21.15.119:6809/2918159428","cluster_addr":"172.21.15.119:6811/2918159428","heartbeat_back_addr":"172.21.15.119:6815/2918159428","heartbeat_front_addr":"172.21.15.119:6813/2918159428","state":["exists","up"]},{"osd":6,"uuid":"1f415570-dbcc-4cb9-930a-ad31a96c3ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6825","nonce":3509665357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6827","nonce":3509665357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6831","nonce":3509665357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6829","nonce":3509665357}]},"public_addr":"172.21.15.119:6825/3509665357","cluster_addr":"172.21.15.119:6827/3509665357","heartbeat_back_addr":"172.21.15.119:6831/3509665357","heartbeat_front_addr":"172.21.15.119:6829/3509665357","state":["exists","up"]},{"osd":7,"uuid":"ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6817","nonce":892749725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6819","nonce":892749725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6823","nonce":892749725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6821","nonce":892749725}]},"public_addr":"172.21.15.119:6817/892749725","cluster_addr":"172.21.15.119:6819/892749725","heartbeat_back_addr":"172.21.15.119:6823/892749725","heartbeat_front_addr":"172.21.15.119:6821/892749725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.489481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.468615+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.485958+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.424425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.456308+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.427607+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T02:12:34.858 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.857+0000 7fddb7905640 1 -- 172.21.15.104:0/1390983841 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdd9406a4f0 msgr2=0x7fdd9406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.858 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.857+0000 7fddb7905640 1 --2- 172.21.15.104:0/1390983841 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdd9406a4f0 0x7fdd9406c9b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdda0036000 tx=0x7fdda00046c0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.858 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.857+0000 7fddb7905640 1 -- 172.21.15.104:0/1390983841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd9c003f20 msgr2=0x7fddb013ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.859 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.857+0000 7fddb7905640 1 --2- 172.21.15.104:0/1390983841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd9c003f20 0x7fddb013ea00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fddac006340 tx=0x7fddac006800 comp rx=0 tx=0).stop 2023-09-13T02:12:34.859 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.857+0000 7fddb7905640 1 -- 172.21.15.104:0/1390983841 shutdown_connections 2023-09-13T02:12:34.859 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.857+0000 7fddb7905640 1 --2- 172.21.15.104:0/1390983841 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdd9406a4f0 0x7fdd9406c9b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.859 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.857+0000 7fddb7905640 1 --2- 172.21.15.104:0/1390983841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb00a8d90 0x7fddb013acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.860 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.857+0000 7fddb7905640 1 --2- 172.21.15.104:0/1390983841 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddb013ef40 0x7fddb00a8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.860 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.857+0000 7fddb7905640 1 --2- 172.21.15.104:0/1390983841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd9c003f20 0x7fddb013ea00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.860 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.857+0000 7fddb7905640 1 -- 172.21.15.104:0/1390983841 >> 172.21.15.104:0/1390983841 conn(0x7fddb00708b0 msgr2=0x7fddb0144170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:34.860 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.857+0000 7fddb7905640 1 -- 172.21.15.104:0/1390983841 shutdown_connections 2023-09-13T02:12:34.860 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.857+0000 7fddb7905640 1 -- 172.21.15.104:0/1390983841 wait complete. 2023-09-13T02:12:34.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T02:12:12.071023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T02:12:22.114609+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T02:12:22.880593+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T02:12:34.869 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T02:12:34.973 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.972+0000 7f4722e90640 1 -- 172.21.15.104:0/1431877449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f471c0b5ba0 msgr2=0x7f471c14ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.974 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.972+0000 7f4722e90640 1 --2- 172.21.15.104:0/1431877449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f471c0b5ba0 0x7f471c14ec50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4714005fd0 tx=0x7f471402c050 comp rx=0 tx=0).stop 2023-09-13T02:12:34.974 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.972+0000 7f4722e90640 1 -- 172.21.15.104:0/1431877449 shutdown_connections 2023-09-13T02:12:34.974 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.972+0000 7f4722e90640 1 --2- 172.21.15.104:0/1431877449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f471c0b5ba0 0x7f471c14ec50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.972+0000 7f4722e90640 1 --2- 172.21.15.104:0/1431877449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f471c147b90 0x7f471c1482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.972+0000 7f4722e90640 1 -- 172.21.15.104:0/1431877449 >> 172.21.15.104:0/1431877449 conn(0x7f471c0708b0 msgr2=0x7f471c070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:34.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.972+0000 7f4722e90640 1 -- 172.21.15.104:0/1431877449 shutdown_connections 2023-09-13T02:12:34.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.972+0000 7f4722e90640 1 -- 172.21.15.104:0/1431877449 wait complete. 2023-09-13T02:12:34.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.973+0000 7f4722e90640 1 Processor -- start 2023-09-13T02:12:34.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.973+0000 7f4722e90640 1 -- start start 2023-09-13T02:12:34.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.974+0000 7f4722e90640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f471c0b5ba0 0x7f471c12c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:34.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.974+0000 7f4722e90640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f471c147b90 0x7f471c139660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:34.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.974+0000 7f4722e90640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f471c139ba0 0x7f471c1da590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:34.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.974+0000 7f4722e90640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471c12d970 con 0x7f471c139ba0 2023-09-13T02:12:34.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.974+0000 7f4722e90640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471c1db520 con 0x7f471c0b5ba0 2023-09-13T02:12:34.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.974+0000 7f4722e90640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471c12d360 con 0x7f471c147b90 2023-09-13T02:12:34.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.974+0000 7f472142d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f471c139ba0 0x7f471c1da590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:34.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.974+0000 7f472142d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f471c139ba0 0x7f471c1da590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47604/0 (socket says 172.21.15.104:47604) 2023-09-13T02:12:34.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.974+0000 7f472142d640 1 -- 172.21.15.104:0/609342031 learned_addr learned my addr 172.21.15.104:0/609342031 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:34.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.974+0000 7f4720c2c640 1 --2- 172.21.15.104:0/609342031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f471c0b5ba0 0x7f471c12c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:34.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.974+0000 7f471bfff640 1 --2- 172.21.15.104:0/609342031 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f471c147b90 0x7f471c139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:34.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.974+0000 7f472142d640 1 -- 172.21.15.104:0/609342031 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f471c147b90 msgr2=0x7f471c139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.974+0000 7f472142d640 1 --2- 172.21.15.104:0/609342031 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f471c147b90 0x7f471c139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.974+0000 7f472142d640 1 -- 172.21.15.104:0/609342031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f471c0b5ba0 msgr2=0x7f471c12c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:34.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.974+0000 7f472142d640 1 --2- 172.21.15.104:0/609342031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f471c0b5ba0 0x7f471c12c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:34.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.974+0000 7f472142d640 1 -- 172.21.15.104:0/609342031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4714009840 con 0x7f471c139ba0 2023-09-13T02:12:34.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.974+0000 7f471bfff640 1 --2- 172.21.15.104:0/609342031 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f471c147b90 0x7f471c139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:34.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.975+0000 7f472142d640 1 --2- 172.21.15.104:0/609342031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f471c139ba0 0x7f471c1da590 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4714009b30 tx=0x7f4714004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:34.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.975+0000 7f47197fa640 1 -- 172.21.15.104:0/609342031 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4714004870 con 0x7f471c139ba0 2023-09-13T02:12:34.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.975+0000 7f47197fa640 1 -- 172.21.15.104:0/609342031 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f471403e460 con 0x7f471c139ba0 2023-09-13T02:12:34.983 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.975+0000 7f47197fa640 1 -- 172.21.15.104:0/609342031 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471403e850 con 0x7f471c139ba0 2023-09-13T02:12:34.985 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.975+0000 7f4722e90640 1 -- 172.21.15.104:0/609342031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f471c12d600 con 0x7f471c139ba0 2023-09-13T02:12:34.985 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.975+0000 7f4722e90640 1 -- 172.21.15.104:0/609342031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471c12de00 con 0x7f471c139ba0 2023-09-13T02:12:34.985 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.976+0000 7f4722e90640 1 -- 172.21.15.104:0/609342031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471c12d1c0 con 0x7f471c139ba0 2023-09-13T02:12:34.985 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.976+0000 7f47197fa640 1 -- 172.21.15.104:0/609342031 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f471403e9b0 con 0x7f471c139ba0 2023-09-13T02:12:34.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.977+0000 7f47197fa640 1 --2- 172.21.15.104:0/609342031 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f470806a4f0 0x7f470806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:34.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.977+0000 7f4720c2c640 1 --2- 172.21.15.104:0/609342031 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f470806a4f0 0x7f470806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:34.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.977+0000 7f47197fa640 1 -- 172.21.15.104:0/609342031 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47140ab9e0 con 0x7f471c139ba0 2023-09-13T02:12:34.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.977+0000 7f4720c2c640 1 --2- 172.21.15.104:0/609342031 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f470806a4f0 0x7f470806c9b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f470c009b30 tx=0x7f470c005f90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:34.987 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:34.981+0000 7f47197fa640 1 -- 172.21.15.104:0/609342031 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f471c12d1c0 con 0x7f471c139ba0 2023-09-13T02:12:35.149 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.147+0000 7f4722e90640 1 -- 172.21.15.104:0/609342031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f471c12d1c0 con 0x7f471c139ba0 2023-09-13T02:12:35.149 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.148+0000 7f47197fa640 1 -- 172.21.15.104:0/609342031 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f471c12d1c0 con 0x7f471c139ba0 2023-09-13T02:12:35.149 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2023-09-13T02:12:35.151 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.150+0000 7f4722e90640 1 -- 172.21.15.104:0/609342031 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f470806a4f0 msgr2=0x7f470806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:35.151 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.150+0000 7f4722e90640 1 --2- 172.21.15.104:0/609342031 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f470806a4f0 0x7f470806c9b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f470c009b30 tx=0x7f470c005f90 comp rx=0 tx=0).stop 2023-09-13T02:12:35.151 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.150+0000 7f4722e90640 1 -- 172.21.15.104:0/609342031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f471c139ba0 msgr2=0x7f471c1da590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:35.151 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.150+0000 7f4722e90640 1 --2- 172.21.15.104:0/609342031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f471c139ba0 0x7f471c1da590 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4714009b30 tx=0x7f4714004270 comp rx=0 tx=0).stop 2023-09-13T02:12:35.152 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.150+0000 7f4722e90640 1 -- 172.21.15.104:0/609342031 shutdown_connections 2023-09-13T02:12:35.152 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.150+0000 7f4722e90640 1 --2- 172.21.15.104:0/609342031 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f470806a4f0 0x7f470806c9b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.152 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.150+0000 7f4722e90640 1 --2- 172.21.15.104:0/609342031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f471c139ba0 0x7f471c1da590 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.152 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.150+0000 7f4722e90640 1 --2- 172.21.15.104:0/609342031 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f471c147b90 0x7f471c139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.152 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.150+0000 7f4722e90640 1 --2- 172.21.15.104:0/609342031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f471c0b5ba0 0x7f471c12c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.153 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.150+0000 7f4722e90640 1 -- 172.21.15.104:0/609342031 >> 172.21.15.104:0/609342031 conn(0x7f471c0708b0 msgr2=0x7f471c0ad870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:35.153 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.150+0000 7f4722e90640 1 -- 172.21.15.104:0/609342031 shutdown_connections 2023-09-13T02:12:35.153 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.150+0000 7f4722e90640 1 -- 172.21.15.104:0/609342031 wait complete. 2023-09-13T02:12:35.161 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T02:12:35.266 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.264+0000 7ff7c722f640 1 -- 172.21.15.104:0/1991138965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7c00aefb0 msgr2=0x7ff7c013bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:35.266 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.264+0000 7ff7c722f640 1 --2- 172.21.15.104:0/1991138965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7c00aefb0 0x7ff7c013bf20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0005fd0 tx=0x7ff7b002bd90 comp rx=0 tx=0).stop 2023-09-13T02:12:35.266 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.264+0000 7ff7c722f640 1 -- 172.21.15.104:0/1991138965 shutdown_connections 2023-09-13T02:12:35.267 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.264+0000 7ff7c722f640 1 --2- 172.21.15.104:0/1991138965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7c00aefb0 0x7ff7c013bf20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.267 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.265+0000 7ff7c722f640 1 -- 172.21.15.104:0/1991138965 >> 172.21.15.104:0/1991138965 conn(0x7ff7c00b56f0 msgr2=0x7ff7c00b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:35.267 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.265+0000 7ff7c722f640 1 -- 172.21.15.104:0/1991138965 shutdown_connections 2023-09-13T02:12:35.267 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.265+0000 7ff7c722f640 1 -- 172.21.15.104:0/1991138965 wait complete. 2023-09-13T02:12:35.269 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.265+0000 7ff7c722f640 1 Processor -- start 2023-09-13T02:12:35.270 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.266+0000 7ff7c722f640 1 -- start start 2023-09-13T02:12:35.270 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.266+0000 7ff7c722f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7c00aefb0 0x7ff7c0070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:35.270 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.266+0000 7ff7c722f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7c00b1280 0x7ff7c01da150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:35.270 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.266+0000 7ff7c722f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff7c0142940 0x7ff7c01da690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:35.271 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.266+0000 7ff7c722f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c00a6a10 con 0x7ff7c00b1280 2023-09-13T02:12:35.271 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.266+0000 7ff7c722f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c01d96b0 con 0x7ff7c00aefb0 2023-09-13T02:12:35.271 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.266+0000 7ff7c722f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c00a6f60 con 0x7ff7c0142940 2023-09-13T02:12:35.271 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.266+0000 7ff7bffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7c00b1280 0x7ff7c01da150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:35.271 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.266+0000 7ff7bffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7c00b1280 0x7ff7c01da150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47626/0 (socket says 172.21.15.104:47626) 2023-09-13T02:12:35.272 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.266+0000 7ff7bffff640 1 -- 172.21.15.104:0/4020629371 learned_addr learned my addr 172.21.15.104:0/4020629371 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:35.272 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.267+0000 7ff7c4fcb640 1 --2- 172.21.15.104:0/4020629371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7c00aefb0 0x7ff7c0070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:35.272 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.267+0000 7ff7c57cc640 1 --2- 172.21.15.104:0/4020629371 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff7c0142940 0x7ff7c01da690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:35.272 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.267+0000 7ff7bffff640 1 -- 172.21.15.104:0/4020629371 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff7c0142940 msgr2=0x7ff7c01da690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:35.272 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.267+0000 7ff7bffff640 1 --2- 172.21.15.104:0/4020629371 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff7c0142940 0x7ff7c01da690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.273 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.267+0000 7ff7bffff640 1 -- 172.21.15.104:0/4020629371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7c00aefb0 msgr2=0x7ff7c0070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:35.273 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.267+0000 7ff7bffff640 1 --2- 172.21.15.104:0/4020629371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7c00aefb0 0x7ff7c0070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.273 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.267+0000 7ff7bffff640 1 -- 172.21.15.104:0/4020629371 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b0009560 con 0x7ff7c00b1280 2023-09-13T02:12:35.273 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.267+0000 7ff7bffff640 1 --2- 172.21.15.104:0/4020629371 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7c00b1280 0x7ff7c01da150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400c4b0 tx=0x7ff7b400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:35.274 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.267+0000 7ff7bd7fa640 1 -- 172.21.15.104:0/4020629371 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4005480 con 0x7ff7c00b1280 2023-09-13T02:12:35.274 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.267+0000 7ff7bd7fa640 1 -- 172.21.15.104:0/4020629371 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff7b40036e0 con 0x7ff7c00b1280 2023-09-13T02:12:35.274 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.267+0000 7ff7c722f640 1 -- 172.21.15.104:0/4020629371 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c01d9950 con 0x7ff7c00b1280 2023-09-13T02:12:35.274 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.267+0000 7ff7bd7fa640 1 -- 172.21.15.104:0/4020629371 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4003b30 con 0x7ff7c00b1280 2023-09-13T02:12:35.274 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.267+0000 7ff7c722f640 1 -- 172.21.15.104:0/4020629371 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c00a6c80 con 0x7ff7c00b1280 2023-09-13T02:12:35.275 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.268+0000 7ff7c722f640 1 -- 172.21.15.104:0/4020629371 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c01d9e70 con 0x7ff7c00b1280 2023-09-13T02:12:35.275 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.268+0000 7ff7bd7fa640 1 -- 172.21.15.104:0/4020629371 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff7b4003c90 con 0x7ff7c00b1280 2023-09-13T02:12:35.275 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.269+0000 7ff7bd7fa640 1 --2- 172.21.15.104:0/4020629371 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff7ac06a4f0 0x7ff7ac06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:35.275 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.269+0000 7ff7c4fcb640 1 --2- 172.21.15.104:0/4020629371 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff7ac06a4f0 0x7ff7ac06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:35.275 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.269+0000 7ff7bd7fa640 1 -- 172.21.15.104:0/4020629371 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7b4088240 con 0x7ff7c00b1280 2023-09-13T02:12:35.276 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.269+0000 7ff7c4fcb640 1 --2- 172.21.15.104:0/4020629371 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff7ac06a4f0 0x7ff7ac06c9b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0035000 tx=0x7ff7b0004730 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:35.276 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.273+0000 7ff7bd7fa640 1 -- 172.21.15.104:0/4020629371 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff7c01d9e70 con 0x7ff7c00b1280 2023-09-13T02:12:35.440 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.439+0000 7ff7c722f640 1 -- 172.21.15.104:0/4020629371 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7c01d9e70 con 0x7ff7c00b1280 2023-09-13T02:12:35.441 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.440+0000 7ff7bd7fa640 1 -- 172.21.15.104:0/4020629371 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff7c01d9e70 con 0x7ff7c00b1280 2023-09-13T02:12:35.441 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2023-09-13T02:12:35.443 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.442+0000 7ff7c722f640 1 -- 172.21.15.104:0/4020629371 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff7ac06a4f0 msgr2=0x7ff7ac06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:35.443 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.442+0000 7ff7c722f640 1 --2- 172.21.15.104:0/4020629371 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff7ac06a4f0 0x7ff7ac06c9b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0035000 tx=0x7ff7b0004730 comp rx=0 tx=0).stop 2023-09-13T02:12:35.443 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.442+0000 7ff7c722f640 1 -- 172.21.15.104:0/4020629371 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7c00b1280 msgr2=0x7ff7c01da150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:35.443 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.442+0000 7ff7c722f640 1 --2- 172.21.15.104:0/4020629371 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7c00b1280 0x7ff7c01da150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400c4b0 tx=0x7ff7b400c970 comp rx=0 tx=0).stop 2023-09-13T02:12:35.444 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.442+0000 7ff7c722f640 1 -- 172.21.15.104:0/4020629371 shutdown_connections 2023-09-13T02:12:35.444 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.442+0000 7ff7c722f640 1 --2- 172.21.15.104:0/4020629371 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff7ac06a4f0 0x7ff7ac06c9b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.444 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.442+0000 7ff7c722f640 1 --2- 172.21.15.104:0/4020629371 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff7c0142940 0x7ff7c01da690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.444 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.442+0000 7ff7c722f640 1 --2- 172.21.15.104:0/4020629371 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7c00b1280 0x7ff7c01da150 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.444 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.442+0000 7ff7c722f640 1 --2- 172.21.15.104:0/4020629371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7c00aefb0 0x7ff7c0070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.445 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.442+0000 7ff7c722f640 1 -- 172.21.15.104:0/4020629371 >> 172.21.15.104:0/4020629371 conn(0x7ff7c00b56f0 msgr2=0x7ff7c014d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:35.445 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.442+0000 7ff7c722f640 1 -- 172.21.15.104:0/4020629371 shutdown_connections 2023-09-13T02:12:35.445 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.442+0000 7ff7c722f640 1 -- 172.21.15.104:0/4020629371 wait complete. 2023-09-13T02:12:35.453 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T02:12:35.558 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.556+0000 7fb46b41f640 1 -- 172.21.15.104:0/3396400250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb450003fd0 msgr2=0x7fb4500047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:35.558 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.556+0000 7fb46b41f640 1 --2- 172.21.15.104:0/3396400250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb450003fd0 0x7fb4500047c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb454001650 tx=0x7fb4500057f0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.558 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.556+0000 7fb4699bc640 1 -- 172.21.15.104:0/3396400250 reap_dead start 2023-09-13T02:12:35.558 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.556+0000 7fb46b41f640 1 -- 172.21.15.104:0/3396400250 shutdown_connections 2023-09-13T02:12:35.559 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.556+0000 7fb46b41f640 1 -- 172.21.15.104:0/3396400250 >> 172.21.15.104:0/3396400250 conn(0x7fb4640708b0 msgr2=0x7fb464070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:35.559 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.556+0000 7fb46b41f640 1 -- 172.21.15.104:0/3396400250 shutdown_connections 2023-09-13T02:12:35.559 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.556+0000 7fb46b41f640 1 -- 172.21.15.104:0/3396400250 wait complete. 2023-09-13T02:12:35.561 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.557+0000 7fb46b41f640 1 Processor -- start 2023-09-13T02:12:35.561 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.557+0000 7fb46b41f640 1 -- start start 2023-09-13T02:12:35.561 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.558+0000 7fb46b41f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb450003fd0 0x7fb46413bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:35.562 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.558+0000 7fb46b41f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb464144ea0 0x7fb4641ddb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:35.562 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.558+0000 7fb46b41f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4641de0a0 0x7fb464134c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:35.562 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.558+0000 7fb46b41f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4641cf480 con 0x7fb450003fd0 2023-09-13T02:12:35.562 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.558+0000 7fb46b41f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4641dd6b0 con 0x7fb4641de0a0 2023-09-13T02:12:35.562 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.558+0000 7fb46b41f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4641de520 con 0x7fb464144ea0 2023-09-13T02:12:35.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.558+0000 7fb4691bb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb450003fd0 0x7fb46413bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:35.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.558+0000 7fb4691bb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb450003fd0 0x7fb46413bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47648/0 (socket says 172.21.15.104:47648) 2023-09-13T02:12:35.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.558+0000 7fb4691bb640 1 -- 172.21.15.104:0/3540101418 learned_addr learned my addr 172.21.15.104:0/3540101418 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:35.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.558+0000 7fb4689ba640 1 --2- 172.21.15.104:0/3540101418 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb464144ea0 0x7fb4641ddb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:35.563 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.558+0000 7fb4691bb640 1 -- 172.21.15.104:0/3540101418 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb464144ea0 msgr2=0x7fb4641ddb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:35.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.558+0000 7fb4699bc640 1 --2- 172.21.15.104:0/3540101418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4641de0a0 0x7fb464134c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:35.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.558+0000 7fb4691bb640 1 --2- 172.21.15.104:0/3540101418 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb464144ea0 0x7fb4641ddb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.558+0000 7fb4691bb640 1 -- 172.21.15.104:0/3540101418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4641de0a0 msgr2=0x7fb464134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:35.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.558+0000 7fb4691bb640 1 --2- 172.21.15.104:0/3540101418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4641de0a0 0x7fb464134c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.564 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.558+0000 7fb4691bb640 1 -- 172.21.15.104:0/3540101418 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4640add70 con 0x7fb450003fd0 2023-09-13T02:12:35.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.558+0000 7fb4699bc640 1 --2- 172.21.15.104:0/3540101418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4641de0a0 0x7fb464134c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:12:35.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.559+0000 7fb4691bb640 1 --2- 172.21.15.104:0/3540101418 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb450003fd0 0x7fb46413bbe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb460006660 tx=0x7fb460003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:35.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.559+0000 7fb459ffb640 1 -- 172.21.15.104:0/3540101418 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46000f720 con 0x7fb450003fd0 2023-09-13T02:12:35.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.559+0000 7fb459ffb640 1 -- 172.21.15.104:0/3540101418 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb46000f880 con 0x7fb450003fd0 2023-09-13T02:12:35.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.559+0000 7fb46b41f640 1 -- 172.21.15.104:0/3540101418 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4640ae050 con 0x7fb450003fd0 2023-09-13T02:12:35.565 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.559+0000 7fb459ffb640 1 -- 172.21.15.104:0/3540101418 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46000fc90 con 0x7fb450003fd0 2023-09-13T02:12:35.566 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.559+0000 7fb46b41f640 1 -- 172.21.15.104:0/3540101418 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4641ce770 con 0x7fb450003fd0 2023-09-13T02:12:35.566 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.560+0000 7fb46b41f640 1 -- 172.21.15.104:0/3540101418 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4641dd880 con 0x7fb450003fd0 2023-09-13T02:12:35.566 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.560+0000 7fb459ffb640 1 -- 172.21.15.104:0/3540101418 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb460011430 con 0x7fb450003fd0 2023-09-13T02:12:35.567 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.561+0000 7fb459ffb640 1 --2- 172.21.15.104:0/3540101418 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb44806a520 0x7fb44806c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:35.567 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.561+0000 7fb4689ba640 1 --2- 172.21.15.104:0/3540101418 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb44806a520 0x7fb44806c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:35.567 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.561+0000 7fb459ffb640 1 -- 172.21.15.104:0/3540101418 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4600897e0 con 0x7fb450003fd0 2023-09-13T02:12:35.568 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.561+0000 7fb4689ba640 1 --2- 172.21.15.104:0/3540101418 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb44806a520 0x7fb44806c9e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb454034000 tx=0x7fb454039040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:35.568 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.565+0000 7fb459ffb640 1 -- 172.21.15.104:0/3540101418 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb4641dd880 con 0x7fb450003fd0 2023-09-13T02:12:35.733 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.731+0000 7fb46b41f640 1 -- 172.21.15.104:0/3540101418 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb4640b0fa0 con 0x7fb450003fd0 2023-09-13T02:12:35.733 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.732+0000 7fb459ffb640 1 -- 172.21.15.104:0/3540101418 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb4600150a0 con 0x7fb450003fd0 2023-09-13T02:12:35.733 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2023-09-13T02:12:35.735 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.734+0000 7fb46b41f640 1 -- 172.21.15.104:0/3540101418 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb44806a520 msgr2=0x7fb44806c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:35.735 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.734+0000 7fb46b41f640 1 --2- 172.21.15.104:0/3540101418 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb44806a520 0x7fb44806c9e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb454034000 tx=0x7fb454039040 comp rx=0 tx=0).stop 2023-09-13T02:12:35.736 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.734+0000 7fb46b41f640 1 -- 172.21.15.104:0/3540101418 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb450003fd0 msgr2=0x7fb46413bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:35.736 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.734+0000 7fb46b41f640 1 --2- 172.21.15.104:0/3540101418 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb450003fd0 0x7fb46413bbe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb460006660 tx=0x7fb460003a80 comp rx=0 tx=0).stop 2023-09-13T02:12:35.736 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.734+0000 7fb46b41f640 1 -- 172.21.15.104:0/3540101418 shutdown_connections 2023-09-13T02:12:35.736 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.734+0000 7fb46b41f640 1 --2- 172.21.15.104:0/3540101418 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb44806a520 0x7fb44806c9e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.736 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.734+0000 7fb46b41f640 1 --2- 172.21.15.104:0/3540101418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4641de0a0 0x7fb464134c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.737 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.734+0000 7fb46b41f640 1 --2- 172.21.15.104:0/3540101418 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb464144ea0 0x7fb4641ddb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.737 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.734+0000 7fb46b41f640 1 --2- 172.21.15.104:0/3540101418 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb450003fd0 0x7fb46413bbe0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.737 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.734+0000 7fb46b41f640 1 -- 172.21.15.104:0/3540101418 >> 172.21.15.104:0/3540101418 conn(0x7fb4640708b0 msgr2=0x7fb4640b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:35.737 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.734+0000 7fb46b41f640 1 -- 172.21.15.104:0/3540101418 shutdown_connections 2023-09-13T02:12:35.737 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.734+0000 7fb46b41f640 1 -- 172.21.15.104:0/3540101418 wait complete. 2023-09-13T02:12:35.745 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T02:12:35.847 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.846+0000 7f95b9316640 1 -- 172.21.15.104:0/2793134039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b40b5ba0 msgr2=0x7f95b40b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:35.848 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.846+0000 7f95b9316640 1 --2- 172.21.15.104:0/2793134039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b40b5ba0 0x7f95b40b0300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f95b406b4e0 tx=0x7f95ac02c1b0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.848 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.846+0000 7f95b9316640 1 -- 172.21.15.104:0/2793134039 shutdown_connections 2023-09-13T02:12:35.848 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.846+0000 7f95b9316640 1 --2- 172.21.15.104:0/2793134039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b40b5ba0 0x7f95b40b0300 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.848 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.846+0000 7f95b9316640 1 --2- 172.21.15.104:0/2793134039 >> v2:172.21.15.119:3300/0 conn(0x7f95b40b1820 0x7f95b40afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.848 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.846+0000 7f95b9316640 1 --2- 172.21.15.104:0/2793134039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95b4147b90 0x7f95b41482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.849 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.846+0000 7f95b9316640 1 -- 172.21.15.104:0/2793134039 >> 172.21.15.104:0/2793134039 conn(0x7f95b40708b0 msgr2=0x7f95b4070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:35.849 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.846+0000 7f95b9316640 1 -- 172.21.15.104:0/2793134039 shutdown_connections 2023-09-13T02:12:35.849 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.846+0000 7f95b9316640 1 -- 172.21.15.104:0/2793134039 wait complete. 2023-09-13T02:12:35.852 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.847+0000 7f95b9316640 1 Processor -- start 2023-09-13T02:12:35.852 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.847+0000 7f95b9316640 1 -- start start 2023-09-13T02:12:35.852 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.847+0000 7f95b9316640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b40b5ba0 0x7f95b40aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:35.852 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.847+0000 7f95b9316640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95b4147b90 0x7f95b41d9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:35.852 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.847+0000 7f95b9316640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95b41da4f0 0x7f95b413bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:35.853 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.847+0000 7f95b9316640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40b9750 con 0x7f95b40b5ba0 2023-09-13T02:12:35.853 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.847+0000 7f95b9316640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40b9140 con 0x7f95b4147b90 2023-09-13T02:12:35.853 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.847+0000 7f95b9316640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40b9be0 con 0x7f95b41da4f0 2023-09-13T02:12:35.853 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.847+0000 7f95b2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b40b5ba0 0x7f95b40aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:35.853 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.847+0000 7f95b2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b40b5ba0 0x7f95b40aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47666/0 (socket says 172.21.15.104:47666) 2023-09-13T02:12:35.853 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.848+0000 7f95b2ffd640 1 -- 172.21.15.104:0/822232295 learned_addr learned my addr 172.21.15.104:0/822232295 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:35.854 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.848+0000 7f95b37fe640 1 --2- 172.21.15.104:0/822232295 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95b41da4f0 0x7f95b413bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:35.854 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.848+0000 7f95abfff640 1 --2- 172.21.15.104:0/822232295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95b4147b90 0x7f95b41d9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:35.854 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.848+0000 7f95b2ffd640 1 -- 172.21.15.104:0/822232295 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95b41da4f0 msgr2=0x7f95b413bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:35.854 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.848+0000 7f95b2ffd640 1 --2- 172.21.15.104:0/822232295 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95b41da4f0 0x7f95b413bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.854 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.848+0000 7f95b2ffd640 1 -- 172.21.15.104:0/822232295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95b4147b90 msgr2=0x7f95b41d9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:35.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.848+0000 7f95b2ffd640 1 --2- 172.21.15.104:0/822232295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95b4147b90 0x7f95b41d9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:35.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.848+0000 7f95b2ffd640 1 -- 172.21.15.104:0/822232295 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac009900 con 0x7f95b40b5ba0 2023-09-13T02:12:35.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.848+0000 7f95abfff640 1 --2- 172.21.15.104:0/822232295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95b4147b90 0x7f95b41d9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:12:35.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.848+0000 7f95b2ffd640 1 --2- 172.21.15.104:0/822232295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b40b5ba0 0x7f95b40aebb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f95a400d6d0 tx=0x7f95a400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:35.855 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.848+0000 7f95ab7fe640 1 -- 172.21.15.104:0/822232295 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4005220 con 0x7f95b40b5ba0 2023-09-13T02:12:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.848+0000 7f95ab7fe640 1 -- 172.21.15.104:0/822232295 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f95a4005490 con 0x7f95b40b5ba0 2023-09-13T02:12:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.848+0000 7f95b9316640 1 -- 172.21.15.104:0/822232295 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b413fe70 con 0x7f95b40b5ba0 2023-09-13T02:12:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.848+0000 7f95ab7fe640 1 -- 172.21.15.104:0/822232295 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4009a80 con 0x7f95b40b5ba0 2023-09-13T02:12:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.848+0000 7f95b9316640 1 -- 172.21.15.104:0/822232295 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b413fad0 con 0x7f95b40b5ba0 2023-09-13T02:12:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.849+0000 7f95b9316640 1 -- 172.21.15.104:0/822232295 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b40b4090 con 0x7f95b40b5ba0 2023-09-13T02:12:35.857 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.850+0000 7f95ab7fe640 1 -- 172.21.15.104:0/822232295 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f95a40047a0 con 0x7f95b40b5ba0 2023-09-13T02:12:35.857 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.850+0000 7f95ab7fe640 1 --2- 172.21.15.104:0/822232295 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f959406a4f0 0x7f959406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:35.857 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.850+0000 7f95abfff640 1 --2- 172.21.15.104:0/822232295 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f959406a4f0 0x7f959406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:35.857 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.850+0000 7f95abfff640 1 --2- 172.21.15.104:0/822232295 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f959406a4f0 0x7f959406c9b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f959c0058c0 tx=0x7f959c005850 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:35.857 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.851+0000 7f95ab7fe640 1 -- 172.21.15.104:0/822232295 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95a4058070 con 0x7f95b40b5ba0 2023-09-13T02:12:35.858 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:35.855+0000 7f95ab7fe640 1 -- 172.21.15.104:0/822232295 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f95a40543b0 con 0x7f95b40b5ba0 2023-09-13T02:12:36.058 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.056+0000 7f95b9316640 1 -- 172.21.15.104:0/822232295 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95b404e100 con 0x7f95b40b5ba0 2023-09-13T02:12:36.058 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.057+0000 7f95ab7fe640 1 -- 172.21.15.104:0/822232295 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3330 (secure 0 0 0) 0x7f95a4017d20 con 0x7f95b40b5ba0 2023-09-13T02:12:36.059 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:36.059 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/811188307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":811188307},{"type":"v1","addr":"172.21.15.119:6833","nonce":811188307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T02:12:23.916322+0000","modified":"2023-09-13T02:12:26.178874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1426622388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1426622388},{"type":"v1","addr":"172.21.15.104:6835","nonce":1426622388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T02:12:36.060 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 6 2023-09-13T02:12:36.060 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.059+0000 7f95b9316640 1 -- 172.21.15.104:0/822232295 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f959406a4f0 msgr2=0x7f959406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:36.060 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.059+0000 7f95b9316640 1 --2- 172.21.15.104:0/822232295 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f959406a4f0 0x7f959406c9b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f959c0058c0 tx=0x7f959c005850 comp rx=0 tx=0).stop 2023-09-13T02:12:36.061 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.059+0000 7f95b9316640 1 -- 172.21.15.104:0/822232295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b40b5ba0 msgr2=0x7f95b40aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:36.061 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.059+0000 7f95b9316640 1 --2- 172.21.15.104:0/822232295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b40b5ba0 0x7f95b40aebb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f95a400d6d0 tx=0x7f95a400db90 comp rx=0 tx=0).stop 2023-09-13T02:12:36.061 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.059+0000 7f95b9316640 1 -- 172.21.15.104:0/822232295 shutdown_connections 2023-09-13T02:12:36.061 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.059+0000 7f95b9316640 1 --2- 172.21.15.104:0/822232295 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f959406a4f0 0x7f959406c9b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.061 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.059+0000 7f95b9316640 1 --2- 172.21.15.104:0/822232295 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95b41da4f0 0x7f95b413bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.061 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.059+0000 7f95b9316640 1 --2- 172.21.15.104:0/822232295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95b4147b90 0x7f95b41d9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.062 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.059+0000 7f95b9316640 1 --2- 172.21.15.104:0/822232295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b40b5ba0 0x7f95b40aebb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.062 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.059+0000 7f95b9316640 1 -- 172.21.15.104:0/822232295 >> 172.21.15.104:0/822232295 conn(0x7f95b40708b0 msgr2=0x7f95b413e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:36.062 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.059+0000 7f95b9316640 1 -- 172.21.15.104:0/822232295 shutdown_connections 2023-09-13T02:12:36.062 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.059+0000 7f95b9316640 1 -- 172.21.15.104:0/822232295 wait complete. 2023-09-13T02:12:36.070 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T02:12:36.173 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.171+0000 7f868153c640 1 -- 172.21.15.104:0/2904230615 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f867c0ae580 msgr2=0x7f867c14b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:36.173 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.171+0000 7f868153c640 1 --2- 172.21.15.104:0/2904230615 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f867c0ae580 0x7f867c14b8a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8674005fd0 tx=0x7f867402bcf0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.173 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.172+0000 7f868153c640 1 -- 172.21.15.104:0/2904230615 shutdown_connections 2023-09-13T02:12:36.174 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.172+0000 7f868153c640 1 --2- 172.21.15.104:0/2904230615 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f867c0ae580 0x7f867c14b8a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.174 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.172+0000 7f868153c640 1 --2- 172.21.15.104:0/2904230615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f867c0af880 0x7f867c0ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.174 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.172+0000 7f868153c640 1 -- 172.21.15.104:0/2904230615 >> 172.21.15.104:0/2904230615 conn(0x7f867c0b67f0 msgr2=0x7f867c0b6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:36.174 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.172+0000 7f868153c640 1 -- 172.21.15.104:0/2904230615 shutdown_connections 2023-09-13T02:12:36.174 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.172+0000 7f868153c640 1 -- 172.21.15.104:0/2904230615 wait complete. 2023-09-13T02:12:36.177 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.173+0000 7f868153c640 1 Processor -- start 2023-09-13T02:12:36.177 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.173+0000 7f868153c640 1 -- start start 2023-09-13T02:12:36.177 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.173+0000 7f868153c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f867c0ae580 0x7f867c138e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:36.177 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.173+0000 7f868153c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f867c0af880 0x7f867c1daf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:36.178 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.173+0000 7f868153c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f867c144780 0x7f867c133c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:36.178 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.173+0000 7f868153c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c139350 con 0x7f867c144780 2023-09-13T02:12:36.178 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.173+0000 7f868153c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c1daa70 con 0x7f867c0af880 2023-09-13T02:12:36.178 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.173+0000 7f868153c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c133970 con 0x7f867c0ae580 2023-09-13T02:12:36.179 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.173+0000 7f867b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f867c144780 0x7f867c133c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:36.179 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.173+0000 7f867b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f867c144780 0x7f867c133c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47678/0 (socket says 172.21.15.104:47678) 2023-09-13T02:12:36.179 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.173+0000 7f867b7fe640 1 -- 172.21.15.104:0/2810924104 learned_addr learned my addr 172.21.15.104:0/2810924104 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:36.179 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.174+0000 7f867affd640 1 --2- 172.21.15.104:0/2810924104 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f867c0ae580 0x7f867c138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:36.179 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.174+0000 7f867a7fc640 1 --2- 172.21.15.104:0/2810924104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f867c0af880 0x7f867c1daf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:36.180 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.174+0000 7f867b7fe640 1 -- 172.21.15.104:0/2810924104 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f867c0ae580 msgr2=0x7f867c138e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:36.180 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.174+0000 7f867b7fe640 1 --2- 172.21.15.104:0/2810924104 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f867c0ae580 0x7f867c138e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.180 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.174+0000 7f867b7fe640 1 -- 172.21.15.104:0/2810924104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f867c0af880 msgr2=0x7f867c1daf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:36.180 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.174+0000 7f867b7fe640 1 --2- 172.21.15.104:0/2810924104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f867c0af880 0x7f867c1daf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.180 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.174+0000 7f867b7fe640 1 -- 172.21.15.104:0/2810924104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8674009560 con 0x7f867c144780 2023-09-13T02:12:36.181 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.174+0000 7f867b7fe640 1 --2- 172.21.15.104:0/2810924104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f867c144780 0x7f867c133c30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8674009230 tx=0x7f867402dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:36.181 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.174+0000 7f86637fe640 1 -- 172.21.15.104:0/2810924104 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674005690 con 0x7f867c144780 2023-09-13T02:12:36.181 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.174+0000 7f86637fe640 1 -- 172.21.15.104:0/2810924104 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f86740038f0 con 0x7f867c144780 2023-09-13T02:12:36.181 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.174+0000 7f86637fe640 1 -- 172.21.15.104:0/2810924104 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674003ca0 con 0x7f867c144780 2023-09-13T02:12:36.181 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.174+0000 7f868153c640 1 -- 172.21.15.104:0/2810924104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c1da700 con 0x7f867c144780 2023-09-13T02:12:36.181 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.174+0000 7f868153c640 1 -- 172.21.15.104:0/2810924104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c13ee00 con 0x7f867c144780 2023-09-13T02:12:36.182 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.175+0000 7f868153c640 1 -- 172.21.15.104:0/2810924104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c1dac00 con 0x7f867c144780 2023-09-13T02:12:36.182 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.175+0000 7f86637fe640 1 -- 172.21.15.104:0/2810924104 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f867403e450 con 0x7f867c144780 2023-09-13T02:12:36.182 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.176+0000 7f86637fe640 1 --2- 172.21.15.104:0/2810924104 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f866806a4f0 0x7f866806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:36.182 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.176+0000 7f867affd640 1 --2- 172.21.15.104:0/2810924104 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f866806a4f0 0x7f866806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:36.182 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.176+0000 7f86637fe640 1 -- 172.21.15.104:0/2810924104 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86740ab100 con 0x7f867c144780 2023-09-13T02:12:36.183 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.176+0000 7f867affd640 1 --2- 172.21.15.104:0/2810924104 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f866806a4f0 0x7f866806c9b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f866c009fd0 tx=0x7f866c00d040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:36.183 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.180+0000 7f86637fe640 1 -- 172.21.15.104:0/2810924104 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f86740767c0 con 0x7f867c144780 2023-09-13T02:12:36.347 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.346+0000 7f868153c640 1 -- 172.21.15.104:0/2810924104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f867c13b670 con 0x7f867c144780 2023-09-13T02:12:36.348 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.347+0000 7f86637fe640 1 -- 172.21.15.104:0/2810924104 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f8674079de0 con 0x7f867c144780 2023-09-13T02:12:36.349 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:36.349 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"ac1f5a95-0d3a-406e-b4ca-c8ea43282cab","created":"2023-09-13T02:11:59.067178+0000","modified":"2023-09-13T02:12:25.572652+0000","last_up_change":"2023-09-13T02:12:11.207888+0000","last_in_change":"2023-09-13T02:12:02.278796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T02:12:12.071023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T02:12:22.114609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T02:12:22.880593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67190066-4851-4b1f-aae8-bad59e79ebb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6801","nonce":3271772377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6803","nonce":3271772377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6807","nonce":3271772377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6805","nonce":3271772377}]},"public_addr":"172.21.15.104:6801/3271772377","cluster_addr":"172.21.15.104:6803/3271772377","heartbeat_back_addr":"172.21.15.104:6807/3271772377","heartbeat_front_addr":"172.21.15.104:6805/3271772377","state":["exists","up"]},{"osd":1,"uuid":"f1907075-bb97-4a19-8dd6-322232caaf4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6809","nonce":3786698894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6811","nonce":3786698894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6815","nonce":3786698894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6813","nonce":3786698894}]},"public_addr":"172.21.15.104:6809/3786698894","cluster_addr":"172.21.15.104:6811/3786698894","heartbeat_back_addr":"172.21.15.104:6815/3786698894","heartbeat_front_addr":"172.21.15.104:6813/3786698894","state":["exists","up"]},{"osd":2,"uuid":"8c323c83-330c-4181-b622-10177c81f975","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6819","nonce":2319361072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6822","nonce":2319361072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6827","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6829","nonce":2319361072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6826","nonce":2319361072}]},"public_addr":"172.21.15.104:6819/2319361072","cluster_addr":"172.21.15.104:6822/2319361072","heartbeat_back_addr":"172.21.15.104:6829/2319361072","heartbeat_front_addr":"172.21.15.104:6826/2319361072","state":["exists","up"]},{"osd":3,"uuid":"811457f5-c408-488d-a4ed-b947d1c55e82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6818","nonce":621253853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6823","nonce":621253853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6831","nonce":621253853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6825","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6828","nonce":621253853}]},"public_addr":"172.21.15.104:6818/621253853","cluster_addr":"172.21.15.104:6823/621253853","heartbeat_back_addr":"172.21.15.104:6831/621253853","heartbeat_front_addr":"172.21.15.104:6828/621253853","state":["exists","up"]},{"osd":4,"uuid":"552010ea-7d61-47c7-b4ac-657845e55e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6801","nonce":3049794634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6803","nonce":3049794634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6807","nonce":3049794634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6805","nonce":3049794634}]},"public_addr":"172.21.15.119:6801/3049794634","cluster_addr":"172.21.15.119:6803/3049794634","heartbeat_back_addr":"172.21.15.119:6807/3049794634","heartbeat_front_addr":"172.21.15.119:6805/3049794634","state":["exists","up"]},{"osd":5,"uuid":"41f415b0-6886-44ed-bccc-57c46cc975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6809","nonce":2918159428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6811","nonce":2918159428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6815","nonce":2918159428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6813","nonce":2918159428}]},"public_addr":"172.21.15.119:6809/2918159428","cluster_addr":"172.21.15.119:6811/2918159428","heartbeat_back_addr":"172.21.15.119:6815/2918159428","heartbeat_front_addr":"172.21.15.119:6813/2918159428","state":["exists","up"]},{"osd":6,"uuid":"1f415570-dbcc-4cb9-930a-ad31a96c3ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6825","nonce":3509665357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6827","nonce":3509665357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6831","nonce":3509665357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6829","nonce":3509665357}]},"public_addr":"172.21.15.119:6825/3509665357","cluster_addr":"172.21.15.119:6827/3509665357","heartbeat_back_addr":"172.21.15.119:6831/3509665357","heartbeat_front_addr":"172.21.15.119:6829/3509665357","state":["exists","up"]},{"osd":7,"uuid":"ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6817","nonce":892749725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6819","nonce":892749725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6823","nonce":892749725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6821","nonce":892749725}]},"public_addr":"172.21.15.119:6817/892749725","cluster_addr":"172.21.15.119:6819/892749725","heartbeat_back_addr":"172.21.15.119:6823/892749725","heartbeat_front_addr":"172.21.15.119:6821/892749725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.489481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.468615+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.485958+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.424425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.456308+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.427607+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T02:12:36.350 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.349+0000 7f868153c640 1 -- 172.21.15.104:0/2810924104 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f866806a4f0 msgr2=0x7f866806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:36.351 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.349+0000 7f868153c640 1 --2- 172.21.15.104:0/2810924104 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f866806a4f0 0x7f866806c9b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f866c009fd0 tx=0x7f866c00d040 comp rx=0 tx=0).stop 2023-09-13T02:12:36.351 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.349+0000 7f868153c640 1 -- 172.21.15.104:0/2810924104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f867c144780 msgr2=0x7f867c133c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:36.351 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.349+0000 7f868153c640 1 --2- 172.21.15.104:0/2810924104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f867c144780 0x7f867c133c30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8674009230 tx=0x7f867402dc40 comp rx=0 tx=0).stop 2023-09-13T02:12:36.351 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.349+0000 7f868153c640 1 -- 172.21.15.104:0/2810924104 shutdown_connections 2023-09-13T02:12:36.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.349+0000 7f868153c640 1 --2- 172.21.15.104:0/2810924104 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f866806a4f0 0x7f866806c9b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.349+0000 7f868153c640 1 --2- 172.21.15.104:0/2810924104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f867c144780 0x7f867c133c30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.349+0000 7f868153c640 1 --2- 172.21.15.104:0/2810924104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f867c0af880 0x7f867c1daf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.349+0000 7f868153c640 1 --2- 172.21.15.104:0/2810924104 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f867c0ae580 0x7f867c138e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.349+0000 7f868153c640 1 -- 172.21.15.104:0/2810924104 >> 172.21.15.104:0/2810924104 conn(0x7f867c0b67f0 msgr2=0x7f867c0b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:36.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.349+0000 7f868153c640 1 -- 172.21.15.104:0/2810924104 shutdown_connections 2023-09-13T02:12:36.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.349+0000 7f868153c640 1 -- 172.21.15.104:0/2810924104 wait complete. 2023-09-13T02:12:36.361 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T02:12:36.463 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.462+0000 7f91a02f7640 1 -- 172.21.15.104:0/3596238226 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91840047c0 msgr2=0x7f9184004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:36.464 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.462+0000 7f91a02f7640 1 --2- 172.21.15.104:0/3596238226 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91840047c0 0x7f9184004c40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9188001eb0 tx=0x7f91840057f0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.464 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.462+0000 7f91a02f7640 1 -- 172.21.15.104:0/3596238226 shutdown_connections 2023-09-13T02:12:36.464 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.462+0000 7f91a02f7640 1 --2- 172.21.15.104:0/3596238226 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91840047c0 0x7f9184004c40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.464 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.462+0000 7f91a02f7640 1 -- 172.21.15.104:0/3596238226 >> 172.21.15.104:0/3596238226 conn(0x7f91980b56f0 msgr2=0x7f91980b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:36.465 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.462+0000 7f91a02f7640 1 -- 172.21.15.104:0/3596238226 shutdown_connections 2023-09-13T02:12:36.465 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.462+0000 7f91a02f7640 1 -- 172.21.15.104:0/3596238226 wait complete. 2023-09-13T02:12:36.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.463+0000 7f91a02f7640 1 Processor -- start 2023-09-13T02:12:36.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.463+0000 7f91a02f7640 1 -- start start 2023-09-13T02:12:36.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f91a02f7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91840047c0 0x7f91980715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:36.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f91a02f7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91980b48c0 0x7f91981cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:36.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f91a02f7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9198136980 0x7f9198136e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:36.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f91a02f7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91981ce370 con 0x7f9198136980 2023-09-13T02:12:36.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f91a02f7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91980b4d40 con 0x7f91840047c0 2023-09-13T02:12:36.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f91a02f7640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9198137340 con 0x7f91980b48c0 2023-09-13T02:12:36.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f919e894640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9198136980 0x7f9198136e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:36.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f919e894640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9198136980 0x7f9198136e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39774/0 (socket says 172.21.15.104:39774) 2023-09-13T02:12:36.470 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f919e894640 1 -- 172.21.15.104:0/3759281177 learned_addr learned my addr 172.21.15.104:0/3759281177 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:36.470 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f919e093640 1 --2- 172.21.15.104:0/3759281177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91840047c0 0x7f91980715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:36.470 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f919d892640 1 --2- 172.21.15.104:0/3759281177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91980b48c0 0x7f91981cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:36.470 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f919e894640 1 -- 172.21.15.104:0/3759281177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91980b48c0 msgr2=0x7f91981cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:36.470 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f919e894640 1 --2- 172.21.15.104:0/3759281177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91980b48c0 0x7f91981cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.471 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f919e894640 1 -- 172.21.15.104:0/3759281177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91840047c0 msgr2=0x7f91980715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:36.471 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f919e894640 1 --2- 172.21.15.104:0/3759281177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91840047c0 0x7f91980715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.471 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f919e894640 1 -- 172.21.15.104:0/3759281177 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91981cd920 con 0x7f9198136980 2023-09-13T02:12:36.471 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f919d892640 1 --2- 172.21.15.104:0/3759281177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91980b48c0 0x7f91981cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:12:36.471 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f919e894640 1 --2- 172.21.15.104:0/3759281177 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9198136980 0x7f9198136e00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91980aca00 tx=0x7f9190001c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:36.471 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f918effd640 1 -- 172.21.15.104:0/3759281177 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190011900 con 0x7f9198136980 2023-09-13T02:12:36.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f918effd640 1 -- 172.21.15.104:0/3759281177 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9190011a80 con 0x7f9198136980 2023-09-13T02:12:36.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f91a02f7640 1 -- 172.21.15.104:0/3759281177 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91981cd640 con 0x7f9198136980 2023-09-13T02:12:36.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f918effd640 1 -- 172.21.15.104:0/3759281177 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190011e90 con 0x7f9198136980 2023-09-13T02:12:36.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.464+0000 7f91a02f7640 1 -- 172.21.15.104:0/3759281177 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91981cddb0 con 0x7f9198136980 2023-09-13T02:12:36.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.465+0000 7f91a02f7640 1 -- 172.21.15.104:0/3759281177 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f919804e100 con 0x7f9198136980 2023-09-13T02:12:36.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.466+0000 7f918effd640 1 -- 172.21.15.104:0/3759281177 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f91900103c0 con 0x7f9198136980 2023-09-13T02:12:36.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.466+0000 7f918effd640 1 --2- 172.21.15.104:0/3759281177 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f917c06a4f0 0x7f917c06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:36.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.466+0000 7f918effd640 1 -- 172.21.15.104:0/3759281177 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9190089a10 con 0x7f9198136980 2023-09-13T02:12:36.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.466+0000 7f919e093640 1 --2- 172.21.15.104:0/3759281177 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f917c06a4f0 0x7f917c06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:36.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.466+0000 7f919e093640 1 --2- 172.21.15.104:0/3759281177 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f917c06a4f0 0x7f917c06c9b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f91981dbe20 tx=0x7f9194005f90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:36.474 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.470+0000 7f918effd640 1 -- 172.21.15.104:0/3759281177 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9190055020 con 0x7f9198136980 2023-09-13T02:12:36.673 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.671+0000 7f91a02f7640 1 -- 172.21.15.104:0/3759281177 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9198141890 con 0x7f9198136980 2023-09-13T02:12:36.673 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.672+0000 7f918effd640 1 -- 172.21.15.104:0/3759281177 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3330 (secure 0 0 0) 0x7f9190015070 con 0x7f9198136980 2023-09-13T02:12:36.674 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:12:36.674 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/811188307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":811188307},{"type":"v1","addr":"172.21.15.119:6833","nonce":811188307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T02:12:23.916322+0000","modified":"2023-09-13T02:12:26.178874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1426622388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1426622388},{"type":"v1","addr":"172.21.15.104:6835","nonce":1426622388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T02:12:36.674 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 6 2023-09-13T02:12:36.675 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.674+0000 7f91a02f7640 1 -- 172.21.15.104:0/3759281177 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f917c06a4f0 msgr2=0x7f917c06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:36.675 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.674+0000 7f91a02f7640 1 --2- 172.21.15.104:0/3759281177 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f917c06a4f0 0x7f917c06c9b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f91981dbe20 tx=0x7f9194005f90 comp rx=0 tx=0).stop 2023-09-13T02:12:36.676 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.674+0000 7f91a02f7640 1 -- 172.21.15.104:0/3759281177 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9198136980 msgr2=0x7f9198136e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:36.676 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.674+0000 7f91a02f7640 1 --2- 172.21.15.104:0/3759281177 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9198136980 0x7f9198136e00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91980aca00 tx=0x7f9190001c30 comp rx=0 tx=0).stop 2023-09-13T02:12:36.676 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.674+0000 7f91a02f7640 1 -- 172.21.15.104:0/3759281177 shutdown_connections 2023-09-13T02:12:36.676 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.674+0000 7f91a02f7640 1 --2- 172.21.15.104:0/3759281177 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f917c06a4f0 0x7f917c06c9b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.676 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.674+0000 7f91a02f7640 1 --2- 172.21.15.104:0/3759281177 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9198136980 0x7f9198136e00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.677 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.674+0000 7f91a02f7640 1 --2- 172.21.15.104:0/3759281177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91980b48c0 0x7f91981cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.677 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.674+0000 7f91a02f7640 1 --2- 172.21.15.104:0/3759281177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91840047c0 0x7f91980715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.677 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.674+0000 7f91a02f7640 1 -- 172.21.15.104:0/3759281177 >> 172.21.15.104:0/3759281177 conn(0x7f91980b56f0 msgr2=0x7f9198140f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:36.677 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.674+0000 7f91a02f7640 1 -- 172.21.15.104:0/3759281177 shutdown_connections 2023-09-13T02:12:36.677 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.674+0000 7f91a02f7640 1 -- 172.21.15.104:0/3759281177 wait complete. 2023-09-13T02:12:36.886 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-13T02:12:23.916322+0000', 'modified': '2023-09-13T02:12:26.178874+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4365': {'gid': 4365, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6835/1426622388', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6834', 'nonce': 1426622388}, {'type': 'v1', 'addr': '172.21.15.104:6835', 'nonce': 1426622388}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-13T02:12:36.887 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-13T02:12:36.887 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-13T02:12:36.991 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.990+0000 7efe156bb640 1 -- 172.21.15.104:0/252005873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe10147b90 msgr2=0x7efe101482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:36.991 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.990+0000 7efe156bb640 1 --2- 172.21.15.104:0/252005873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe10147b90 0x7efe101482f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efe00009ca0 tx=0x7efe0002c1b0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.992 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.990+0000 7efe156bb640 1 -- 172.21.15.104:0/252005873 shutdown_connections 2023-09-13T02:12:36.992 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.990+0000 7efe156bb640 1 --2- 172.21.15.104:0/252005873 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe100b5ba0 0x7efe1014ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.992 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.990+0000 7efe156bb640 1 --2- 172.21.15.104:0/252005873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe10147b90 0x7efe101482f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.992 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.990+0000 7efe156bb640 1 -- 172.21.15.104:0/252005873 >> 172.21.15.104:0/252005873 conn(0x7efe100708b0 msgr2=0x7efe10070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:36.992 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.990+0000 7efe156bb640 1 -- 172.21.15.104:0/252005873 shutdown_connections 2023-09-13T02:12:36.993 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.990+0000 7efe156bb640 1 -- 172.21.15.104:0/252005873 wait complete. 2023-09-13T02:12:36.995 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.991+0000 7efe156bb640 1 Processor -- start 2023-09-13T02:12:36.996 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.991+0000 7efe156bb640 1 -- start start 2023-09-13T02:12:36.996 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe156bb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe100b5ba0 0x7efe10131e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:36.996 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe156bb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe10147b90 0x7efe1012be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:36.996 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe156bb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe101ddb00 0x7efe101ddfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:36.996 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe156bb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe10132340 con 0x7efe101ddb00 2023-09-13T02:12:36.997 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe156bb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe10138290 con 0x7efe100b5ba0 2023-09-13T02:12:36.997 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe156bb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe101de4f0 con 0x7efe10147b90 2023-09-13T02:12:36.997 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe0f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe101ddb00 0x7efe101ddfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:36.997 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe0f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe101ddb00 0x7efe101ddfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39786/0 (socket says 172.21.15.104:39786) 2023-09-13T02:12:36.997 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe0f7fe640 1 -- 172.21.15.104:0/134771194 learned_addr learned my addr 172.21.15.104:0/134771194 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:36.998 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe0e7fc640 1 --2- 172.21.15.104:0/134771194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe10147b90 0x7efe1012be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:36.998 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe0effd640 1 --2- 172.21.15.104:0/134771194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe100b5ba0 0x7efe10131e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:36.998 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe0f7fe640 1 -- 172.21.15.104:0/134771194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe10147b90 msgr2=0x7efe1012be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:36.998 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe0f7fe640 1 --2- 172.21.15.104:0/134771194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe10147b90 0x7efe1012be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.998 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe0f7fe640 1 -- 172.21.15.104:0/134771194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe100b5ba0 msgr2=0x7efe10131e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:36.999 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe0f7fe640 1 --2- 172.21.15.104:0/134771194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe100b5ba0 0x7efe10131e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:36.999 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe0f7fe640 1 -- 172.21.15.104:0/134771194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe00009900 con 0x7efe101ddb00 2023-09-13T02:12:36.999 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe0f7fe640 1 --2- 172.21.15.104:0/134771194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe101ddb00 0x7efe101ddfb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efe0800c970 tx=0x7efe0800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:36.999 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efdf77fe640 1 -- 172.21.15.104:0/134771194 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe08004230 con 0x7efe101ddb00 2023-09-13T02:12:36.999 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efdf77fe640 1 -- 172.21.15.104:0/134771194 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efe080044a0 con 0x7efe101ddb00 2023-09-13T02:12:37.000 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe156bb640 1 -- 172.21.15.104:0/134771194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe10139820 con 0x7efe101ddb00 2023-09-13T02:12:37.000 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efdf77fe640 1 -- 172.21.15.104:0/134771194 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe08007c10 con 0x7efe101ddb00 2023-09-13T02:12:37.000 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.992+0000 7efe156bb640 1 -- 172.21.15.104:0/134771194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe101306a0 con 0x7efe101ddb00 2023-09-13T02:12:37.000 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.994+0000 7efdf77fe640 1 -- 172.21.15.104:0/134771194 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7efe080035f0 con 0x7efe101ddb00 2023-09-13T02:12:37.000 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.994+0000 7efdf77fe640 1 --2- 172.21.15.104:0/134771194 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7efdfc06a520 0x7efdfc06c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:37.001 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.994+0000 7efe0effd640 1 --2- 172.21.15.104:0/134771194 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7efdfc06a520 0x7efdfc06c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:37.001 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.994+0000 7efdf77fe640 1 -- 172.21.15.104:0/134771194 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe08088f40 con 0x7efe101ddb00 2023-09-13T02:12:37.001 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.995+0000 7efe0effd640 1 --2- 172.21.15.104:0/134771194 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7efdfc06a520 0x7efdfc06c9e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efe00036000 tx=0x7efe00004ab0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:37.007 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.995+0000 7efe18236740 1 Processor -- start 2023-09-13T02:12:37.007 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.996+0000 7efe18236740 1 -- start start 2023-09-13T02:12:37.008 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.996+0000 7efe18236740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde427b6b0 0x55fde42aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:37.008 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.996+0000 7efe18236740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde42ab110 0x55fde42a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:37.008 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.996+0000 7efe18236740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42a40b0 0x55fde42a4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:37.008 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.996+0000 7efe18236740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde4189700 con 0x55fde42a40b0 2023-09-13T02:12:37.009 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.996+0000 7efe18236740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde41e9220 con 0x55fde42ab110 2023-09-13T02:12:37.009 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.996+0000 7efe18236740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fde41e6910 con 0x55fde427b6b0 2023-09-13T02:12:37.009 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.996+0000 7efe0f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42a40b0 0x55fde42a4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:37.009 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.996+0000 7efe0f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42a40b0 0x55fde42a4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39788/0 (socket says 172.21.15.104:39788) 2023-09-13T02:12:37.009 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.996+0000 7efe0f7fe640 1 -- 172.21.15.104:0/2801389926 learned_addr learned my addr 172.21.15.104:0/2801389926 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:37.010 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.996+0000 7efe0effd640 1 --2- 172.21.15.104:0/2801389926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde427b6b0 0x55fde42aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:37.010 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.996+0000 7efe0e7fc640 1 --2- 172.21.15.104:0/2801389926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde42ab110 0x55fde42a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:37.010 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.996+0000 7efe0f7fe640 1 -- 172.21.15.104:0/2801389926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde427b6b0 msgr2=0x55fde42aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T02:12:37.010 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.996+0000 7efe0f7fe640 1 --2- 172.21.15.104:0/2801389926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde427b6b0 0x55fde42aabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.010 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.996+0000 7efe0f7fe640 1 -- 172.21.15.104:0/2801389926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde42ab110 msgr2=0x55fde42a3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T02:12:37.011 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.996+0000 7efe0f7fe640 1 --2- 172.21.15.104:0/2801389926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde42ab110 0x55fde42a3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.011 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.996+0000 7efe0f7fe640 1 -- 172.21.15.104:0/2801389926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fde41e6e70 con 0x55fde42a40b0 2023-09-13T02:12:37.011 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.997+0000 7efe0f7fe640 1 --2- 172.21.15.104:0/2801389926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42a40b0 0x55fde42a4530 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efe0805fc20 tx=0x7efe08057c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc6526723814429 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:37.011 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.997+0000 7efdf4ff9640 1 -- 172.21.15.104:0/2801389926 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0805e070 con 0x55fde42a40b0 2023-09-13T02:12:37.011 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.997+0000 7efdf4ff9640 1 -- 172.21.15.104:0/2801389926 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efe080566b0 con 0x55fde42a40b0 2023-09-13T02:12:37.012 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.997+0000 7efdf4ff9640 1 -- 172.21.15.104:0/2801389926 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe08054930 con 0x55fde42a40b0 2023-09-13T02:12:37.012 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.997+0000 7efe18236740 1 -- 172.21.15.104:0/2801389926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42a40b0 msgr2=0x55fde42a4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:37.012 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.997+0000 7efe18236740 1 --2- 172.21.15.104:0/2801389926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42a40b0 0x55fde42a4530 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efe0805fc20 tx=0x7efe08057c80 comp rx=0 tx=0).stop 2023-09-13T02:12:37.012 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.997+0000 7efe18236740 1 -- 172.21.15.104:0/2801389926 shutdown_connections 2023-09-13T02:12:37.012 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.997+0000 7efe18236740 1 --2- 172.21.15.104:0/2801389926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42a40b0 0x55fde42a4530 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.013 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.997+0000 7efe18236740 1 --2- 172.21.15.104:0/2801389926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde42ab110 0x55fde42a3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.013 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.997+0000 7efe18236740 1 --2- 172.21.15.104:0/2801389926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde427b6b0 0x55fde42aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.013 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.997+0000 7efe18236740 1 -- 172.21.15.104:0/2801389926 >> 172.21.15.104:0/2801389926 conn(0x55fde4278c80 msgr2=0x55fde427ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:37.013 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.997+0000 7efe18236740 1 -- 172.21.15.104:0/2801389926 shutdown_connections 2023-09-13T02:12:37.013 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.997+0000 7efe18236740 1 -- 172.21.15.104:0/2801389926 wait complete. 2023-09-13T02:12:37.014 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.998+0000 7efe18236740 1 -- start start 2023-09-13T02:12:37.014 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.998+0000 7efe18236740 1 Processor -- start 2023-09-13T02:12:37.014 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.998+0000 7efe18236740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde42a40b0 0x55fde42be2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:37.014 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.998+0000 7efe18236740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde42ab110 0x55fde429e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:37.014 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.998+0000 7efe18236740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde429bea0 0x55fde42af140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:37.015 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.998+0000 7efe18236740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde41e2200 con 0x55fde429bea0 2023-09-13T02:12:37.015 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe18236740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde4181d00 con 0x55fde42ab110 2023-09-13T02:12:37.015 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe18236740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fde41819a0 con 0x55fde42a40b0 2023-09-13T02:12:37.015 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe18236740 10 client.0 _ll_register_callbacks cb 0x55fde4181680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T02:12:37.015 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe0f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde429bea0 0x55fde42af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:37.016 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe0f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde429bea0 0x55fde42af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39796/0 (socket says 172.21.15.104:39796) 2023-09-13T02:12:37.016 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe0f7fe640 1 -- 172.21.15.104:0/3752983706 learned_addr learned my addr 172.21.15.104:0/3752983706 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:37.016 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe0e7fc640 1 --2- 172.21.15.104:0/3752983706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde42ab110 0x55fde429e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:37.016 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe0effd640 1 --2- 172.21.15.104:0/3752983706 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde42a40b0 0x55fde42be2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:37.016 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe0f7fe640 1 -- 172.21.15.104:0/3752983706 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde42a40b0 msgr2=0x55fde42be2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T02:12:37.017 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe0f7fe640 1 --2- 172.21.15.104:0/3752983706 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde42a40b0 0x55fde42be2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.017 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe0f7fe640 1 -- 172.21.15.104:0/3752983706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde42ab110 msgr2=0x55fde429e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T02:12:37.017 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe0f7fe640 1 --2- 172.21.15.104:0/3752983706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde42ab110 0x55fde429e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.017 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe0f7fe640 1 -- 172.21.15.104:0/3752983706 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe101306a0 con 0x55fde429bea0 2023-09-13T02:12:37.017 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe0f7fe640 1 --2- 172.21.15.104:0/3752983706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde429bea0 0x55fde42af140 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efe080583e0 tx=0x7efe0800a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3e1682b978f11c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:37.018 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efdedffb640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2023-09-13T02:12:37.018 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efdedffb640 1 -- 172.21.15.104:0/3752983706 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe08007e70 con 0x55fde429bea0 2023-09-13T02:12:37.018 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efdedffb640 1 -- 172.21.15.104:0/3752983706 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe0805fcc0 con 0x55fde429bea0 2023-09-13T02:12:37.018 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe18236740 1 -- 172.21.15.104:0/3752983706 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fde4209b80 con 0x55fde429bea0 2023-09-13T02:12:37.019 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efdedffb640 1 -- 172.21.15.104:0/3752983706 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe08087180 con 0x55fde429bea0 2023-09-13T02:12:37.019 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe18236740 10 client.4716 fetch_fsmap learned FSMap version 6 2023-09-13T02:12:37.019 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe18236740 1 -- 172.21.15.104:0/3752983706 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55fde41e0880 con 0x55fde429bea0 2023-09-13T02:12:37.019 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efdedffb640 1 -- 172.21.15.104:0/3752983706 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55fde4209b80 con 0x55fde429bea0 2023-09-13T02:12:37.019 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efdedffb640 1 -- 172.21.15.104:0/3752983706 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 6) v1 ==== 2144+0+0 (secure 0 0 0) 0x7efe08054010 con 0x55fde429bea0 2023-09-13T02:12:37.019 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe18236740 10 client.4716 fetch_fsmap finished waiting for FSMap version 6 2023-09-13T02:12:37.020 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe18236740 10 client.4716 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-13T02:12:37.020 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe18236740 20 client.4716 populate_metadata read hostname 'smithi104' 2023-09-13T02:12:37.020 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe18236740 1 --2- 172.21.15.104:0/3752983706 >> [v2:172.21.15.104:6834/1426622388,v1:172.21.15.104:6835/1426622388] conn(0x55fde42afb50 0x55fde42c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:37.020 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe18236740 4 client.4716 mds_command: new command op to 4365 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-13T02:12:37.020 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:36.999+0000 7efe18236740 1 -- 172.21.15.104:0/3752983706 --> [v2:172.21.15.104:6834/1426622388,v1:172.21.15.104:6835/1426622388] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fde41b6820 con 0x55fde42afb50 2023-09-13T02:12:37.021 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.000+0000 7efe0effd640 1 --2- 172.21.15.104:0/3752983706 >> [v2:172.21.15.104:6834/1426622388,v1:172.21.15.104:6835/1426622388] conn(0x55fde42afb50 0x55fde42c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:37.021 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.000+0000 7efdedffb640 10 client.4716 ms_handle_connect on v2:172.21.15.104:6834/1426622388 2023-09-13T02:12:37.021 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.000+0000 7efe0effd640 1 --2- 172.21.15.104:0/3752983706 >> [v2:172.21.15.104:6834/1426622388,v1:172.21.15.104:6835/1426622388] conn(0x55fde42afb50 0x55fde42c91c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c5b728d7e0eeabc server_cookie=946ec1c9153042e6 in_seq=0 out_seq=0 2023-09-13T02:12:37.021 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.000+0000 7efdedffb640 1 -- 172.21.15.104:0/3752983706 <== mds.0 v2:172.21.15.104:6834/1426622388 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fde41b6820 con 0x55fde42afb50 2023-09-13T02:12:37.021 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.000+0000 7efdedffb640 10 client.4716 handle_command_reply: tid=0 2023-09-13T02:12:37.022 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.000+0000 7efe18236740 1 client.4716 shutdown 2023-09-13T02:12:37.022 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.000+0000 7efe18236740 1 -- 172.21.15.104:0/3752983706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde429bea0 msgr2=0x55fde42af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:37.022 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.000+0000 7efe18236740 1 --2- 172.21.15.104:0/3752983706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde429bea0 0x55fde42af140 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efe080583e0 tx=0x7efe0800a590 comp rx=0 tx=0).stop 2023-09-13T02:12:37.022 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.001+0000 7efe18236740 1 -- 172.21.15.104:0/3752983706 shutdown_connections 2023-09-13T02:12:37.022 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.001+0000 7efe18236740 1 --2- 172.21.15.104:0/3752983706 >> [v2:172.21.15.104:6834/1426622388,v1:172.21.15.104:6835/1426622388] conn(0x55fde42afb50 0x55fde42c91c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.023 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.001+0000 7efe18236740 1 --2- 172.21.15.104:0/3752983706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde429bea0 0x55fde42af140 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.023 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.001+0000 7efe18236740 1 --2- 172.21.15.104:0/3752983706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde42ab110 0x55fde429e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.023 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.001+0000 7efdedffb640 0 client.4716 ms_handle_reset on v2:172.21.15.104:6834/1426622388 2023-09-13T02:12:37.023 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.001+0000 7efe18236740 1 --2- 172.21.15.104:0/3752983706 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde42a40b0 0x55fde42be2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.023 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.001+0000 7efe18236740 1 -- 172.21.15.104:0/3752983706 >> 172.21.15.104:0/3752983706 conn(0x55fde427b6b0 msgr2=0x55fde4275c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:37.024 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.001+0000 7efe18236740 1 -- 172.21.15.104:0/3752983706 shutdown_connections 2023-09-13T02:12:37.024 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.001+0000 7efe18236740 1 -- 172.21.15.104:0/3752983706 wait complete. 2023-09-13T02:12:37.024 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.001+0000 7efe18236740 20 client.4716 trim_cache size 0 max 16384 2023-09-13T02:12:37.030 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.016+0000 7efe18236740 1 Processor -- start 2023-09-13T02:12:37.030 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.016+0000 7efe18236740 1 -- start start 2023-09-13T02:12:37.030 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.016+0000 7efe18236740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde429bea0 0x55fde42b9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:37.030 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.016+0000 7efe18236740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42a40b0 0x55fde42a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:37.031 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.016+0000 7efe18236740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde42ab110 0x55fde42cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:37.031 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.016+0000 7efe18236740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde4164240 con 0x55fde42a40b0 2023-09-13T02:12:37.031 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.016+0000 7efe18236740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde4278890 con 0x55fde429bea0 2023-09-13T02:12:37.031 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.016+0000 7efe18236740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fde42af0b0 con 0x55fde42ab110 2023-09-13T02:12:37.031 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.016+0000 7efe0e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42a40b0 0x55fde42a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.016+0000 7efe0e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42a40b0 0x55fde42a58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39806/0 (socket says 172.21.15.104:39806) 2023-09-13T02:12:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.016+0000 7efe0e7fc640 1 -- 172.21.15.104:0/2218286657 learned_addr learned my addr 172.21.15.104:0/2218286657 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.016+0000 7efe0f7fe640 1 --2- 172.21.15.104:0/2218286657 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde42ab110 0x55fde42cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.016+0000 7efe0effd640 1 --2- 172.21.15.104:0/2218286657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde429bea0 0x55fde42b9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efe0e7fc640 1 -- 172.21.15.104:0/2218286657 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde42ab110 msgr2=0x55fde42cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T02:12:37.033 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efe0e7fc640 1 --2- 172.21.15.104:0/2218286657 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde42ab110 0x55fde42cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.033 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efe0e7fc640 1 -- 172.21.15.104:0/2218286657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde429bea0 msgr2=0x55fde42b9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T02:12:37.033 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efe0e7fc640 1 --2- 172.21.15.104:0/2218286657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde429bea0 0x55fde42b9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.033 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efe0e7fc640 1 -- 172.21.15.104:0/2218286657 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fde4180cd0 con 0x55fde42a40b0 2023-09-13T02:12:37.033 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efe0e7fc640 1 --2- 172.21.15.104:0/2218286657 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42a40b0 0x55fde42a58a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efe1006bb90 tx=0x7efe04007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3910c7a0152be3c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:37.034 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efdf57fa640 1 -- 172.21.15.104:0/2218286657 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04014c30 con 0x55fde42a40b0 2023-09-13T02:12:37.034 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efdf57fa640 1 -- 172.21.15.104:0/2218286657 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efe04014e80 con 0x55fde42a40b0 2023-09-13T02:12:37.034 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efdf57fa640 1 -- 172.21.15.104:0/2218286657 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04007290 con 0x55fde42a40b0 2023-09-13T02:12:37.034 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efe18236740 1 -- 172.21.15.104:0/2218286657 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42a40b0 msgr2=0x55fde42a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:37.034 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efe18236740 1 --2- 172.21.15.104:0/2218286657 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42a40b0 0x55fde42a58a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efe1006bb90 tx=0x7efe04007e30 comp rx=0 tx=0).stop 2023-09-13T02:12:37.035 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efe18236740 1 -- 172.21.15.104:0/2218286657 shutdown_connections 2023-09-13T02:12:37.035 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efe18236740 1 --2- 172.21.15.104:0/2218286657 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde42ab110 0x55fde42cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.035 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efe18236740 1 --2- 172.21.15.104:0/2218286657 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42a40b0 0x55fde42a58a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.035 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efe18236740 1 --2- 172.21.15.104:0/2218286657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde429bea0 0x55fde42b9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.035 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efe18236740 1 -- 172.21.15.104:0/2218286657 >> 172.21.15.104:0/2218286657 conn(0x55fde427b6b0 msgr2=0x55fde42aa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:37.036 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efe18236740 1 -- 172.21.15.104:0/2218286657 shutdown_connections 2023-09-13T02:12:37.036 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.017+0000 7efe18236740 1 -- 172.21.15.104:0/2218286657 wait complete. 2023-09-13T02:12:37.036 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.018+0000 7efe18236740 1 -- start start 2023-09-13T02:12:37.036 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.018+0000 7efe18236740 1 Processor -- start 2023-09-13T02:12:37.036 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.018+0000 7efe18236740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde429bea0 0x55fde43167e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:37.037 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.018+0000 7efe18236740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde42a40b0 0x55fde4279be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:37.037 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.018+0000 7efe18236740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42ab110 0x55fde4313090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:37.037 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.018+0000 7efe18236740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde4316d20 con 0x55fde42ab110 2023-09-13T02:12:37.037 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.018+0000 7efe18236740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde4312b40 con 0x55fde42a40b0 2023-09-13T02:12:37.037 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.018+0000 7efe18236740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fde4315d90 con 0x55fde429bea0 2023-09-13T02:12:37.037 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.018+0000 7efe18236740 10 client.0 _ll_register_callbacks cb 0x7efe08058220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T02:12:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe0f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42ab110 0x55fde4313090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe0f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42ab110 0x55fde4313090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39814/0 (socket says 172.21.15.104:39814) 2023-09-13T02:12:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe0f7fe640 1 -- 172.21.15.104:0/1347277425 learned_addr learned my addr 172.21.15.104:0/1347277425 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:12:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe0e7fc640 1 --2- 172.21.15.104:0/1347277425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde42a40b0 0x55fde4279be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe0effd640 1 --2- 172.21.15.104:0/1347277425 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde429bea0 0x55fde43167e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:37.039 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe0f7fe640 1 -- 172.21.15.104:0/1347277425 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde429bea0 msgr2=0x55fde43167e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T02:12:37.039 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe0f7fe640 1 --2- 172.21.15.104:0/1347277425 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde429bea0 0x55fde43167e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.039 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe0f7fe640 1 -- 172.21.15.104:0/1347277425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde42a40b0 msgr2=0x55fde4279be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T02:12:37.039 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe0f7fe640 1 --2- 172.21.15.104:0/1347277425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde42a40b0 0x55fde4279be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.039 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe0f7fe640 1 -- 172.21.15.104:0/1347277425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe04004cb0 con 0x55fde42ab110 2023-09-13T02:12:37.040 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe0f7fe640 1 --2- 172.21.15.104:0/1347277425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42ab110 0x55fde4313090 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efe0800c940 tx=0x7efe080580b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f376d1ae2dbc312 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:12:37.040 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efdedffb640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2023-09-13T02:12:37.040 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efdedffb640 1 -- 172.21.15.104:0/1347277425 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe08087180 con 0x55fde42ab110 2023-09-13T02:12:37.040 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efdedffb640 1 -- 172.21.15.104:0/1347277425 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe0805ff20 con 0x55fde42ab110 2023-09-13T02:12:37.040 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe18236740 1 -- 172.21.15.104:0/1347277425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe080566b0 con 0x55fde42ab110 2023-09-13T02:12:37.041 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efdedffb640 1 -- 172.21.15.104:0/1347277425 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe0805e070 con 0x55fde42ab110 2023-09-13T02:12:37.041 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe18236740 10 client.4722 fetch_fsmap learned FSMap version 6 2023-09-13T02:12:37.041 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe18236740 1 -- 172.21.15.104:0/1347277425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55fde41a62c0 con 0x55fde42ab110 2023-09-13T02:12:37.041 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efdedffb640 1 -- 172.21.15.104:0/1347277425 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efe080566b0 con 0x55fde42ab110 2023-09-13T02:12:37.041 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efdedffb640 1 -- 172.21.15.104:0/1347277425 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 6) v1 ==== 2144+0+0 (secure 0 0 0) 0x7efe0807d030 con 0x55fde42ab110 2023-09-13T02:12:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe18236740 10 client.4722 fetch_fsmap finished waiting for FSMap version 6 2023-09-13T02:12:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe18236740 10 client.4722 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-13T02:12:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe18236740 20 client.4722 populate_metadata read hostname 'smithi104' 2023-09-13T02:12:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe18236740 1 --2- 172.21.15.104:0/1347277425 >> [v2:172.21.15.104:6834/1426622388,v1:172.21.15.104:6835/1426622388] conn(0x55fde4276a20 0x55fde42adf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:12:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe18236740 4 client.4722 mds_command: new command op to 4365 tid=0[{"prefix": "status"}] 2023-09-13T02:12:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.019+0000 7efe18236740 1 -- 172.21.15.104:0/1347277425 --> [v2:172.21.15.104:6834/1426622388,v1:172.21.15.104:6835/1426622388] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fde41db1e0 con 0x55fde4276a20 2023-09-13T02:12:37.043 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efe0effd640 1 --2- 172.21.15.104:0/1347277425 >> [v2:172.21.15.104:6834/1426622388,v1:172.21.15.104:6835/1426622388] conn(0x55fde4276a20 0x55fde42adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:12:37.043 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efdedffb640 10 client.4722 ms_handle_connect on v2:172.21.15.104:6834/1426622388 2023-09-13T02:12:37.043 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efe0effd640 1 --2- 172.21.15.104:0/1347277425 >> [v2:172.21.15.104:6834/1426622388,v1:172.21.15.104:6835/1426622388] conn(0x55fde4276a20 0x55fde42adf60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c95a64f175d82ed server_cookie=e56f3c753e1b164c in_seq=0 out_seq=0 2023-09-13T02:12:37.043 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efdedffb640 1 -- 172.21.15.104:0/1347277425 <== mds.0 v2:172.21.15.104:6834/1426622388 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55fde41db1e0 con 0x55fde4276a20 2023-09-13T02:12:37.043 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efdedffb640 10 client.4722 handle_command_reply: tid=0 2023-09-13T02:12:37.044 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efe18236740 1 client.4722 shutdown 2023-09-13T02:12:37.044 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efe18236740 1 -- 172.21.15.104:0/1347277425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42ab110 msgr2=0x55fde4313090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:37.044 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efe18236740 1 --2- 172.21.15.104:0/1347277425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42ab110 0x55fde4313090 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efe0800c940 tx=0x7efe080580b0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.044 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efe18236740 1 -- 172.21.15.104:0/1347277425 shutdown_connections 2023-09-13T02:12:37.044 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efe18236740 1 --2- 172.21.15.104:0/1347277425 >> [v2:172.21.15.104:6834/1426622388,v1:172.21.15.104:6835/1426622388] conn(0x55fde4276a20 0x55fde42adf60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.045 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efe18236740 1 --2- 172.21.15.104:0/1347277425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fde42ab110 0x55fde4313090 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.045 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efdedffb640 0 client.4722 ms_handle_reset on v2:172.21.15.104:6834/1426622388 2023-09-13T02:12:37.045 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efe18236740 1 --2- 172.21.15.104:0/1347277425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fde42a40b0 0x55fde4279be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.045 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efe18236740 1 --2- 172.21.15.104:0/1347277425 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55fde429bea0 0x55fde43167e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.045 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efe18236740 1 -- 172.21.15.104:0/1347277425 >> 172.21.15.104:0/1347277425 conn(0x55fde427b6b0 msgr2=0x55fde42aa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:37.046 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efe18236740 1 -- 172.21.15.104:0/1347277425 shutdown_connections 2023-09-13T02:12:37.046 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efe18236740 1 -- 172.21.15.104:0/1347277425 wait complete. 2023-09-13T02:12:37.046 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.020+0000 7efe18236740 20 client.4722 trim_cache size 0 max 16384 2023-09-13T02:12:37.046 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2023-09-13T02:12:37.047 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "ac1f5a95-0d3a-406e-b4ca-c8ea43282cab", 2023-09-13T02:12:37.047 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2023-09-13T02:12:37.047 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 4365, 2023-09-13T02:12:37.047 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2023-09-13T02:12:37.047 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2023-09-13T02:12:37.048 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2023-09-13T02:12:37.048 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 12.170823141, 2023-09-13T02:12:37.048 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 6, 2023-09-13T02:12:37.048 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 20, 2023-09-13T02:12:37.048 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 20, 2023-09-13T02:12:37.048 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 19.254056415000001 2023-09-13T02:12:37.049 INFO:teuthology.orchestra.run.smithi104.stdout:} 2023-09-13T02:12:37.050 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.021+0000 7efe156bb640 1 -- 172.21.15.104:0/134771194 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7efdfc06a520 msgr2=0x7efdfc06c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:37.050 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.021+0000 7efe156bb640 1 --2- 172.21.15.104:0/134771194 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7efdfc06a520 0x7efdfc06c9e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efe00036000 tx=0x7efe00004ab0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.050 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.021+0000 7efe156bb640 1 -- 172.21.15.104:0/134771194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe101ddb00 msgr2=0x7efe101ddfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:12:37.051 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.021+0000 7efe156bb640 1 --2- 172.21.15.104:0/134771194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe101ddb00 0x7efe101ddfb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efe0800c970 tx=0x7efe0800ce30 comp rx=0 tx=0).stop 2023-09-13T02:12:37.051 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.021+0000 7efe156bb640 1 -- 172.21.15.104:0/134771194 shutdown_connections 2023-09-13T02:12:37.051 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.021+0000 7efe156bb640 1 --2- 172.21.15.104:0/134771194 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7efdfc06a520 0x7efdfc06c9e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.051 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.021+0000 7efe156bb640 1 --2- 172.21.15.104:0/134771194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe101ddb00 0x7efe101ddfb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.051 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.021+0000 7efe156bb640 1 --2- 172.21.15.104:0/134771194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe10147b90 0x7efe1012be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.052 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.021+0000 7efe156bb640 1 --2- 172.21.15.104:0/134771194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe100b5ba0 0x7efe10131e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:12:37.052 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.021+0000 7efe156bb640 1 -- 172.21.15.104:0/134771194 >> 172.21.15.104:0/134771194 conn(0x7efe100708b0 msgr2=0x7efe100adbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:12:37.052 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.021+0000 7efe156bb640 1 -- 172.21.15.104:0/134771194 shutdown_connections 2023-09-13T02:12:37.052 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:12:37.021+0000 7efe156bb640 1 -- 172.21.15.104:0/134771194 wait complete. 2023-09-13T02:12:37.053 INFO:teuthology.run_tasks:Running task workunit... 2023-09-13T02:12:37.069 INFO:tasks.workunit:Pulling workunits from ref 3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f 2023-09-13T02:12:37.069 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-09-13T02:12:37.070 DEBUG:teuthology.orchestra.run.smithi104:> stat -- /home/ubuntu/cephtest/mnt.0 2023-09-13T02:12:37.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T02:12:37.086 INFO:teuthology.orchestra.run.smithi104.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-09-13T02:12:37.086 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-09-13T02:12:37.140 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-09-13T02:12:37.140 DEBUG:teuthology.orchestra.run.smithi104:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-09-13T02:12:37.194 INFO:tasks.workunit:timeout=3h 2023-09-13T02:12:37.194 INFO:tasks.workunit:cleanup=True 2023-09-13T02:12:37.195 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/batrick/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f 2023-09-13T02:12:37.249 INFO:tasks.workunit.client.0.smithi104.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-09-13T02:12:53.944 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:12:53.947 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:13:16.397 INFO:tasks.workunit.client.0.smithi104.stderr:Note: switching to '3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f'. 2023-09-13T02:13:16.397 INFO:tasks.workunit.client.0.smithi104.stderr: 2023-09-13T02:13:16.397 INFO:tasks.workunit.client.0.smithi104.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-09-13T02:13:16.398 INFO:tasks.workunit.client.0.smithi104.stderr:changes and commit them, and you can discard any commits you make in this 2023-09-13T02:13:16.398 INFO:tasks.workunit.client.0.smithi104.stderr:state without impacting any branches by switching back to a branch. 2023-09-13T02:13:16.398 INFO:tasks.workunit.client.0.smithi104.stderr: 2023-09-13T02:13:16.398 INFO:tasks.workunit.client.0.smithi104.stderr:If you want to create a new branch to retain commits you create, you may 2023-09-13T02:13:16.399 INFO:tasks.workunit.client.0.smithi104.stderr:do so (now or later) by using -c with the switch command. Example: 2023-09-13T02:13:16.399 INFO:tasks.workunit.client.0.smithi104.stderr: 2023-09-13T02:13:16.399 INFO:tasks.workunit.client.0.smithi104.stderr: git switch -c 2023-09-13T02:13:16.399 INFO:tasks.workunit.client.0.smithi104.stderr: 2023-09-13T02:13:16.400 INFO:tasks.workunit.client.0.smithi104.stderr:Or undo this operation with: 2023-09-13T02:13:16.400 INFO:tasks.workunit.client.0.smithi104.stderr: 2023-09-13T02:13:16.400 INFO:tasks.workunit.client.0.smithi104.stderr: git switch - 2023-09-13T02:13:16.401 INFO:tasks.workunit.client.0.smithi104.stderr: 2023-09-13T02:13:16.401 INFO:tasks.workunit.client.0.smithi104.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-09-13T02:13:16.401 INFO:tasks.workunit.client.0.smithi104.stderr: 2023-09-13T02:13:16.401 INFO:tasks.workunit.client.0.smithi104.stderr:HEAD is now at 3711e7dcbd7 qa: use exisitng ignorelist override list for fs:mirror[-ha] 2023-09-13T02:13:16.403 DEBUG:teuthology.orchestra.run.smithi104:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-09-13T02:13:16.428 INFO:tasks.workunit.client.0.smithi104.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-09-13T02:13:16.430 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-09-13T02:13:16.430 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-09-13T02:13:17.057 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-09-13T02:13:17.119 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-09-13T02:13:17.159 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-09-13T02:13:17.160 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-09-13T02:13:17.161 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-09-13T02:13:17.199 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-09-13T02:13:17.202 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-09-13T02:13:17.202 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-09-13T02:13:17.258 INFO:tasks.workunit:Running workunits matching fs/test_python.sh on client.0... 2023-09-13T02:13:17.259 INFO:tasks.workunit:Running workunit fs/test_python.sh... 2023-09-13T02:13:17.260 DEBUG:teuthology.orchestra.run.smithi104:workunit test fs/test_python.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh 2023-09-13T02:13:17.316 INFO:tasks.workunit.client.0.smithi104.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh 2023-09-13T02:13:17.317 INFO:tasks.workunit.client.0.smithi104.stderr:+ sudo python3 -m pytest -v /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/../../../src/test/pybind/test_cephfs.py 2023-09-13T02:13:17.496 INFO:tasks.workunit.client.0.smithi104.stdout:============================= test session starts ============================== 2023-09-13T02:13:17.496 INFO:tasks.workunit.client.0.smithi104.stdout:platform linux -- Python 3.9.17, pytest-6.2.2, py-1.10.0, pluggy-0.13.1 -- /bin/python3 2023-09-13T02:13:17.497 INFO:tasks.workunit.client.0.smithi104.stdout:cachedir: .pytest_cache 2023-09-13T02:13:17.497 INFO:tasks.workunit.client.0.smithi104.stdout:rootdir: /home/ubuntu/cephtest/clone.client.0/src/test/pybind, configfile: pytest.ini 2023-09-13T02:13:17.539 INFO:tasks.workunit.client.0.smithi104.stdout:collecting ... collected 54 items 2023-09-13T02:13:17.539 INFO:tasks.workunit.client.0.smithi104.stdout: 2023-09-13T02:13:17.553 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_conf_get PASSED [ 1%] 2023-09-13T02:13:17.554 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_version PASSED [ 3%] 2023-09-13T02:13:17.558 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_fstat PASSED [ 5%] 2023-09-13T02:13:17.562 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_statfs PASSED [ 7%] 2023-09-13T02:13:17.572 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_statx PASSED [ 9%] 2023-09-13T02:13:17.577 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_syncfs PASSED [ 11%] 2023-09-13T02:13:17.585 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_fsync PASSED [ 12%] 2023-09-13T02:13:17.605 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_directory PASSED [ 14%] 2023-09-13T02:13:17.623 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_walk_dir PASSED [ 16%] 2023-09-13T02:13:17.631 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_xattr PASSED [ 18%] 2023-09-13T02:13:17.649 INFO:tasks.ceph.mds.a.smithi104.stderr:2023-09-13T02:13:17.649+0000 7f34e40e0640 -1 mds.0.server mirror info parse error 2023-09-13T02:13:17.650 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_ceph_mirror_xattr PASSED [ 20%] 2023-09-13T02:13:17.665 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_fxattr PASSED [ 22%] 2023-09-13T02:13:17.682 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_rename PASSED [ 24%] 2023-09-13T02:13:17.698 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_open PASSED [ 25%] 2023-09-13T02:13:17.710 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_link PASSED [ 27%] 2023-09-13T02:13:17.720 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_symlink PASSED [ 29%] 2023-09-13T02:13:17.733 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_readlink PASSED [ 31%] 2023-09-13T02:13:17.743 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_delete_cwd PASSED [ 33%] 2023-09-13T02:13:17.752 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_flock PASSED [ 35%] 2023-09-13T02:13:17.832 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_mount_unmount PASSED [ 37%] 2023-09-13T02:13:17.850 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_lxattr PASSED [ 38%] 2023-09-13T02:13:18.905 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_mount_root PASSED [ 40%] 2023-09-13T02:13:19.922 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_utime PASSED [ 42%] 2023-09-13T02:13:20.931 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_futime PASSED [ 44%] 2023-09-13T02:13:21.940 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_utimes PASSED [ 46%] 2023-09-13T02:13:22.958 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_lutimes PASSED [ 48%] 2023-09-13T02:13:23.969 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_futimes PASSED [ 50%] 2023-09-13T02:13:24.081 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:13:24.085 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:13:24.978 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_futimens PASSED [ 51%] 2023-09-13T02:13:25.994 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_lchmod PASSED [ 53%] 2023-09-13T02:13:26.002 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_fchmod PASSED [ 55%] 2023-09-13T02:13:26.009 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_fchown PASSED [ 57%] 2023-09-13T02:13:26.020 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_truncate PASSED [ 59%] 2023-09-13T02:13:26.035 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_ftruncate PASSED [ 61%] 2023-09-13T02:13:26.045 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_fallocate PASSED [ 62%] 2023-09-13T02:13:26.052 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_mknod PASSED [ 64%] 2023-09-13T02:13:26.062 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_lazyio PASSED [ 66%] 2023-09-13T02:13:26.334 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_replication PASSED [ 68%] 2023-09-13T02:13:26.341 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_caps PASSED [ 70%] 2023-09-13T02:13:26.361 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_setuuid PASSED [ 72%] 2023-09-13T02:13:26.381 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_session_timeout PASSED [ 74%] 2023-09-13T02:13:26.403 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_readdirops PASSED [ 75%] 2023-09-13T02:13:26.407 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_preadv_pwritev PASSED [ 77%] 2023-09-13T02:13:27.424 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_setattrx PASSED [ 79%] 2023-09-13T02:13:28.435 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_fsetattrx PASSED [ 81%] 2023-09-13T02:13:28.443 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_get_layout PASSED [ 83%] 2023-09-13T02:13:28.449 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_get_default_pool PASSED [ 85%] 2023-09-13T02:13:28.727 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_get_pool PASSED [ 87%] 2023-09-13T02:13:28.760 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_disk_quota_exceeeded_error FAILED [ 88%] 2023-09-13T02:13:28.789 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_empty_snapshot_info PASSED [ 90%] 2023-09-13T02:13:28.811 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_snapshot_info PASSED [ 92%] 2023-09-13T02:13:28.815 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_set_mount_timeout_post_mount PASSED [ 94%] 2023-09-13T02:13:28.951 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_set_mount_timeout PASSED [ 96%] 2023-09-13T02:13:28.963 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_set_mount_timeout_lt0 PASSED [ 98%] 2023-09-13T02:13:29.992 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_snapdiff PASSED [100%] 2023-09-13T02:13:29.993 INFO:tasks.workunit.client.0.smithi104.stdout: 2023-09-13T02:13:29.993 INFO:tasks.workunit.client.0.smithi104.stdout:=================================== FAILURES =================================== 2023-09-13T02:13:29.993 INFO:tasks.workunit.client.0.smithi104.stdout:_______________________ test_disk_quota_exceeeded_error ________________________ 2023-09-13T02:13:29.994 INFO:tasks.workunit.client.0.smithi104.stdout: 2023-09-13T02:13:29.994 INFO:tasks.workunit.client.0.smithi104.stdout:testdir = None 2023-09-13T02:13:29.994 INFO:tasks.workunit.client.0.smithi104.stdout: 2023-09-13T02:13:29.994 INFO:tasks.workunit.client.0.smithi104.stdout: def test_disk_quota_exceeeded_error(testdir): 2023-09-13T02:13:29.994 INFO:tasks.workunit.client.0.smithi104.stdout: cephfs.mkdir("/dir-1", 0o755) 2023-09-13T02:13:29.995 INFO:tasks.workunit.client.0.smithi104.stdout: cephfs.setxattr("/dir-1", "ceph.quota.max_bytes", b"4096", 0) 2023-09-13T02:13:29.995 INFO:tasks.workunit.client.0.smithi104.stdout: fd = cephfs.open(b'/dir-1/file-1', 'w', 0o755) 2023-09-13T02:13:29.995 INFO:tasks.workunit.client.0.smithi104.stdout: cephfs.ftruncate(fd, 4092) 2023-09-13T02:13:29.995 INFO:tasks.workunit.client.0.smithi104.stdout: cephfs.lseek(fd, 4090, os.SEEK_SET) 2023-09-13T02:13:29.995 INFO:tasks.workunit.client.0.smithi104.stdout:> assert_raises(libcephfs.DiskQuotaExceeded, cephfs.write, fd, b"abcdeghiklmnopqrstuvwxyz1234567890qwertyuioddd", -1) 2023-09-13T02:13:29.996 INFO:tasks.workunit.client.0.smithi104.stdout: 2023-09-13T02:13:29.996 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py:832: 2023-09-13T02:13:29.996 INFO:tasks.workunit.client.0.smithi104.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-09-13T02:13:29.996 INFO:tasks.workunit.client.0.smithi104.stdout: 2023-09-13T02:13:29.996 INFO:tasks.workunit.client.0.smithi104.stdout:excClass = 2023-09-13T02:13:29.996 INFO:tasks.workunit.client.0.smithi104.stdout:callableObj = 2023-09-13T02:13:29.997 INFO:tasks.workunit.client.0.smithi104.stdout:args = (10, b'abcdeghiklmnopqrstuvwxyz1234567890qwertyuioddd', -1), kwargs = {} 2023-09-13T02:13:29.997 INFO:tasks.workunit.client.0.smithi104.stdout:excName = 'DiskQuotaExceeded' 2023-09-13T02:13:29.997 INFO:tasks.workunit.client.0.smithi104.stdout: 2023-09-13T02:13:29.997 INFO:tasks.workunit.client.0.smithi104.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2023-09-13T02:13:29.997 INFO:tasks.workunit.client.0.smithi104.stdout: """ 2023-09-13T02:13:29.998 INFO:tasks.workunit.client.0.smithi104.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2023-09-13T02:13:29.998 INFO:tasks.workunit.client.0.smithi104.stdout: """ 2023-09-13T02:13:29.998 INFO:tasks.workunit.client.0.smithi104.stdout: try: 2023-09-13T02:13:29.998 INFO:tasks.workunit.client.0.smithi104.stdout: callableObj(*args, **kwargs) 2023-09-13T02:13:29.998 INFO:tasks.workunit.client.0.smithi104.stdout: except excClass as e: 2023-09-13T02:13:29.999 INFO:tasks.workunit.client.0.smithi104.stdout: return e 2023-09-13T02:13:29.999 INFO:tasks.workunit.client.0.smithi104.stdout: else: 2023-09-13T02:13:29.999 INFO:tasks.workunit.client.0.smithi104.stdout: if hasattr(excClass, '__name__'): 2023-09-13T02:13:29.999 INFO:tasks.workunit.client.0.smithi104.stdout: excName = excClass.__name__ 2023-09-13T02:13:29.999 INFO:tasks.workunit.client.0.smithi104.stdout: else: 2023-09-13T02:13:30.000 INFO:tasks.workunit.client.0.smithi104.stdout: excName = str(excClass) 2023-09-13T02:13:30.000 INFO:tasks.workunit.client.0.smithi104.stdout:> raise AssertionError("%s not raised" % excName) 2023-09-13T02:13:30.000 INFO:tasks.workunit.client.0.smithi104.stdout:E AssertionError: DiskQuotaExceeded not raised 2023-09-13T02:13:30.000 INFO:tasks.workunit.client.0.smithi104.stdout: 2023-09-13T02:13:30.000 INFO:tasks.workunit.client.0.smithi104.stdout:../../../clone.client.0/src/test/pybind/assertions.py:26: AssertionError 2023-09-13T02:13:30.001 INFO:tasks.workunit.client.0.smithi104.stdout:---------------------------- Captured stdout setup ----------------------------- 2023-09-13T02:13:30.001 INFO:tasks.workunit.client.0.smithi104.stdout:b'Purge /' 2023-09-13T02:13:30.001 INFO:tasks.workunit.client.0.smithi104.stdout:ret_buf=b'' 2023-09-13T02:13:30.001 INFO:tasks.workunit.client.0.smithi104.stdout:=========================== short test summary info ============================ 2023-09-13T02:13:30.001 INFO:tasks.workunit.client.0.smithi104.stdout:FAILED ../../../clone.client.0/src/test/pybind/test_cephfs.py::test_disk_quota_exceeeded_error 2023-09-13T02:13:30.002 INFO:tasks.workunit.client.0.smithi104.stdout:======================== 1 failed, 53 passed in 12.50s ========================= 2023-09-13T02:13:30.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T02:13:30.023 INFO:tasks.workunit:Stopping ['fs/test_python.sh'] on client.0... 2023-09-13T02:13:30.023 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-09-13T02:13:30.265 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_batrick_ceph_3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_batrick_ceph_3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/test_python.sh) on smithi104 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh' 2023-09-13T02:13:30.340 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=106d2fffd2954685970ea7f3aa01363b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_batrick_ceph_3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_batrick_ceph_3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/test_python.sh) on smithi104 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh' 2023-09-13T02:13:30.343 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-13T02:13:30.353 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-13T02:13:30.353 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T02:13:30.460 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.459+0000 7f86d289b640 1 -- 172.21.15.104:0/3745397530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86cc06fd20 msgr2=0x7f86cc145600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:30.460 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.459+0000 7f86d289b640 1 --2- 172.21.15.104:0/3745397530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86cc06fd20 0x7f86cc145600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0b5530 tx=0x7f86c402c250 comp rx=0 tx=0).stop 2023-09-13T02:13:30.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.459+0000 7f86d289b640 1 -- 172.21.15.104:0/3745397530 shutdown_connections 2023-09-13T02:13:30.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.459+0000 7f86d289b640 1 --2- 172.21.15.104:0/3745397530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86cc06fd20 0x7f86cc145600 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:30.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.459+0000 7f86d289b640 1 --2- 172.21.15.104:0/3745397530 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86cc0b1b40 0x7f86cc06f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:30.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.459+0000 7f86d289b640 1 --2- 172.21.15.104:0/3745397530 >> v2:172.21.15.119:3300/0 conn(0x7f86cc0b1330 0x7f86cc070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:30.462 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.459+0000 7f86d289b640 1 -- 172.21.15.104:0/3745397530 >> 172.21.15.104:0/3745397530 conn(0x7f86cc069b30 msgr2=0x7f86cc0b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:30.462 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.459+0000 7f86d289b640 1 -- 172.21.15.104:0/3745397530 shutdown_connections 2023-09-13T02:13:30.462 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.459+0000 7f86d289b640 1 -- 172.21.15.104:0/3745397530 wait complete. 2023-09-13T02:13:30.463 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.460+0000 7f86d289b640 1 Processor -- start 2023-09-13T02:13:30.463 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.460+0000 7f86d289b640 1 -- start start 2023-09-13T02:13:30.466 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86d289b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86cc06fd20 0x7f86cc1450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:30.466 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86d289b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86cc0b1330 0x7f86cc139eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:30.466 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86d289b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86cc0b1b40 0x7f86cc1db170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:30.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86d289b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc13a3f0 con 0x7f86cc06fd20 2023-09-13T02:13:30.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86d289b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc1db6b0 con 0x7f86cc0b1330 2023-09-13T02:13:30.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86d289b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc13fa30 con 0x7f86cc0b1b40 2023-09-13T02:13:30.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86cbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86cc06fd20 0x7f86cc1450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:30.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86cbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86cc06fd20 0x7f86cc1450b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49170/0 (socket says 172.21.15.104:49170) 2023-09-13T02:13:30.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86cbfff640 1 -- 172.21.15.104:0/723418022 learned_addr learned my addr 172.21.15.104:0/723418022 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:30.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86d0e38640 1 --2- 172.21.15.104:0/723418022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86cc0b1b40 0x7f86cc1db170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:30.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86cbfff640 1 -- 172.21.15.104:0/723418022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86cc0b1b40 msgr2=0x7f86cc1db170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:30.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86cbfff640 1 --2- 172.21.15.104:0/723418022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86cc0b1b40 0x7f86cc1db170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:30.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86cbfff640 1 -- 172.21.15.104:0/723418022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86cc0b1330 msgr2=0x7f86cc139eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:30.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86cb7fe640 1 --2- 172.21.15.104:0/723418022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86cc0b1330 0x7f86cc139eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:30.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86cbfff640 1 --2- 172.21.15.104:0/723418022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86cc0b1330 0x7f86cc139eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:30.470 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86cbfff640 1 -- 172.21.15.104:0/723418022 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c4009900 con 0x7f86cc06fd20 2023-09-13T02:13:30.470 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86cbfff640 1 --2- 172.21.15.104:0/723418022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86cc06fd20 0x7f86cc1450b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00c940 tx=0x7f86bc00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:30.470 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86c8ff9640 1 -- 172.21.15.104:0/723418022 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc007bb0 con 0x7f86cc06fd20 2023-09-13T02:13:30.471 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86c8ff9640 1 -- 172.21.15.104:0/723418022 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f86bc007e00 con 0x7f86cc06fd20 2023-09-13T02:13:30.471 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86d289b640 1 -- 172.21.15.104:0/723418022 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86cc143b90 con 0x7f86cc06fd20 2023-09-13T02:13:30.471 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86c8ff9640 1 -- 172.21.15.104:0/723418022 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc005280 con 0x7f86cc06fd20 2023-09-13T02:13:30.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.461+0000 7f86d289b640 1 -- 172.21.15.104:0/723418022 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86cc144150 con 0x7f86cc06fd20 2023-09-13T02:13:30.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.462+0000 7f86d289b640 1 -- 172.21.15.104:0/723418022 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86cc1439f0 con 0x7f86cc06fd20 2023-09-13T02:13:30.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.463+0000 7f86c8ff9640 1 -- 172.21.15.104:0/723418022 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f86bc0054a0 con 0x7f86cc06fd20 2023-09-13T02:13:30.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.463+0000 7f86c8ff9640 1 --2- 172.21.15.104:0/723418022 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f86b806a4f0 0x7f86b806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:30.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.463+0000 7f86cb7fe640 1 --2- 172.21.15.104:0/723418022 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f86b806a4f0 0x7f86b806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:30.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.463+0000 7f86c8ff9640 1 -- 172.21.15.104:0/723418022 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f86bc0892a0 con 0x7f86cc06fd20 2023-09-13T02:13:30.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.463+0000 7f86cb7fe640 1 --2- 172.21.15.104:0/723418022 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f86b806a4f0 0x7f86b806c9b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f86c0005fd0 tx=0x7f86c0005bc0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:30.474 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.467+0000 7f86c8ff9640 1 -- 172.21.15.104:0/723418022 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f86cc1439f0 con 0x7f86cc06fd20 2023-09-13T02:13:30.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.631+0000 7f86d289b640 1 -- 172.21.15.104:0/723418022 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f86cc1439f0 con 0x7f86b806a4f0 2023-09-13T02:13:30.638 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.638+0000 7f86c8ff9640 1 -- 172.21.15.104:0/723418022 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289496 (secure 0 0 0) 0x7f86cc1439f0 con 0x7f86b806a4f0 2023-09-13T02:13:30.643 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:13:30.645 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2023-09-13T02:13:30.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.641+0000 7f86d289b640 1 -- 172.21.15.104:0/723418022 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f86b806a4f0 msgr2=0x7f86b806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:30.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.641+0000 7f86d289b640 1 --2- 172.21.15.104:0/723418022 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f86b806a4f0 0x7f86b806c9b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f86c0005fd0 tx=0x7f86c0005bc0 comp rx=0 tx=0).stop 2023-09-13T02:13:30.648 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.641+0000 7f86d289b640 1 -- 172.21.15.104:0/723418022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86cc06fd20 msgr2=0x7f86cc1450b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:30.648 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.641+0000 7f86d289b640 1 --2- 172.21.15.104:0/723418022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86cc06fd20 0x7f86cc1450b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00c940 tx=0x7f86bc00ce00 comp rx=0 tx=0).stop 2023-09-13T02:13:30.649 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.642+0000 7f86d289b640 1 -- 172.21.15.104:0/723418022 shutdown_connections 2023-09-13T02:13:30.649 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.642+0000 7f86d289b640 1 --2- 172.21.15.104:0/723418022 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f86b806a4f0 0x7f86b806c9b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:30.650 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.642+0000 7f86d289b640 1 --2- 172.21.15.104:0/723418022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86cc0b1b40 0x7f86cc1db170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:30.650 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.642+0000 7f86d289b640 1 --2- 172.21.15.104:0/723418022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86cc0b1330 0x7f86cc139eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:30.651 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.642+0000 7f86d289b640 1 --2- 172.21.15.104:0/723418022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86cc06fd20 0x7f86cc1450b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:30.651 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.642+0000 7f86d289b640 1 -- 172.21.15.104:0/723418022 >> 172.21.15.104:0/723418022 conn(0x7f86cc069b30 msgr2=0x7f86cc13c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:30.652 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.642+0000 7f86d289b640 1 -- 172.21.15.104:0/723418022 shutdown_connections 2023-09-13T02:13:30.652 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.642+0000 7f86d289b640 1 -- 172.21.15.104:0/723418022 wait complete. 2023-09-13T02:13:30.653 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-09-13T02:13:30.044754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":996237,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":125,"num_read_kb":112,"num_write":362,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1855,"ondisk_log_size":1855,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219964,"kb_used_data":3836,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754756,"statfs":{"total":773094113280,"available":772868870144,"internally_reserved":0,"allocated":3928064,"data_stored":2654493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":403459,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":12,"num_write":158,"num_write_kb":486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003269"},"pg_stats":[{"pgid":"3.3f","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.388177+0000","last_change":"2023-09-13T02:12:24.593673+0000","last_active":"2023-09-13T02:13:26.388177+0000","last_peered":"2023-09-13T02:13:26.388177+0000","last_clean":"2023-09-13T02:13:26.388177+0000","last_became_active":"2023-09-13T02:12:24.592754+0000","last_became_peered":"2023-09-13T02:12:24.592754+0000","last_unstale":"2023-09-13T02:13:26.388177+0000","last_undegraded":"2023-09-13T02:13:26.388177+0000","last_fullsized":"2023-09-13T02:13:26.388177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:43:34.341442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'12","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.373777+0000","last_change":"2023-09-13T02:12:24.580108+0000","last_active":"2023-09-13T02:13:26.373777+0000","last_peered":"2023-09-13T02:13:26.373777+0000","last_clean":"2023-09-13T02:13:26.373777+0000","last_became_active":"2023-09-13T02:12:24.579873+0000","last_became_peered":"2023-09-13T02:12:24.579873+0000","last_unstale":"2023-09-13T02:13:26.373777+0000","last_undegraded":"2023-09-13T02:13:26.373777+0000","last_fullsized":"2023-09-13T02:13:26.373777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'23","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.376076+0000","last_change":"2023-09-13T02:12:24.584533+0000","last_active":"2023-09-13T02:13:26.376076+0000","last_peered":"2023-09-13T02:13:26.376076+0000","last_clean":"2023-09-13T02:13:26.376076+0000","last_became_active":"2023-09-13T02:12:24.584249+0000","last_became_peered":"2023-09-13T02:12:24.584249+0000","last_unstale":"2023-09-13T02:13:26.376076+0000","last_undegraded":"2023-09-13T02:13:26.376076+0000","last_fullsized":"2023-09-13T02:13:26.376076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.383220+0000","last_change":"2023-09-13T02:12:24.596092+0000","last_active":"2023-09-13T02:13:26.383220+0000","last_peered":"2023-09-13T02:13:26.383220+0000","last_clean":"2023-09-13T02:13:26.383220+0000","last_became_active":"2023-09-13T02:12:24.595817+0000","last_became_peered":"2023-09-13T02:12:24.595817+0000","last_unstale":"2023-09-13T02:13:26.383220+0000","last_undegraded":"2023-09-13T02:13:26.383220+0000","last_fullsized":"2023-09-13T02:13:26.383220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:15.246952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'12","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.385312+0000","last_change":"2023-09-13T02:12:24.592410+0000","last_active":"2023-09-13T02:13:26.385312+0000","last_peered":"2023-09-13T02:13:26.385312+0000","last_clean":"2023-09-13T02:13:26.385312+0000","last_became_active":"2023-09-13T02:12:24.591503+0000","last_became_peered":"2023-09-13T02:12:24.591503+0000","last_unstale":"2023-09-13T02:13:26.385312+0000","last_undegraded":"2023-09-13T02:13:26.385312+0000","last_fullsized":"2023-09-13T02:13:26.385312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:43:26.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'18","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.380748+0000","last_change":"2023-09-13T02:13:06.365480+0000","last_active":"2023-09-13T02:13:26.380748+0000","last_peered":"2023-09-13T02:13:26.380748+0000","last_clean":"2023-09-13T02:13:26.380748+0000","last_became_active":"2023-09-13T02:13:06.365133+0000","last_became_peered":"2023-09-13T02:13:06.365133+0000","last_unstale":"2023-09-13T02:13:26.380748+0000","last_undegraded":"2023-09-13T02:13:26.380748+0000","last_fullsized":"2023-09-13T02:13:26.380748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:04:53.013012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"22'16","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.381276+0000","last_change":"2023-09-13T02:12:24.591304+0000","last_active":"2023-09-13T02:13:26.381276+0000","last_peered":"2023-09-13T02:13:26.381276+0000","last_clean":"2023-09-13T02:13:26.381276+0000","last_became_active":"2023-09-13T02:12:24.590654+0000","last_became_peered":"2023-09-13T02:12:24.590654+0000","last_unstale":"2023-09-13T02:13:26.381276+0000","last_undegraded":"2023-09-13T02:13:26.381276+0000","last_fullsized":"2023-09-13T02:13:26.381276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:15.246952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'27","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382837+0000","last_change":"2023-09-13T02:12:24.588844+0000","last_active":"2023-09-13T02:13:26.382837+0000","last_peered":"2023-09-13T02:13:26.382837+0000","last_clean":"2023-09-13T02:13:26.382837+0000","last_became_active":"2023-09-13T02:12:24.588438+0000","last_became_peered":"2023-09-13T02:12:24.588438+0000","last_unstale":"2023-09-13T02:13:26.382837+0000","last_undegraded":"2023-09-13T02:13:26.382837+0000","last_fullsized":"2023-09-13T02:13:26.382837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:37.796406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'33","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393395+0000","last_change":"2023-09-13T02:12:24.589946+0000","last_active":"2023-09-13T02:13:26.393395+0000","last_peered":"2023-09-13T02:13:26.393395+0000","last_clean":"2023-09-13T02:13:26.393395+0000","last_became_active":"2023-09-13T02:12:24.589606+0000","last_became_peered":"2023-09-13T02:12:24.589606+0000","last_unstale":"2023-09-13T02:13:26.393395+0000","last_undegraded":"2023-09-13T02:13:26.393395+0000","last_fullsized":"2023-09-13T02:13:26.393395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:41.609166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.385472+0000","last_change":"2023-09-13T02:12:24.588874+0000","last_active":"2023-09-13T02:13:26.385472+0000","last_peered":"2023-09-13T02:13:26.385472+0000","last_clean":"2023-09-13T02:13:26.385472+0000","last_became_active":"2023-09-13T02:12:24.588522+0000","last_became_peered":"2023-09-13T02:12:24.588522+0000","last_unstale":"2023-09-13T02:13:26.385472+0000","last_undegraded":"2023-09-13T02:13:26.385472+0000","last_fullsized":"2023-09-13T02:13:26.385472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'18","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.384182+0000","last_change":"2023-09-13T02:12:24.589173+0000","last_active":"2023-09-13T02:13:26.384182+0000","last_peered":"2023-09-13T02:13:26.384182+0000","last_clean":"2023-09-13T02:13:26.384182+0000","last_became_active":"2023-09-13T02:12:24.588891+0000","last_became_peered":"2023-09-13T02:12:24.588891+0000","last_unstale":"2023-09-13T02:13:26.384182+0000","last_undegraded":"2023-09-13T02:13:26.384182+0000","last_fullsized":"2023-09-13T02:13:26.384182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'21","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378152+0000","last_change":"2023-09-13T02:12:24.587494+0000","last_active":"2023-09-13T02:13:26.378152+0000","last_peered":"2023-09-13T02:13:26.378152+0000","last_clean":"2023-09-13T02:13:26.378152+0000","last_became_active":"2023-09-13T02:12:24.587023+0000","last_became_peered":"2023-09-13T02:12:24.587023+0000","last_unstale":"2023-09-13T02:13:26.378152+0000","last_undegraded":"2023-09-13T02:13:26.378152+0000","last_fullsized":"2023-09-13T02:13:26.378152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:41.175280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378034+0000","last_change":"2023-09-13T02:12:24.588000+0000","last_active":"2023-09-13T02:13:26.378034+0000","last_peered":"2023-09-13T02:13:26.378034+0000","last_clean":"2023-09-13T02:13:26.378034+0000","last_became_active":"2023-09-13T02:12:24.587730+0000","last_became_peered":"2023-09-13T02:12:24.587730+0000","last_unstale":"2023-09-13T02:13:26.378034+0000","last_undegraded":"2023-09-13T02:13:26.378034+0000","last_fullsized":"2023-09-13T02:13:26.378034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'23","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.373720+0000","last_change":"2023-09-13T02:12:24.584985+0000","last_active":"2023-09-13T02:13:26.373720+0000","last_peered":"2023-09-13T02:13:26.373720+0000","last_clean":"2023-09-13T02:13:26.373720+0000","last_became_active":"2023-09-13T02:12:24.584734+0000","last_became_peered":"2023-09-13T02:12:24.584734+0000","last_unstale":"2023-09-13T02:13:26.373720+0000","last_undegraded":"2023-09-13T02:13:26.373720+0000","last_fullsized":"2023-09-13T02:13:26.373720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:37.796406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'23","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378365+0000","last_change":"2023-09-13T02:12:24.578832+0000","last_active":"2023-09-13T02:13:26.378365+0000","last_peered":"2023-09-13T02:13:26.378365+0000","last_clean":"2023-09-13T02:13:26.378365+0000","last_became_active":"2023-09-13T02:12:24.578553+0000","last_became_peered":"2023-09-13T02:12:24.578553+0000","last_unstale":"2023-09-13T02:13:26.378365+0000","last_undegraded":"2023-09-13T02:13:26.378365+0000","last_fullsized":"2023-09-13T02:13:26.378365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.381433+0000","last_change":"2023-09-13T02:12:24.591151+0000","last_active":"2023-09-13T02:13:26.381433+0000","last_peered":"2023-09-13T02:13:26.381433+0000","last_clean":"2023-09-13T02:13:26.381433+0000","last_became_active":"2023-09-13T02:12:24.590871+0000","last_became_peered":"2023-09-13T02:12:24.590871+0000","last_unstale":"2023-09-13T02:13:26.381433+0000","last_undegraded":"2023-09-13T02:13:26.381433+0000","last_fullsized":"2023-09-13T02:13:26.381433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.388169+0000","last_change":"2023-09-13T02:12:24.592615+0000","last_active":"2023-09-13T02:13:26.388169+0000","last_peered":"2023-09-13T02:13:26.388169+0000","last_clean":"2023-09-13T02:13:26.388169+0000","last_became_active":"2023-09-13T02:12:24.592325+0000","last_became_peered":"2023-09-13T02:12:24.592325+0000","last_unstale":"2023-09-13T02:13:26.388169+0000","last_undegraded":"2023-09-13T02:13:26.388169+0000","last_fullsized":"2023-09-13T02:13:26.388169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:19:41.872878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'33","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.888218+0000","last_change":"2023-09-13T02:12:24.587859+0000","last_active":"2023-09-13T02:13:26.888218+0000","last_peered":"2023-09-13T02:13:26.888218+0000","last_clean":"2023-09-13T02:13:26.888218+0000","last_became_active":"2023-09-13T02:12:24.587552+0000","last_became_peered":"2023-09-13T02:12:24.587552+0000","last_unstale":"2023-09-13T02:13:26.888218+0000","last_undegraded":"2023-09-13T02:13:26.888218+0000","last_fullsized":"2023-09-13T02:13:26.888218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:39.029452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'23","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.387469+0000","last_change":"2023-09-13T02:12:24.591593+0000","last_active":"2023-09-13T02:13:26.387469+0000","last_peered":"2023-09-13T02:13:26.387469+0000","last_clean":"2023-09-13T02:13:26.387469+0000","last_became_active":"2023-09-13T02:12:24.590670+0000","last_became_peered":"2023-09-13T02:12:24.590670+0000","last_unstale":"2023-09-13T02:13:26.387469+0000","last_undegraded":"2023-09-13T02:13:26.387469+0000","last_fullsized":"2023-09-13T02:13:26.387469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:19:41.872878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'25","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378361+0000","last_change":"2023-09-13T02:12:24.593278+0000","last_active":"2023-09-13T02:13:26.378361+0000","last_peered":"2023-09-13T02:13:26.378361+0000","last_clean":"2023-09-13T02:13:26.378361+0000","last_became_active":"2023-09-13T02:12:24.591065+0000","last_became_peered":"2023-09-13T02:12:24.591065+0000","last_unstale":"2023-09-13T02:13:26.378361+0000","last_undegraded":"2023-09-13T02:13:26.378361+0000","last_fullsized":"2023-09-13T02:13:26.378361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'36","reported_seq":49,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378658+0000","last_change":"2023-09-13T02:12:24.587352+0000","last_active":"2023-09-13T02:13:26.378658+0000","last_peered":"2023-09-13T02:13:26.378658+0000","last_clean":"2023-09-13T02:13:26.378658+0000","last_became_active":"2023-09-13T02:12:24.586981+0000","last_became_peered":"2023-09-13T02:12:24.586981+0000","last_unstale":"2023-09-13T02:13:26.378658+0000","last_undegraded":"2023-09-13T02:13:26.378658+0000","last_fullsized":"2023-09-13T02:13:26.378658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.388258+0000","last_change":"2023-09-13T02:12:24.595423+0000","last_active":"2023-09-13T02:13:26.388258+0000","last_peered":"2023-09-13T02:13:26.388258+0000","last_clean":"2023-09-13T02:13:26.388258+0000","last_became_active":"2023-09-13T02:12:24.594351+0000","last_became_peered":"2023-09-13T02:12:24.594351+0000","last_unstale":"2023-09-13T02:13:26.388258+0000","last_undegraded":"2023-09-13T02:13:26.388258+0000","last_fullsized":"2023-09-13T02:13:26.388258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:18.256464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.379446+0000","last_change":"2023-09-13T02:12:24.590553+0000","last_active":"2023-09-13T02:13:26.379446+0000","last_peered":"2023-09-13T02:13:26.379446+0000","last_clean":"2023-09-13T02:13:26.379446+0000","last_became_active":"2023-09-13T02:12:24.590295+0000","last_became_peered":"2023-09-13T02:12:24.590295+0000","last_unstale":"2023-09-13T02:13:26.379446+0000","last_undegraded":"2023-09-13T02:13:26.379446+0000","last_fullsized":"2023-09-13T02:13:26.379446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.380900+0000","last_change":"2023-09-13T02:12:24.593925+0000","last_active":"2023-09-13T02:13:26.380900+0000","last_peered":"2023-09-13T02:13:26.380900+0000","last_clean":"2023-09-13T02:13:26.380900+0000","last_became_active":"2023-09-13T02:12:24.593673+0000","last_became_peered":"2023-09-13T02:12:24.593673+0000","last_unstale":"2023-09-13T02:13:26.380900+0000","last_undegraded":"2023-09-13T02:13:26.380900+0000","last_fullsized":"2023-09-13T02:13:26.380900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'8","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.888016+0000","last_change":"2023-09-13T02:12:24.590496+0000","last_active":"2023-09-13T02:13:26.888016+0000","last_peered":"2023-09-13T02:13:26.888016+0000","last_clean":"2023-09-13T02:13:26.888016+0000","last_became_active":"2023-09-13T02:12:24.590231+0000","last_became_peered":"2023-09-13T02:12:24.590231+0000","last_unstale":"2023-09-13T02:13:26.888016+0000","last_undegraded":"2023-09-13T02:13:26.888016+0000","last_fullsized":"2023-09-13T02:13:26.888016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'46","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.377698+0000","last_change":"2023-09-13T02:13:05.916706+0000","last_active":"2023-09-13T02:13:26.377698+0000","last_peered":"2023-09-13T02:13:26.377698+0000","last_clean":"2023-09-13T02:13:26.377698+0000","last_became_active":"2023-09-13T02:13:05.916435+0000","last_became_peered":"2023-09-13T02:13:05.916435+0000","last_unstale":"2023-09-13T02:13:26.377698+0000","last_undegraded":"2023-09-13T02:13:26.377698+0000","last_fullsized":"2023-09-13T02:13:26.377698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:39:21.058634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'18","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.377483+0000","last_change":"2023-09-13T02:12:24.584028+0000","last_active":"2023-09-13T02:13:26.377483+0000","last_peered":"2023-09-13T02:13:26.377483+0000","last_clean":"2023-09-13T02:13:26.377483+0000","last_became_active":"2023-09-13T02:12:24.583782+0000","last_became_peered":"2023-09-13T02:12:24.583782+0000","last_unstale":"2023-09-13T02:13:26.377483+0000","last_undegraded":"2023-09-13T02:13:26.377483+0000","last_fullsized":"2023-09-13T02:13:26.377483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'12","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.379349+0000","last_change":"2023-09-13T02:12:24.590548+0000","last_active":"2023-09-13T02:13:26.379349+0000","last_peered":"2023-09-13T02:13:26.379349+0000","last_clean":"2023-09-13T02:13:26.379349+0000","last_became_active":"2023-09-13T02:12:24.590189+0000","last_became_peered":"2023-09-13T02:12:24.590189+0000","last_unstale":"2023-09-13T02:13:26.379349+0000","last_undegraded":"2023-09-13T02:13:26.379349+0000","last_fullsized":"2023-09-13T02:13:26.379349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'21","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.376706+0000","last_change":"2023-09-13T02:12:24.583749+0000","last_active":"2023-09-13T02:13:26.376706+0000","last_peered":"2023-09-13T02:13:26.376706+0000","last_clean":"2023-09-13T02:13:26.376706+0000","last_became_active":"2023-09-13T02:12:24.583453+0000","last_became_peered":"2023-09-13T02:12:24.583453+0000","last_unstale":"2023-09-13T02:13:26.376706+0000","last_undegraded":"2023-09-13T02:13:26.376706+0000","last_fullsized":"2023-09-13T02:13:26.376706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.379356+0000","last_change":"2023-09-13T02:12:24.595007+0000","last_active":"2023-09-13T02:13:26.379356+0000","last_peered":"2023-09-13T02:13:26.379356+0000","last_clean":"2023-09-13T02:13:26.379356+0000","last_became_active":"2023-09-13T02:12:24.592875+0000","last_became_peered":"2023-09-13T02:12:24.592875+0000","last_unstale":"2023-09-13T02:13:26.379356+0000","last_undegraded":"2023-09-13T02:13:26.379356+0000","last_fullsized":"2023-09-13T02:13:26.379356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'36","reported_seq":49,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378778+0000","last_change":"2023-09-13T02:12:24.588586+0000","last_active":"2023-09-13T02:13:26.378778+0000","last_peered":"2023-09-13T02:13:26.378778+0000","last_clean":"2023-09-13T02:13:26.378778+0000","last_became_active":"2023-09-13T02:12:24.588173+0000","last_became_peered":"2023-09-13T02:12:24.588173+0000","last_unstale":"2023-09-13T02:13:26.378778+0000","last_undegraded":"2023-09-13T02:13:26.378778+0000","last_fullsized":"2023-09-13T02:13:26.378778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:50.824236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'27","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.383062+0000","last_change":"2023-09-13T02:12:24.590981+0000","last_active":"2023-09-13T02:13:26.383062+0000","last_peered":"2023-09-13T02:13:26.383062+0000","last_clean":"2023-09-13T02:13:26.383062+0000","last_became_active":"2023-09-13T02:12:24.590677+0000","last_became_peered":"2023-09-13T02:12:24.590677+0000","last_unstale":"2023-09-13T02:13:26.383062+0000","last_undegraded":"2023-09-13T02:13:26.383062+0000","last_fullsized":"2023-09-13T02:13:26.383062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'22","reported_seq":35,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.370221+0000","last_change":"2023-09-13T02:12:24.586738+0000","last_active":"2023-09-13T02:13:26.370221+0000","last_peered":"2023-09-13T02:13:26.370221+0000","last_clean":"2023-09-13T02:13:26.370221+0000","last_became_active":"2023-09-13T02:12:24.586251+0000","last_became_peered":"2023-09-13T02:12:24.586251+0000","last_unstale":"2023-09-13T02:13:26.370221+0000","last_undegraded":"2023-09-13T02:13:26.370221+0000","last_fullsized":"2023-09-13T02:13:26.370221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:25.830036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.914084+0000","last_change":"2023-09-13T02:12:23.579164+0000","last_active":"2023-09-13T02:13:05.914084+0000","last_peered":"2023-09-13T02:13:05.914084+0000","last_clean":"2023-09-13T02:13:05.914084+0000","last_became_active":"2023-09-13T02:12:23.578889+0000","last_became_peered":"2023-09-13T02:12:23.578889+0000","last_unstale":"2023-09-13T02:13:05.914084+0000","last_undegraded":"2023-09-13T02:13:05.914084+0000","last_fullsized":"2023-09-13T02:13:05.914084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.376150+0000","last_change":"2023-09-13T02:12:24.579559+0000","last_active":"2023-09-13T02:13:26.376150+0000","last_peered":"2023-09-13T02:13:26.376150+0000","last_clean":"2023-09-13T02:13:26.376150+0000","last_became_active":"2023-09-13T02:12:24.579243+0000","last_became_peered":"2023-09-13T02:12:24.579243+0000","last_unstale":"2023-09-13T02:13:26.376150+0000","last_undegraded":"2023-09-13T02:13:26.376150+0000","last_fullsized":"2023-09-13T02:13:26.376150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.364759+0000","last_change":"2023-09-13T02:12:23.577022+0000","last_active":"2023-09-13T02:13:05.364759+0000","last_peered":"2023-09-13T02:13:05.364759+0000","last_clean":"2023-09-13T02:13:05.364759+0000","last_became_active":"2023-09-13T02:12:23.576754+0000","last_became_peered":"2023-09-13T02:12:23.576754+0000","last_unstale":"2023-09-13T02:13:05.364759+0000","last_undegraded":"2023-09-13T02:13:05.364759+0000","last_fullsized":"2023-09-13T02:13:05.364759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:49.820358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:17.908498+0000","last_change":"2023-09-13T02:12:23.579634+0000","last_active":"2023-09-13T02:13:17.908498+0000","last_peered":"2023-09-13T02:13:17.908498+0000","last_clean":"2023-09-13T02:13:17.908498+0000","last_became_active":"2023-09-13T02:12:23.579351+0000","last_became_peered":"2023-09-13T02:12:23.579351+0000","last_unstale":"2023-09-13T02:13:17.908498+0000","last_undegraded":"2023-09-13T02:13:17.908498+0000","last_fullsized":"2023-09-13T02:13:17.908498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:24.826159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.379347+0000","last_change":"2023-09-13T02:12:24.590474+0000","last_active":"2023-09-13T02:13:26.379347+0000","last_peered":"2023-09-13T02:13:26.379347+0000","last_clean":"2023-09-13T02:13:26.379347+0000","last_became_active":"2023-09-13T02:12:24.590126+0000","last_became_peered":"2023-09-13T02:12:24.590126+0000","last_unstale":"2023-09-13T02:13:26.379347+0000","last_undegraded":"2023-09-13T02:13:26.379347+0000","last_fullsized":"2023-09-13T02:13:26.379347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.903735+0000","last_change":"2023-09-13T02:12:23.586264+0000","last_active":"2023-09-13T02:13:04.903735+0000","last_peered":"2023-09-13T02:13:04.903735+0000","last_clean":"2023-09-13T02:13:04.903735+0000","last_became_active":"2023-09-13T02:12:23.585953+0000","last_became_peered":"2023-09-13T02:12:23.585953+0000","last_unstale":"2023-09-13T02:13:04.903735+0000","last_undegraded":"2023-09-13T02:13:04.903735+0000","last_fullsized":"2023-09-13T02:13:04.903735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:27.359818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378167+0000","last_change":"2023-09-13T02:12:24.585138+0000","last_active":"2023-09-13T02:13:26.378167+0000","last_peered":"2023-09-13T02:13:26.378167+0000","last_clean":"2023-09-13T02:13:26.378167+0000","last_became_active":"2023-09-13T02:12:24.584901+0000","last_became_peered":"2023-09-13T02:12:24.584901+0000","last_unstale":"2023-09-13T02:13:26.378167+0000","last_undegraded":"2023-09-13T02:13:26.378167+0000","last_fullsized":"2023-09-13T02:13:26.378167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.912367+0000","last_change":"2023-09-13T02:12:23.583663+0000","last_active":"2023-09-13T02:13:05.912367+0000","last_peered":"2023-09-13T02:13:05.912367+0000","last_clean":"2023-09-13T02:13:05.912367+0000","last_became_active":"2023-09-13T02:12:23.583305+0000","last_became_peered":"2023-09-13T02:12:23.583305+0000","last_unstale":"2023-09-13T02:13:05.912367+0000","last_undegraded":"2023-09-13T02:13:05.912367+0000","last_fullsized":"2023-09-13T02:13:05.912367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:32.660244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.388445+0000","last_change":"2023-09-13T02:12:24.595264+0000","last_active":"2023-09-13T02:13:26.388445+0000","last_peered":"2023-09-13T02:13:26.388445+0000","last_clean":"2023-09-13T02:13:26.388445+0000","last_became_active":"2023-09-13T02:12:24.594434+0000","last_became_peered":"2023-09-13T02:12:24.594434+0000","last_unstale":"2023-09-13T02:13:26.388445+0000","last_undegraded":"2023-09-13T02:13:26.388445+0000","last_fullsized":"2023-09-13T02:13:26.388445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:17:30.897344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.042686+0000","last_change":"2023-09-13T02:12:23.584935+0000","last_active":"2023-09-13T02:13:06.042686+0000","last_peered":"2023-09-13T02:13:06.042686+0000","last_clean":"2023-09-13T02:13:06.042686+0000","last_became_active":"2023-09-13T02:12:23.584657+0000","last_became_peered":"2023-09-13T02:12:23.584657+0000","last_unstale":"2023-09-13T02:13:06.042686+0000","last_undegraded":"2023-09-13T02:13:06.042686+0000","last_fullsized":"2023-09-13T02:13:06.042686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:36.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'28","reported_seq":41,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.369701+0000","last_change":"2023-09-13T02:12:24.588694+0000","last_active":"2023-09-13T02:13:26.369701+0000","last_peered":"2023-09-13T02:13:26.369701+0000","last_clean":"2023-09-13T02:13:26.369701+0000","last_became_active":"2023-09-13T02:12:24.588455+0000","last_became_peered":"2023-09-13T02:12:24.588455+0000","last_unstale":"2023-09-13T02:13:26.369701+0000","last_undegraded":"2023-09-13T02:13:26.369701+0000","last_fullsized":"2023-09-13T02:13:26.369701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'10","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:25.893290+0000","last_change":"2023-09-13T02:12:23.582781+0000","last_active":"2023-09-13T02:13:25.893290+0000","last_peered":"2023-09-13T02:13:25.893290+0000","last_clean":"2023-09-13T02:13:25.893290+0000","last_became_active":"2023-09-13T02:12:23.582506+0000","last_became_peered":"2023-09-13T02:12:23.582506+0000","last_unstale":"2023-09-13T02:13:25.893290+0000","last_undegraded":"2023-09-13T02:13:25.893290+0000","last_fullsized":"2023-09-13T02:13:25.893290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:03.890491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'37","reported_seq":50,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.391591+0000","last_change":"2023-09-13T02:12:24.594514+0000","last_active":"2023-09-13T02:13:26.391591+0000","last_peered":"2023-09-13T02:13:26.391591+0000","last_clean":"2023-09-13T02:13:26.391591+0000","last_became_active":"2023-09-13T02:12:24.592367+0000","last_became_peered":"2023-09-13T02:12:24.592367+0000","last_unstale":"2023-09-13T02:13:26.391591+0000","last_undegraded":"2023-09-13T02:13:26.391591+0000","last_fullsized":"2023-09-13T02:13:26.391591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:08.045218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'101","reported_seq":115,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.395152+0000","last_change":"2023-09-13T02:12:23.579000+0000","last_active":"2023-09-13T02:13:26.395152+0000","last_peered":"2023-09-13T02:13:26.395152+0000","last_clean":"2023-09-13T02:13:26.395152+0000","last_became_active":"2023-09-13T02:12:23.578748+0000","last_became_peered":"2023-09-13T02:12:23.578748+0000","last_unstale":"2023-09-13T02:13:26.395152+0000","last_undegraded":"2023-09-13T02:13:26.395152+0000","last_fullsized":"2023-09-13T02:13:26.395152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:38.025574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400311,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'20","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.381851+0000","last_change":"2023-09-13T02:12:24.593514+0000","last_active":"2023-09-13T02:13:26.381851+0000","last_peered":"2023-09-13T02:13:26.381851+0000","last_clean":"2023-09-13T02:13:26.381851+0000","last_became_active":"2023-09-13T02:12:24.593092+0000","last_became_peered":"2023-09-13T02:12:24.593092+0000","last_unstale":"2023-09-13T02:13:26.381851+0000","last_undegraded":"2023-09-13T02:13:26.381851+0000","last_fullsized":"2023-09-13T02:13:26.381851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:18:08.378805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364390+0000","last_change":"2023-09-13T02:12:23.579348+0000","last_active":"2023-09-13T02:13:06.364390+0000","last_peered":"2023-09-13T02:13:06.364390+0000","last_clean":"2023-09-13T02:13:06.364390+0000","last_became_active":"2023-09-13T02:12:23.579079+0000","last_became_peered":"2023-09-13T02:12:23.579079+0000","last_unstale":"2023-09-13T02:13:06.364390+0000","last_undegraded":"2023-09-13T02:13:06.364390+0000","last_fullsized":"2023-09-13T02:13:06.364390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:07.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'35","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378378+0000","last_change":"2023-09-13T02:12:24.587235+0000","last_active":"2023-09-13T02:13:26.378378+0000","last_peered":"2023-09-13T02:13:26.378378+0000","last_clean":"2023-09-13T02:13:26.378378+0000","last_became_active":"2023-09-13T02:12:24.586930+0000","last_became_peered":"2023-09-13T02:12:24.586930+0000","last_unstale":"2023-09-13T02:13:26.378378+0000","last_undegraded":"2023-09-13T02:13:26.378378+0000","last_fullsized":"2023-09-13T02:13:26.378378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.904408+0000","last_change":"2023-09-13T02:12:23.585680+0000","last_active":"2023-09-13T02:13:04.904408+0000","last_peered":"2023-09-13T02:13:04.904408+0000","last_clean":"2023-09-13T02:13:04.904408+0000","last_became_active":"2023-09-13T02:12:23.585417+0000","last_became_peered":"2023-09-13T02:12:23.585417+0000","last_unstale":"2023-09-13T02:13:04.904408+0000","last_undegraded":"2023-09-13T02:13:04.904408+0000","last_fullsized":"2023-09-13T02:13:04.904408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:03.890491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'46","reported_seq":59,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393959+0000","last_change":"2023-09-13T02:12:24.592703+0000","last_active":"2023-09-13T02:13:26.393959+0000","last_peered":"2023-09-13T02:13:26.393959+0000","last_clean":"2023-09-13T02:13:26.393959+0000","last_became_active":"2023-09-13T02:12:24.591849+0000","last_became_peered":"2023-09-13T02:12:24.591849+0000","last_unstale":"2023-09-13T02:13:26.393959+0000","last_undegraded":"2023-09-13T02:13:26.393959+0000","last_fullsized":"2023-09-13T02:13:26.393959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:17:30.897344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.363813+0000","last_change":"2023-09-13T02:12:23.576659+0000","last_active":"2023-09-13T02:13:05.363813+0000","last_peered":"2023-09-13T02:13:05.363813+0000","last_clean":"2023-09-13T02:13:05.363813+0000","last_became_active":"2023-09-13T02:12:23.576022+0000","last_became_peered":"2023-09-13T02:12:23.576022+0000","last_unstale":"2023-09-13T02:13:05.363813+0000","last_undegraded":"2023-09-13T02:13:05.363813+0000","last_fullsized":"2023-09-13T02:13:05.363813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:51.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'18","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382451+0000","last_change":"2023-09-13T02:12:24.591552+0000","last_active":"2023-09-13T02:13:26.382451+0000","last_peered":"2023-09-13T02:13:26.382451+0000","last_clean":"2023-09-13T02:13:26.382451+0000","last_became_active":"2023-09-13T02:12:24.591247+0000","last_became_peered":"2023-09-13T02:12:24.591247+0000","last_unstale":"2023-09-13T02:13:26.382451+0000","last_undegraded":"2023-09-13T02:13:26.382451+0000","last_fullsized":"2023-09-13T02:13:26.382451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'9","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.910464+0000","last_change":"2023-09-13T02:12:23.570753+0000","last_active":"2023-09-13T02:13:05.910464+0000","last_peered":"2023-09-13T02:13:05.910464+0000","last_clean":"2023-09-13T02:13:05.910464+0000","last_became_active":"2023-09-13T02:12:23.570461+0000","last_became_peered":"2023-09-13T02:12:23.570461+0000","last_unstale":"2023-09-13T02:13:05.910464+0000","last_undegraded":"2023-09-13T02:13:05.910464+0000","last_fullsized":"2023-09-13T02:13:05.910464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'18","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393593+0000","last_change":"2023-09-13T02:12:24.591474+0000","last_active":"2023-09-13T02:13:26.393593+0000","last_peered":"2023-09-13T02:13:26.393593+0000","last_clean":"2023-09-13T02:13:26.393593+0000","last_became_active":"2023-09-13T02:12:24.591036+0000","last_became_peered":"2023-09-13T02:12:24.591036+0000","last_unstale":"2023-09-13T02:13:26.393593+0000","last_undegraded":"2023-09-13T02:13:26.393593+0000","last_fullsized":"2023-09-13T02:13:26.393593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.273406+0000","last_change":"2023-09-13T02:12:23.584508+0000","last_active":"2023-09-13T02:13:05.273406+0000","last_peered":"2023-09-13T02:13:05.273406+0000","last_clean":"2023-09-13T02:13:05.273406+0000","last_became_active":"2023-09-13T02:12:23.584235+0000","last_became_peered":"2023-09-13T02:12:23.584235+0000","last_unstale":"2023-09-13T02:13:05.273406+0000","last_undegraded":"2023-09-13T02:13:05.273406+0000","last_fullsized":"2023-09-13T02:13:05.273406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'15","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393266+0000","last_change":"2023-09-13T02:12:24.593312+0000","last_active":"2023-09-13T02:13:26.393266+0000","last_peered":"2023-09-13T02:13:26.393266+0000","last_clean":"2023-09-13T02:13:26.393266+0000","last_became_active":"2023-09-13T02:12:24.592242+0000","last_became_peered":"2023-09-13T02:12:24.592242+0000","last_unstale":"2023-09-13T02:13:26.393266+0000","last_undegraded":"2023-09-13T02:13:26.393266+0000","last_fullsized":"2023-09-13T02:13:26.393266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:03:12.365120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.908624+0000","last_change":"2023-09-13T02:12:23.578204+0000","last_active":"2023-09-13T02:13:04.908624+0000","last_peered":"2023-09-13T02:13:04.908624+0000","last_clean":"2023-09-13T02:13:04.908624+0000","last_became_active":"2023-09-13T02:12:23.577918+0000","last_became_peered":"2023-09-13T02:12:23.577918+0000","last_unstale":"2023-09-13T02:13:04.908624+0000","last_undegraded":"2023-09-13T02:13:04.908624+0000","last_fullsized":"2023-09-13T02:13:04.908624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:24.826159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'27","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393646+0000","last_change":"2023-09-13T02:12:24.595748+0000","last_active":"2023-09-13T02:13:26.393646+0000","last_peered":"2023-09-13T02:13:26.393646+0000","last_clean":"2023-09-13T02:13:26.393646+0000","last_became_active":"2023-09-13T02:12:24.595462+0000","last_became_peered":"2023-09-13T02:12:24.595462+0000","last_unstale":"2023-09-13T02:13:26.393646+0000","last_undegraded":"2023-09-13T02:13:26.393646+0000","last_fullsized":"2023-09-13T02:13:26.393646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:52:10.210519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.905766+0000","last_change":"2023-09-13T02:12:23.570346+0000","last_active":"2023-09-13T02:13:04.905766+0000","last_peered":"2023-09-13T02:13:04.905766+0000","last_clean":"2023-09-13T02:13:04.905766+0000","last_became_active":"2023-09-13T02:12:23.570066+0000","last_became_peered":"2023-09-13T02:12:23.570066+0000","last_unstale":"2023-09-13T02:13:04.905766+0000","last_undegraded":"2023-09-13T02:13:04.905766+0000","last_fullsized":"2023-09-13T02:13:04.905766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:36.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'18","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382510+0000","last_change":"2023-09-13T02:12:24.595650+0000","last_active":"2023-09-13T02:13:26.382510+0000","last_peered":"2023-09-13T02:13:26.382510+0000","last_clean":"2023-09-13T02:13:26.382510+0000","last_became_active":"2023-09-13T02:12:24.595327+0000","last_became_peered":"2023-09-13T02:12:24.595327+0000","last_unstale":"2023-09-13T02:13:26.382510+0000","last_undegraded":"2023-09-13T02:13:26.382510+0000","last_fullsized":"2023-09-13T02:13:26.382510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:43:26.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.909441+0000","last_change":"2023-09-13T02:12:23.583113+0000","last_active":"2023-09-13T02:13:05.909441+0000","last_peered":"2023-09-13T02:13:05.909441+0000","last_clean":"2023-09-13T02:13:05.909441+0000","last_became_active":"2023-09-13T02:12:23.582841+0000","last_became_peered":"2023-09-13T02:12:23.582841+0000","last_unstale":"2023-09-13T02:13:05.909441+0000","last_undegraded":"2023-09-13T02:13:05.909441+0000","last_fullsized":"2023-09-13T02:13:05.909441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'22","reported_seq":35,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393154+0000","last_change":"2023-09-13T02:12:24.590616+0000","last_active":"2023-09-13T02:13:26.393154+0000","last_peered":"2023-09-13T02:13:26.393154+0000","last_clean":"2023-09-13T02:13:26.393154+0000","last_became_active":"2023-09-13T02:12:24.590343+0000","last_became_peered":"2023-09-13T02:12:24.590343+0000","last_unstale":"2023-09-13T02:13:26.393154+0000","last_undegraded":"2023-09-13T02:13:26.393154+0000","last_fullsized":"2023-09-13T02:13:26.393154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:15.126313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.363945+0000","last_change":"2023-09-13T02:12:13.261542+0000","last_active":"2023-09-13T02:13:05.363945+0000","last_peered":"2023-09-13T02:13:05.363945+0000","last_clean":"2023-09-13T02:13:05.363945+0000","last_became_active":"2023-09-13T02:12:13.260630+0000","last_became_peered":"2023-09-13T02:12:13.260630+0000","last_unstale":"2023-09-13T02:13:05.363945+0000","last_undegraded":"2023-09-13T02:13:05.363945+0000","last_fullsized":"2023-09-13T02:13:05.363945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:12.209844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:12.209844+0000","last_clean_scrub_stamp":"2023-09-13T02:12:12.209844+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:07:47.139624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.903886+0000","last_change":"2023-09-13T02:12:23.584227+0000","last_active":"2023-09-13T02:13:04.903886+0000","last_peered":"2023-09-13T02:13:04.903886+0000","last_clean":"2023-09-13T02:13:04.903886+0000","last_became_active":"2023-09-13T02:12:23.583874+0000","last_became_peered":"2023-09-13T02:12:23.583874+0000","last_unstale":"2023-09-13T02:13:04.903886+0000","last_undegraded":"2023-09-13T02:13:04.903886+0000","last_fullsized":"2023-09-13T02:13:04.903886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'24","reported_seq":44,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.373186+0000","last_change":"2023-09-13T02:13:05.919047+0000","last_active":"2023-09-13T02:13:26.373186+0000","last_peered":"2023-09-13T02:13:26.373186+0000","last_clean":"2023-09-13T02:13:26.373186+0000","last_became_active":"2023-09-13T02:13:05.918736+0000","last_became_peered":"2023-09-13T02:13:05.918736+0000","last_unstale":"2023-09-13T02:13:26.373186+0000","last_undegraded":"2023-09-13T02:13:26.373186+0000","last_fullsized":"2023-09-13T02:13:26.373186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:13:36.591729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364003+0000","last_change":"2023-09-13T02:12:23.580928+0000","last_active":"2023-09-13T02:13:06.364003+0000","last_peered":"2023-09-13T02:13:06.364003+0000","last_clean":"2023-09-13T02:13:06.364003+0000","last_became_active":"2023-09-13T02:12:23.580670+0000","last_became_peered":"2023-09-13T02:12:23.580670+0000","last_unstale":"2023-09-13T02:13:06.364003+0000","last_undegraded":"2023-09-13T02:13:06.364003+0000","last_fullsized":"2023-09-13T02:13:06.364003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'15","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.377687+0000","last_change":"2023-09-13T02:12:24.579008+0000","last_active":"2023-09-13T02:13:26.377687+0000","last_peered":"2023-09-13T02:13:26.377687+0000","last_clean":"2023-09-13T02:13:26.377687+0000","last_became_active":"2023-09-13T02:12:24.578715+0000","last_became_peered":"2023-09-13T02:12:24.578715+0000","last_unstale":"2023-09-13T02:13:26.377687+0000","last_undegraded":"2023-09-13T02:13:26.377687+0000","last_fullsized":"2023-09-13T02:13:26.377687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:04.894368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'10","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.885825+0000","last_change":"2023-09-13T02:12:23.578080+0000","last_active":"2023-09-13T02:13:26.885825+0000","last_peered":"2023-09-13T02:13:26.885825+0000","last_clean":"2023-09-13T02:13:26.885825+0000","last_became_active":"2023-09-13T02:12:23.577786+0000","last_became_peered":"2023-09-13T02:12:23.577786+0000","last_unstale":"2023-09-13T02:13:26.885825+0000","last_undegraded":"2023-09-13T02:13:26.885825+0000","last_fullsized":"2023-09-13T02:13:26.885825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:51.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4747,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":12,"num_write":9,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'26","reported_seq":39,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.376423+0000","last_change":"2023-09-13T02:12:24.582717+0000","last_active":"2023-09-13T02:13:26.376423+0000","last_peered":"2023-09-13T02:13:26.376423+0000","last_clean":"2023-09-13T02:13:26.376423+0000","last_became_active":"2023-09-13T02:12:24.582439+0000","last_became_peered":"2023-09-13T02:12:24.582439+0000","last_unstale":"2023-09-13T02:13:26.376423+0000","last_undegraded":"2023-09-13T02:13:26.376423+0000","last_fullsized":"2023-09-13T02:13:26.376423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.904406+0000","last_change":"2023-09-13T02:12:23.585601+0000","last_active":"2023-09-13T02:13:04.904406+0000","last_peered":"2023-09-13T02:13:04.904406+0000","last_clean":"2023-09-13T02:13:04.904406+0000","last_became_active":"2023-09-13T02:12:23.585349+0000","last_became_peered":"2023-09-13T02:12:23.585349+0000","last_unstale":"2023-09-13T02:13:04.904406+0000","last_undegraded":"2023-09-13T02:13:04.904406+0000","last_fullsized":"2023-09-13T02:13:04.904406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:38.820251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'21","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.366251+0000","last_change":"2023-09-13T02:12:24.586175+0000","last_active":"2023-09-13T02:13:26.366251+0000","last_peered":"2023-09-13T02:13:26.366251+0000","last_clean":"2023-09-13T02:13:26.366251+0000","last_became_active":"2023-09-13T02:12:24.585054+0000","last_became_peered":"2023-09-13T02:12:24.585054+0000","last_unstale":"2023-09-13T02:13:26.366251+0000","last_undegraded":"2023-09-13T02:13:26.366251+0000","last_fullsized":"2023-09-13T02:13:26.366251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:39.029452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.905876+0000","last_change":"2023-09-13T02:12:23.580143+0000","last_active":"2023-09-13T02:13:04.905876+0000","last_peered":"2023-09-13T02:13:04.905876+0000","last_clean":"2023-09-13T02:13:04.905876+0000","last_became_active":"2023-09-13T02:12:23.579844+0000","last_became_peered":"2023-09-13T02:12:23.579844+0000","last_unstale":"2023-09-13T02:13:04.905876+0000","last_undegraded":"2023-09-13T02:13:04.905876+0000","last_fullsized":"2023-09-13T02:13:04.905876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:21:49.468231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'20","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382294+0000","last_change":"2023-09-13T02:12:24.592756+0000","last_active":"2023-09-13T02:13:26.382294+0000","last_peered":"2023-09-13T02:13:26.382294+0000","last_clean":"2023-09-13T02:13:26.382294+0000","last_became_active":"2023-09-13T02:12:24.592436+0000","last_became_peered":"2023-09-13T02:12:24.592436+0000","last_unstale":"2023-09-13T02:13:26.382294+0000","last_undegraded":"2023-09-13T02:13:26.382294+0000","last_fullsized":"2023-09-13T02:13:26.382294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:03:12.365120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.364613+0000","last_change":"2023-09-13T02:12:23.585605+0000","last_active":"2023-09-13T02:13:05.364613+0000","last_peered":"2023-09-13T02:13:05.364613+0000","last_clean":"2023-09-13T02:13:05.364613+0000","last_became_active":"2023-09-13T02:12:23.585411+0000","last_became_peered":"2023-09-13T02:12:23.585411+0000","last_unstale":"2023-09-13T02:13:05.364613+0000","last_undegraded":"2023-09-13T02:13:05.364613+0000","last_fullsized":"2023-09-13T02:13:05.364613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:40.286050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.376926+0000","last_change":"2023-09-13T02:12:24.582796+0000","last_active":"2023-09-13T02:13:26.376926+0000","last_peered":"2023-09-13T02:13:26.376926+0000","last_clean":"2023-09-13T02:13:26.376926+0000","last_became_active":"2023-09-13T02:12:24.582517+0000","last_became_peered":"2023-09-13T02:12:24.582517+0000","last_unstale":"2023-09-13T02:13:26.376926+0000","last_undegraded":"2023-09-13T02:13:26.376926+0000","last_fullsized":"2023-09-13T02:13:26.376926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:17.890299+0000","last_change":"2023-09-13T02:12:23.576140+0000","last_active":"2023-09-13T02:13:17.890299+0000","last_peered":"2023-09-13T02:13:17.890299+0000","last_clean":"2023-09-13T02:13:17.890299+0000","last_became_active":"2023-09-13T02:12:23.575875+0000","last_became_peered":"2023-09-13T02:12:23.575875+0000","last_unstale":"2023-09-13T02:13:17.890299+0000","last_undegraded":"2023-09-13T02:13:17.890299+0000","last_fullsized":"2023-09-13T02:13:17.890299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:07.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'20","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.381927+0000","last_change":"2023-09-13T02:12:24.592556+0000","last_active":"2023-09-13T02:13:26.381927+0000","last_peered":"2023-09-13T02:13:26.381927+0000","last_clean":"2023-09-13T02:13:26.381927+0000","last_became_active":"2023-09-13T02:12:24.592247+0000","last_became_peered":"2023-09-13T02:12:24.592247+0000","last_unstale":"2023-09-13T02:13:26.381927+0000","last_undegraded":"2023-09-13T02:13:26.381927+0000","last_fullsized":"2023-09-13T02:13:26.381927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:17.903307+0000","last_change":"2023-09-13T02:12:23.579687+0000","last_active":"2023-09-13T02:13:17.903307+0000","last_peered":"2023-09-13T02:13:17.903307+0000","last_clean":"2023-09-13T02:13:17.903307+0000","last_became_active":"2023-09-13T02:12:23.579389+0000","last_became_peered":"2023-09-13T02:12:23.579389+0000","last_unstale":"2023-09-13T02:13:17.903307+0000","last_undegraded":"2023-09-13T02:13:17.903307+0000","last_fullsized":"2023-09-13T02:13:17.903307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'21","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.372849+0000","last_change":"2023-09-13T02:12:24.585029+0000","last_active":"2023-09-13T02:13:26.372849+0000","last_peered":"2023-09-13T02:13:26.372849+0000","last_clean":"2023-09-13T02:13:26.372849+0000","last_became_active":"2023-09-13T02:12:24.584791+0000","last_became_peered":"2023-09-13T02:12:24.584791+0000","last_unstale":"2023-09-13T02:13:26.372849+0000","last_undegraded":"2023-09-13T02:13:26.372849+0000","last_fullsized":"2023-09-13T02:13:26.372849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.363984+0000","last_change":"2023-09-13T02:12:23.585601+0000","last_active":"2023-09-13T02:13:06.363984+0000","last_peered":"2023-09-13T02:13:06.363984+0000","last_clean":"2023-09-13T02:13:06.363984+0000","last_became_active":"2023-09-13T02:12:23.585321+0000","last_became_peered":"2023-09-13T02:12:23.585321+0000","last_unstale":"2023-09-13T02:13:06.363984+0000","last_undegraded":"2023-09-13T02:13:06.363984+0000","last_fullsized":"2023-09-13T02:13:06.363984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'7","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:23.884799+0000","last_change":"2023-09-13T02:12:24.586947+0000","last_active":"2023-09-13T02:13:23.884799+0000","last_peered":"2023-09-13T02:13:23.884799+0000","last_clean":"2023-09-13T02:13:23.884799+0000","last_became_active":"2023-09-13T02:12:24.586072+0000","last_became_peered":"2023-09-13T02:12:24.586072+0000","last_unstale":"2023-09-13T02:13:23.884799+0000","last_undegraded":"2023-09-13T02:13:23.884799+0000","last_fullsized":"2023-09-13T02:13:23.884799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:50.824236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.905358+0000","last_change":"2023-09-13T02:12:23.578914+0000","last_active":"2023-09-13T02:13:04.905358+0000","last_peered":"2023-09-13T02:13:04.905358+0000","last_clean":"2023-09-13T02:13:04.905358+0000","last_became_active":"2023-09-13T02:12:23.578649+0000","last_became_peered":"2023-09-13T02:12:23.578649+0000","last_unstale":"2023-09-13T02:13:04.905358+0000","last_undegraded":"2023-09-13T02:13:04.905358+0000","last_fullsized":"2023-09-13T02:13:04.905358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'27","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.375269+0000","last_change":"2023-09-13T02:13:05.914293+0000","last_active":"2023-09-13T02:13:26.375269+0000","last_peered":"2023-09-13T02:13:26.375269+0000","last_clean":"2023-09-13T02:13:26.375269+0000","last_became_active":"2023-09-13T02:13:05.914007+0000","last_became_peered":"2023-09-13T02:13:05.914007+0000","last_unstale":"2023-09-13T02:13:26.375269+0000","last_undegraded":"2023-09-13T02:13:26.375269+0000","last_fullsized":"2023-09-13T02:13:26.375269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:25:19.651146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.909740+0000","last_change":"2023-09-13T02:12:23.578387+0000","last_active":"2023-09-13T02:13:05.909740+0000","last_peered":"2023-09-13T02:13:05.909740+0000","last_clean":"2023-09-13T02:13:05.909740+0000","last_became_active":"2023-09-13T02:12:23.578121+0000","last_became_peered":"2023-09-13T02:12:23.578121+0000","last_unstale":"2023-09-13T02:13:05.909740+0000","last_undegraded":"2023-09-13T02:13:05.909740+0000","last_fullsized":"2023-09-13T02:13:05.909740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:32.660244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'27","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.379504+0000","last_change":"2023-09-13T02:12:24.587304+0000","last_active":"2023-09-13T02:13:26.379504+0000","last_peered":"2023-09-13T02:13:26.379504+0000","last_clean":"2023-09-13T02:13:26.379504+0000","last_became_active":"2023-09-13T02:12:24.587040+0000","last_became_peered":"2023-09-13T02:12:24.587040+0000","last_unstale":"2023-09-13T02:13:26.379504+0000","last_undegraded":"2023-09-13T02:13:26.379504+0000","last_fullsized":"2023-09-13T02:13:26.379504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:18.256464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364322+0000","last_change":"2023-09-13T02:12:23.578623+0000","last_active":"2023-09-13T02:13:06.364322+0000","last_peered":"2023-09-13T02:13:06.364322+0000","last_clean":"2023-09-13T02:13:06.364322+0000","last_became_active":"2023-09-13T02:12:23.578258+0000","last_became_peered":"2023-09-13T02:12:23.578258+0000","last_unstale":"2023-09-13T02:13:06.364322+0000","last_undegraded":"2023-09-13T02:13:06.364322+0000","last_fullsized":"2023-09-13T02:13:06.364322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:18:54.951761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'15","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.380766+0000","last_change":"2023-09-13T02:12:24.590763+0000","last_active":"2023-09-13T02:13:26.380766+0000","last_peered":"2023-09-13T02:13:26.380766+0000","last_clean":"2023-09-13T02:13:26.380766+0000","last_became_active":"2023-09-13T02:12:24.590494+0000","last_became_peered":"2023-09-13T02:12:24.590494+0000","last_unstale":"2023-09-13T02:13:26.380766+0000","last_undegraded":"2023-09-13T02:13:26.380766+0000","last_fullsized":"2023-09-13T02:13:26.380766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'45","reported_seq":58,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382151+0000","last_change":"2023-09-13T02:12:24.597290+0000","last_active":"2023-09-13T02:13:26.382151+0000","last_peered":"2023-09-13T02:13:26.382151+0000","last_clean":"2023-09-13T02:13:26.382151+0000","last_became_active":"2023-09-13T02:12:24.597024+0000","last_became_peered":"2023-09-13T02:12:24.597024+0000","last_unstale":"2023-09-13T02:13:26.382151+0000","last_undegraded":"2023-09-13T02:13:26.382151+0000","last_fullsized":"2023-09-13T02:13:26.382151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:15.126313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.364323+0000","last_change":"2023-09-13T02:12:23.584941+0000","last_active":"2023-09-13T02:13:05.364323+0000","last_peered":"2023-09-13T02:13:05.364323+0000","last_clean":"2023-09-13T02:13:05.364323+0000","last_became_active":"2023-09-13T02:12:23.584671+0000","last_became_peered":"2023-09-13T02:12:23.584671+0000","last_unstale":"2023-09-13T02:13:05.364323+0000","last_undegraded":"2023-09-13T02:13:05.364323+0000","last_fullsized":"2023-09-13T02:13:05.364323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:38.089400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'27","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382018+0000","last_change":"2023-09-13T02:12:24.596615+0000","last_active":"2023-09-13T02:13:26.382018+0000","last_peered":"2023-09-13T02:13:26.382018+0000","last_clean":"2023-09-13T02:13:26.382018+0000","last_became_active":"2023-09-13T02:12:24.595918+0000","last_became_peered":"2023-09-13T02:12:24.595918+0000","last_unstale":"2023-09-13T02:13:26.382018+0000","last_undegraded":"2023-09-13T02:13:26.382018+0000","last_fullsized":"2023-09-13T02:13:26.382018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:18:08.378805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364450+0000","last_change":"2023-09-13T02:12:23.579507+0000","last_active":"2023-09-13T02:13:06.364450+0000","last_peered":"2023-09-13T02:13:06.364450+0000","last_clean":"2023-09-13T02:13:06.364450+0000","last_became_active":"2023-09-13T02:12:23.579239+0000","last_became_peered":"2023-09-13T02:12:23.579239+0000","last_unstale":"2023-09-13T02:13:06.364450+0000","last_undegraded":"2023-09-13T02:13:06.364450+0000","last_fullsized":"2023-09-13T02:13:06.364450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:11.224076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'20","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.377093+0000","last_change":"2023-09-13T02:12:24.589292+0000","last_active":"2023-09-13T02:13:26.377093+0000","last_peered":"2023-09-13T02:13:26.377093+0000","last_clean":"2023-09-13T02:13:26.377093+0000","last_became_active":"2023-09-13T02:12:24.589039+0000","last_became_peered":"2023-09-13T02:12:24.589039+0000","last_unstale":"2023-09-13T02:13:26.377093+0000","last_undegraded":"2023-09-13T02:13:26.377093+0000","last_fullsized":"2023-09-13T02:13:26.377093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.914584+0000","last_change":"2023-09-13T02:12:23.584177+0000","last_active":"2023-09-13T02:13:05.914584+0000","last_peered":"2023-09-13T02:13:05.914584+0000","last_clean":"2023-09-13T02:13:05.914584+0000","last_became_active":"2023-09-13T02:12:23.583920+0000","last_became_peered":"2023-09-13T02:12:23.583920+0000","last_unstale":"2023-09-13T02:13:05.914584+0000","last_undegraded":"2023-09-13T02:13:05.914584+0000","last_fullsized":"2023-09-13T02:13:05.914584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:21:49.468231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'15","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.374143+0000","last_change":"2023-09-13T02:12:24.588205+0000","last_active":"2023-09-13T02:13:26.374143+0000","last_peered":"2023-09-13T02:13:26.374143+0000","last_clean":"2023-09-13T02:13:26.374143+0000","last_became_active":"2023-09-13T02:12:24.587697+0000","last_became_peered":"2023-09-13T02:12:24.587697+0000","last_unstale":"2023-09-13T02:13:26.374143+0000","last_undegraded":"2023-09-13T02:13:26.374143+0000","last_fullsized":"2023-09-13T02:13:26.374143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364646+0000","last_change":"2023-09-13T02:12:23.583748+0000","last_active":"2023-09-13T02:13:06.364646+0000","last_peered":"2023-09-13T02:13:06.364646+0000","last_clean":"2023-09-13T02:13:06.364646+0000","last_became_active":"2023-09-13T02:12:23.583443+0000","last_became_peered":"2023-09-13T02:12:23.583443+0000","last_unstale":"2023-09-13T02:13:06.364646+0000","last_undegraded":"2023-09-13T02:13:06.364646+0000","last_fullsized":"2023-09-13T02:13:06.364646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":26,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1567,"ondisk_log_size":1567,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":405856,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":9,"num_read_kb":12,"num_write":160,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":876544,"data_stored":811712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":171,"ondisk_log_size":171,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":831488,"data_stored":674158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.63600000000000001}]},{"osd":1,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.68100000000000005}]},{"osd":2,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.752},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.69299999999999995}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.504}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.52500000000000002}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.47699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":638976,"data_stored":483515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.498},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.432}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.44700000000000001}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.55100000000000005}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.52900000000000003}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.47999999999999998}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.372},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.32600000000000001}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.45700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":83294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.439}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.495}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.54500000000000004}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.621},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.58799999999999997}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.70499999999999996}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.76200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":83343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.54600000000000004}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.67200000000000004}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.57199999999999995}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.61599999999999999}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.45100000000000001}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.42199999999999999}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":647168,"data_stored":486953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.27800000000000002}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.318}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.38500000000000001}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.73399999999999999}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.56499999999999995}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.628},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.65900000000000003}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.71399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":86650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.29399999999999998}]},{"osd":1,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.254},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.26700000000000002}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.28100000000000003}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.311},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48599999999999999}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.504},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.33100000000000002}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.35899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":83385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.31900000000000001}]},{"osd":2,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.374},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.41499999999999998}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.39900000000000002}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.64000000000000001}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.61899999999999999}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.67100000000000004}]},{"osd":7,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":835584,"data_stored":673195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.29799999999999999}]},{"osd":2,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.33600000000000002}]},{"osd":3,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.32200000000000001}]},{"osd":4,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.65400000000000003}]},{"osd":5,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55300000000000005}]},{"osd":6,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.625},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.745}]},{"osd":7,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":4747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":405058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":400311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T02:13:30.662 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T02:13:30.795 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.795+0000 7f5c951ce640 1 -- 172.21.15.104:0/1608205949 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c7c004d00 msgr2=0x7f5c7c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:30.796 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.795+0000 7f5c951ce640 1 --2- 172.21.15.104:0/1608205949 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c7c004d00 0x7f5c7c005180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5c88001d80 tx=0x7f5c7c0057f0 comp rx=0 tx=0).stop 2023-09-13T02:13:30.796 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.795+0000 7f5c8f59e640 1 -- 172.21.15.104:0/1608205949 reap_dead start 2023-09-13T02:13:30.796 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.795+0000 7f5c951ce640 1 -- 172.21.15.104:0/1608205949 shutdown_connections 2023-09-13T02:13:30.797 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.795+0000 7f5c951ce640 1 -- 172.21.15.104:0/1608205949 >> 172.21.15.104:0/1608205949 conn(0x7f5c900b56f0 msgr2=0x7f5c900b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:30.797 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.795+0000 7f5c951ce640 1 -- 172.21.15.104:0/1608205949 shutdown_connections 2023-09-13T02:13:30.798 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.795+0000 7f5c951ce640 1 -- 172.21.15.104:0/1608205949 wait complete. 2023-09-13T02:13:30.801 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.796+0000 7f5c951ce640 1 Processor -- start 2023-09-13T02:13:30.801 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.796+0000 7f5c951ce640 1 -- start start 2023-09-13T02:13:30.802 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c951ce640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c7c004d00 0x7f5c90136ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:30.802 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c951ce640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c901355b0 0x7f5c90070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:30.803 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c951ce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c901dafd0 0x7f5c90135c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:30.803 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c951ce640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c90137ff0 con 0x7f5c7c004d00 2023-09-13T02:13:30.803 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c951ce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c90137500 con 0x7f5c901dafd0 2023-09-13T02:13:30.804 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c951ce640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c901da7d0 con 0x7f5c901355b0 2023-09-13T02:13:30.804 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c8ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c7c004d00 0x7f5c90136ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:30.805 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c8ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c7c004d00 0x7f5c90136ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49196/0 (socket says 172.21.15.104:49196) 2023-09-13T02:13:30.805 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c8ed9d640 1 -- 172.21.15.104:0/1967168778 learned_addr learned my addr 172.21.15.104:0/1967168778 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:30.805 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c87fff640 1 --2- 172.21.15.104:0/1967168778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c901355b0 0x7f5c90070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:30.806 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c8f59e640 1 --2- 172.21.15.104:0/1967168778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c901dafd0 0x7f5c90135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:30.806 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c8ed9d640 1 -- 172.21.15.104:0/1967168778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c901355b0 msgr2=0x7f5c90070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:30.806 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c8ed9d640 1 --2- 172.21.15.104:0/1967168778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c901355b0 0x7f5c90070ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:30.807 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c8ed9d640 1 -- 172.21.15.104:0/1967168778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c901dafd0 msgr2=0x7f5c90135c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:30.807 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c8ed9d640 1 --2- 172.21.15.104:0/1967168778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c901dafd0 0x7f5c90135c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:30.807 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c8ed9d640 1 -- 172.21.15.104:0/1967168778 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c901daab0 con 0x7f5c7c004d00 2023-09-13T02:13:30.808 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c8f59e640 1 --2- 172.21.15.104:0/1967168778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c901dafd0 0x7f5c90135c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:13:30.808 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c8ed9d640 1 --2- 172.21.15.104:0/1967168778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c7c004d00 0x7f5c90136ed0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5c80011ae0 tx=0x7f5c80009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:30.809 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c877fe640 1 -- 172.21.15.104:0/1967168778 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8000fe70 con 0x7f5c7c004d00 2023-09-13T02:13:30.809 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c877fe640 1 -- 172.21.15.104:0/1967168778 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5c80004050 con 0x7f5c7c004d00 2023-09-13T02:13:30.809 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c951ce640 1 -- 172.21.15.104:0/1967168778 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c90138240 con 0x7f5c7c004d00 2023-09-13T02:13:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c877fe640 1 -- 172.21.15.104:0/1967168778 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c80004460 con 0x7f5c7c004d00 2023-09-13T02:13:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.797+0000 7f5c951ce640 1 -- 172.21.15.104:0/1967168778 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9013dbb0 con 0x7f5c7c004d00 2023-09-13T02:13:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.798+0000 7f5c951ce640 1 -- 172.21.15.104:0/1967168778 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c9004e100 con 0x7f5c7c004d00 2023-09-13T02:13:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.799+0000 7f5c877fe640 1 -- 172.21.15.104:0/1967168778 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5c800035f0 con 0x7f5c7c004d00 2023-09-13T02:13:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.799+0000 7f5c877fe640 1 --2- 172.21.15.104:0/1967168778 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f5c7006a4f0 0x7f5c7006c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.799+0000 7f5c877fe640 1 -- 172.21.15.104:0/1967168778 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5c80089940 con 0x7f5c7c004d00 2023-09-13T02:13:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.799+0000 7f5c87fff640 1 --2- 172.21.15.104:0/1967168778 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f5c7006a4f0 0x7f5c7006c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.799+0000 7f5c87fff640 1 --2- 172.21.15.104:0/1967168778 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f5c7006a4f0 0x7f5c7006c9b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5c90138720 tx=0x7f5c78006040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:30.813 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.803+0000 7f5c877fe640 1 -- 172.21.15.104:0/1967168778 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5c80054fb0 con 0x7f5c7c004d00 2023-09-13T02:13:30.965 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.965+0000 7f5c951ce640 1 -- 172.21.15.104:0/1967168778 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c901da940 con 0x7f5c7006a4f0 2023-09-13T02:13:30.972 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.972+0000 7f5c877fe640 1 -- 172.21.15.104:0/1967168778 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289496 (secure 0 0 0) 0x7f5c901da940 con 0x7f5c7006a4f0 2023-09-13T02:13:30.975 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:13:30.977 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2023-09-13T02:13:30.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.976+0000 7f5c951ce640 1 -- 172.21.15.104:0/1967168778 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f5c7006a4f0 msgr2=0x7f5c7006c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:30.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.976+0000 7f5c951ce640 1 --2- 172.21.15.104:0/1967168778 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f5c7006a4f0 0x7f5c7006c9b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5c90138720 tx=0x7f5c78006040 comp rx=0 tx=0).stop 2023-09-13T02:13:30.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.976+0000 7f5c951ce640 1 -- 172.21.15.104:0/1967168778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c7c004d00 msgr2=0x7f5c90136ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:30.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.976+0000 7f5c951ce640 1 --2- 172.21.15.104:0/1967168778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c7c004d00 0x7f5c90136ed0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5c80011ae0 tx=0x7f5c80009e90 comp rx=0 tx=0).stop 2023-09-13T02:13:30.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.976+0000 7f5c951ce640 1 -- 172.21.15.104:0/1967168778 shutdown_connections 2023-09-13T02:13:30.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.976+0000 7f5c951ce640 1 --2- 172.21.15.104:0/1967168778 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f5c7006a4f0 0x7f5c7006c9b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:30.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.976+0000 7f5c951ce640 1 --2- 172.21.15.104:0/1967168778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c901dafd0 0x7f5c90135c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:30.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.976+0000 7f5c951ce640 1 --2- 172.21.15.104:0/1967168778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c901355b0 0x7f5c90070ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:30.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.976+0000 7f5c951ce640 1 --2- 172.21.15.104:0/1967168778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c7c004d00 0x7f5c90136ed0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:30.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.976+0000 7f5c951ce640 1 -- 172.21.15.104:0/1967168778 >> 172.21.15.104:0/1967168778 conn(0x7f5c900b56f0 msgr2=0x7f5c900b4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:30.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.976+0000 7f5c951ce640 1 -- 172.21.15.104:0/1967168778 shutdown_connections 2023-09-13T02:13:30.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:30.976+0000 7f5c951ce640 1 -- 172.21.15.104:0/1967168778 wait complete. 2023-09-13T02:13:30.986 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-09-13T02:13:30.044754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":996237,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":125,"num_read_kb":112,"num_write":362,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1855,"ondisk_log_size":1855,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219964,"kb_used_data":3836,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754756,"statfs":{"total":773094113280,"available":772868870144,"internally_reserved":0,"allocated":3928064,"data_stored":2654493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":403459,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":12,"num_write":158,"num_write_kb":486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003269"},"pg_stats":[{"pgid":"3.3f","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.388177+0000","last_change":"2023-09-13T02:12:24.593673+0000","last_active":"2023-09-13T02:13:26.388177+0000","last_peered":"2023-09-13T02:13:26.388177+0000","last_clean":"2023-09-13T02:13:26.388177+0000","last_became_active":"2023-09-13T02:12:24.592754+0000","last_became_peered":"2023-09-13T02:12:24.592754+0000","last_unstale":"2023-09-13T02:13:26.388177+0000","last_undegraded":"2023-09-13T02:13:26.388177+0000","last_fullsized":"2023-09-13T02:13:26.388177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:43:34.341442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'12","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.373777+0000","last_change":"2023-09-13T02:12:24.580108+0000","last_active":"2023-09-13T02:13:26.373777+0000","last_peered":"2023-09-13T02:13:26.373777+0000","last_clean":"2023-09-13T02:13:26.373777+0000","last_became_active":"2023-09-13T02:12:24.579873+0000","last_became_peered":"2023-09-13T02:12:24.579873+0000","last_unstale":"2023-09-13T02:13:26.373777+0000","last_undegraded":"2023-09-13T02:13:26.373777+0000","last_fullsized":"2023-09-13T02:13:26.373777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'23","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.376076+0000","last_change":"2023-09-13T02:12:24.584533+0000","last_active":"2023-09-13T02:13:26.376076+0000","last_peered":"2023-09-13T02:13:26.376076+0000","last_clean":"2023-09-13T02:13:26.376076+0000","last_became_active":"2023-09-13T02:12:24.584249+0000","last_became_peered":"2023-09-13T02:12:24.584249+0000","last_unstale":"2023-09-13T02:13:26.376076+0000","last_undegraded":"2023-09-13T02:13:26.376076+0000","last_fullsized":"2023-09-13T02:13:26.376076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.383220+0000","last_change":"2023-09-13T02:12:24.596092+0000","last_active":"2023-09-13T02:13:26.383220+0000","last_peered":"2023-09-13T02:13:26.383220+0000","last_clean":"2023-09-13T02:13:26.383220+0000","last_became_active":"2023-09-13T02:12:24.595817+0000","last_became_peered":"2023-09-13T02:12:24.595817+0000","last_unstale":"2023-09-13T02:13:26.383220+0000","last_undegraded":"2023-09-13T02:13:26.383220+0000","last_fullsized":"2023-09-13T02:13:26.383220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:15.246952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'12","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.385312+0000","last_change":"2023-09-13T02:12:24.592410+0000","last_active":"2023-09-13T02:13:26.385312+0000","last_peered":"2023-09-13T02:13:26.385312+0000","last_clean":"2023-09-13T02:13:26.385312+0000","last_became_active":"2023-09-13T02:12:24.591503+0000","last_became_peered":"2023-09-13T02:12:24.591503+0000","last_unstale":"2023-09-13T02:13:26.385312+0000","last_undegraded":"2023-09-13T02:13:26.385312+0000","last_fullsized":"2023-09-13T02:13:26.385312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:43:26.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'18","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.380748+0000","last_change":"2023-09-13T02:13:06.365480+0000","last_active":"2023-09-13T02:13:26.380748+0000","last_peered":"2023-09-13T02:13:26.380748+0000","last_clean":"2023-09-13T02:13:26.380748+0000","last_became_active":"2023-09-13T02:13:06.365133+0000","last_became_peered":"2023-09-13T02:13:06.365133+0000","last_unstale":"2023-09-13T02:13:26.380748+0000","last_undegraded":"2023-09-13T02:13:26.380748+0000","last_fullsized":"2023-09-13T02:13:26.380748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:04:53.013012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"22'16","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.381276+0000","last_change":"2023-09-13T02:12:24.591304+0000","last_active":"2023-09-13T02:13:26.381276+0000","last_peered":"2023-09-13T02:13:26.381276+0000","last_clean":"2023-09-13T02:13:26.381276+0000","last_became_active":"2023-09-13T02:12:24.590654+0000","last_became_peered":"2023-09-13T02:12:24.590654+0000","last_unstale":"2023-09-13T02:13:26.381276+0000","last_undegraded":"2023-09-13T02:13:26.381276+0000","last_fullsized":"2023-09-13T02:13:26.381276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:15.246952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'27","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382837+0000","last_change":"2023-09-13T02:12:24.588844+0000","last_active":"2023-09-13T02:13:26.382837+0000","last_peered":"2023-09-13T02:13:26.382837+0000","last_clean":"2023-09-13T02:13:26.382837+0000","last_became_active":"2023-09-13T02:12:24.588438+0000","last_became_peered":"2023-09-13T02:12:24.588438+0000","last_unstale":"2023-09-13T02:13:26.382837+0000","last_undegraded":"2023-09-13T02:13:26.382837+0000","last_fullsized":"2023-09-13T02:13:26.382837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:37.796406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'33","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393395+0000","last_change":"2023-09-13T02:12:24.589946+0000","last_active":"2023-09-13T02:13:26.393395+0000","last_peered":"2023-09-13T02:13:26.393395+0000","last_clean":"2023-09-13T02:13:26.393395+0000","last_became_active":"2023-09-13T02:12:24.589606+0000","last_became_peered":"2023-09-13T02:12:24.589606+0000","last_unstale":"2023-09-13T02:13:26.393395+0000","last_undegraded":"2023-09-13T02:13:26.393395+0000","last_fullsized":"2023-09-13T02:13:26.393395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:41.609166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.385472+0000","last_change":"2023-09-13T02:12:24.588874+0000","last_active":"2023-09-13T02:13:26.385472+0000","last_peered":"2023-09-13T02:13:26.385472+0000","last_clean":"2023-09-13T02:13:26.385472+0000","last_became_active":"2023-09-13T02:12:24.588522+0000","last_became_peered":"2023-09-13T02:12:24.588522+0000","last_unstale":"2023-09-13T02:13:26.385472+0000","last_undegraded":"2023-09-13T02:13:26.385472+0000","last_fullsized":"2023-09-13T02:13:26.385472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'18","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.384182+0000","last_change":"2023-09-13T02:12:24.589173+0000","last_active":"2023-09-13T02:13:26.384182+0000","last_peered":"2023-09-13T02:13:26.384182+0000","last_clean":"2023-09-13T02:13:26.384182+0000","last_became_active":"2023-09-13T02:12:24.588891+0000","last_became_peered":"2023-09-13T02:12:24.588891+0000","last_unstale":"2023-09-13T02:13:26.384182+0000","last_undegraded":"2023-09-13T02:13:26.384182+0000","last_fullsized":"2023-09-13T02:13:26.384182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'21","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378152+0000","last_change":"2023-09-13T02:12:24.587494+0000","last_active":"2023-09-13T02:13:26.378152+0000","last_peered":"2023-09-13T02:13:26.378152+0000","last_clean":"2023-09-13T02:13:26.378152+0000","last_became_active":"2023-09-13T02:12:24.587023+0000","last_became_peered":"2023-09-13T02:12:24.587023+0000","last_unstale":"2023-09-13T02:13:26.378152+0000","last_undegraded":"2023-09-13T02:13:26.378152+0000","last_fullsized":"2023-09-13T02:13:26.378152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:41.175280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378034+0000","last_change":"2023-09-13T02:12:24.588000+0000","last_active":"2023-09-13T02:13:26.378034+0000","last_peered":"2023-09-13T02:13:26.378034+0000","last_clean":"2023-09-13T02:13:26.378034+0000","last_became_active":"2023-09-13T02:12:24.587730+0000","last_became_peered":"2023-09-13T02:12:24.587730+0000","last_unstale":"2023-09-13T02:13:26.378034+0000","last_undegraded":"2023-09-13T02:13:26.378034+0000","last_fullsized":"2023-09-13T02:13:26.378034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'23","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.373720+0000","last_change":"2023-09-13T02:12:24.584985+0000","last_active":"2023-09-13T02:13:26.373720+0000","last_peered":"2023-09-13T02:13:26.373720+0000","last_clean":"2023-09-13T02:13:26.373720+0000","last_became_active":"2023-09-13T02:12:24.584734+0000","last_became_peered":"2023-09-13T02:12:24.584734+0000","last_unstale":"2023-09-13T02:13:26.373720+0000","last_undegraded":"2023-09-13T02:13:26.373720+0000","last_fullsized":"2023-09-13T02:13:26.373720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:37.796406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'23","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378365+0000","last_change":"2023-09-13T02:12:24.578832+0000","last_active":"2023-09-13T02:13:26.378365+0000","last_peered":"2023-09-13T02:13:26.378365+0000","last_clean":"2023-09-13T02:13:26.378365+0000","last_became_active":"2023-09-13T02:12:24.578553+0000","last_became_peered":"2023-09-13T02:12:24.578553+0000","last_unstale":"2023-09-13T02:13:26.378365+0000","last_undegraded":"2023-09-13T02:13:26.378365+0000","last_fullsized":"2023-09-13T02:13:26.378365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.381433+0000","last_change":"2023-09-13T02:12:24.591151+0000","last_active":"2023-09-13T02:13:26.381433+0000","last_peered":"2023-09-13T02:13:26.381433+0000","last_clean":"2023-09-13T02:13:26.381433+0000","last_became_active":"2023-09-13T02:12:24.590871+0000","last_became_peered":"2023-09-13T02:12:24.590871+0000","last_unstale":"2023-09-13T02:13:26.381433+0000","last_undegraded":"2023-09-13T02:13:26.381433+0000","last_fullsized":"2023-09-13T02:13:26.381433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.388169+0000","last_change":"2023-09-13T02:12:24.592615+0000","last_active":"2023-09-13T02:13:26.388169+0000","last_peered":"2023-09-13T02:13:26.388169+0000","last_clean":"2023-09-13T02:13:26.388169+0000","last_became_active":"2023-09-13T02:12:24.592325+0000","last_became_peered":"2023-09-13T02:12:24.592325+0000","last_unstale":"2023-09-13T02:13:26.388169+0000","last_undegraded":"2023-09-13T02:13:26.388169+0000","last_fullsized":"2023-09-13T02:13:26.388169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:19:41.872878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'33","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.888218+0000","last_change":"2023-09-13T02:12:24.587859+0000","last_active":"2023-09-13T02:13:26.888218+0000","last_peered":"2023-09-13T02:13:26.888218+0000","last_clean":"2023-09-13T02:13:26.888218+0000","last_became_active":"2023-09-13T02:12:24.587552+0000","last_became_peered":"2023-09-13T02:12:24.587552+0000","last_unstale":"2023-09-13T02:13:26.888218+0000","last_undegraded":"2023-09-13T02:13:26.888218+0000","last_fullsized":"2023-09-13T02:13:26.888218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:39.029452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'23","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.387469+0000","last_change":"2023-09-13T02:12:24.591593+0000","last_active":"2023-09-13T02:13:26.387469+0000","last_peered":"2023-09-13T02:13:26.387469+0000","last_clean":"2023-09-13T02:13:26.387469+0000","last_became_active":"2023-09-13T02:12:24.590670+0000","last_became_peered":"2023-09-13T02:12:24.590670+0000","last_unstale":"2023-09-13T02:13:26.387469+0000","last_undegraded":"2023-09-13T02:13:26.387469+0000","last_fullsized":"2023-09-13T02:13:26.387469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:19:41.872878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'25","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378361+0000","last_change":"2023-09-13T02:12:24.593278+0000","last_active":"2023-09-13T02:13:26.378361+0000","last_peered":"2023-09-13T02:13:26.378361+0000","last_clean":"2023-09-13T02:13:26.378361+0000","last_became_active":"2023-09-13T02:12:24.591065+0000","last_became_peered":"2023-09-13T02:12:24.591065+0000","last_unstale":"2023-09-13T02:13:26.378361+0000","last_undegraded":"2023-09-13T02:13:26.378361+0000","last_fullsized":"2023-09-13T02:13:26.378361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'36","reported_seq":49,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378658+0000","last_change":"2023-09-13T02:12:24.587352+0000","last_active":"2023-09-13T02:13:26.378658+0000","last_peered":"2023-09-13T02:13:26.378658+0000","last_clean":"2023-09-13T02:13:26.378658+0000","last_became_active":"2023-09-13T02:12:24.586981+0000","last_became_peered":"2023-09-13T02:12:24.586981+0000","last_unstale":"2023-09-13T02:13:26.378658+0000","last_undegraded":"2023-09-13T02:13:26.378658+0000","last_fullsized":"2023-09-13T02:13:26.378658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.388258+0000","last_change":"2023-09-13T02:12:24.595423+0000","last_active":"2023-09-13T02:13:26.388258+0000","last_peered":"2023-09-13T02:13:26.388258+0000","last_clean":"2023-09-13T02:13:26.388258+0000","last_became_active":"2023-09-13T02:12:24.594351+0000","last_became_peered":"2023-09-13T02:12:24.594351+0000","last_unstale":"2023-09-13T02:13:26.388258+0000","last_undegraded":"2023-09-13T02:13:26.388258+0000","last_fullsized":"2023-09-13T02:13:26.388258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:18.256464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.379446+0000","last_change":"2023-09-13T02:12:24.590553+0000","last_active":"2023-09-13T02:13:26.379446+0000","last_peered":"2023-09-13T02:13:26.379446+0000","last_clean":"2023-09-13T02:13:26.379446+0000","last_became_active":"2023-09-13T02:12:24.590295+0000","last_became_peered":"2023-09-13T02:12:24.590295+0000","last_unstale":"2023-09-13T02:13:26.379446+0000","last_undegraded":"2023-09-13T02:13:26.379446+0000","last_fullsized":"2023-09-13T02:13:26.379446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.380900+0000","last_change":"2023-09-13T02:12:24.593925+0000","last_active":"2023-09-13T02:13:26.380900+0000","last_peered":"2023-09-13T02:13:26.380900+0000","last_clean":"2023-09-13T02:13:26.380900+0000","last_became_active":"2023-09-13T02:12:24.593673+0000","last_became_peered":"2023-09-13T02:12:24.593673+0000","last_unstale":"2023-09-13T02:13:26.380900+0000","last_undegraded":"2023-09-13T02:13:26.380900+0000","last_fullsized":"2023-09-13T02:13:26.380900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'8","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.888016+0000","last_change":"2023-09-13T02:12:24.590496+0000","last_active":"2023-09-13T02:13:26.888016+0000","last_peered":"2023-09-13T02:13:26.888016+0000","last_clean":"2023-09-13T02:13:26.888016+0000","last_became_active":"2023-09-13T02:12:24.590231+0000","last_became_peered":"2023-09-13T02:12:24.590231+0000","last_unstale":"2023-09-13T02:13:26.888016+0000","last_undegraded":"2023-09-13T02:13:26.888016+0000","last_fullsized":"2023-09-13T02:13:26.888016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'46","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.377698+0000","last_change":"2023-09-13T02:13:05.916706+0000","last_active":"2023-09-13T02:13:26.377698+0000","last_peered":"2023-09-13T02:13:26.377698+0000","last_clean":"2023-09-13T02:13:26.377698+0000","last_became_active":"2023-09-13T02:13:05.916435+0000","last_became_peered":"2023-09-13T02:13:05.916435+0000","last_unstale":"2023-09-13T02:13:26.377698+0000","last_undegraded":"2023-09-13T02:13:26.377698+0000","last_fullsized":"2023-09-13T02:13:26.377698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:39:21.058634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'18","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.377483+0000","last_change":"2023-09-13T02:12:24.584028+0000","last_active":"2023-09-13T02:13:26.377483+0000","last_peered":"2023-09-13T02:13:26.377483+0000","last_clean":"2023-09-13T02:13:26.377483+0000","last_became_active":"2023-09-13T02:12:24.583782+0000","last_became_peered":"2023-09-13T02:12:24.583782+0000","last_unstale":"2023-09-13T02:13:26.377483+0000","last_undegraded":"2023-09-13T02:13:26.377483+0000","last_fullsized":"2023-09-13T02:13:26.377483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'12","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.379349+0000","last_change":"2023-09-13T02:12:24.590548+0000","last_active":"2023-09-13T02:13:26.379349+0000","last_peered":"2023-09-13T02:13:26.379349+0000","last_clean":"2023-09-13T02:13:26.379349+0000","last_became_active":"2023-09-13T02:12:24.590189+0000","last_became_peered":"2023-09-13T02:12:24.590189+0000","last_unstale":"2023-09-13T02:13:26.379349+0000","last_undegraded":"2023-09-13T02:13:26.379349+0000","last_fullsized":"2023-09-13T02:13:26.379349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'21","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.376706+0000","last_change":"2023-09-13T02:12:24.583749+0000","last_active":"2023-09-13T02:13:26.376706+0000","last_peered":"2023-09-13T02:13:26.376706+0000","last_clean":"2023-09-13T02:13:26.376706+0000","last_became_active":"2023-09-13T02:12:24.583453+0000","last_became_peered":"2023-09-13T02:12:24.583453+0000","last_unstale":"2023-09-13T02:13:26.376706+0000","last_undegraded":"2023-09-13T02:13:26.376706+0000","last_fullsized":"2023-09-13T02:13:26.376706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.379356+0000","last_change":"2023-09-13T02:12:24.595007+0000","last_active":"2023-09-13T02:13:26.379356+0000","last_peered":"2023-09-13T02:13:26.379356+0000","last_clean":"2023-09-13T02:13:26.379356+0000","last_became_active":"2023-09-13T02:12:24.592875+0000","last_became_peered":"2023-09-13T02:12:24.592875+0000","last_unstale":"2023-09-13T02:13:26.379356+0000","last_undegraded":"2023-09-13T02:13:26.379356+0000","last_fullsized":"2023-09-13T02:13:26.379356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'36","reported_seq":49,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378778+0000","last_change":"2023-09-13T02:12:24.588586+0000","last_active":"2023-09-13T02:13:26.378778+0000","last_peered":"2023-09-13T02:13:26.378778+0000","last_clean":"2023-09-13T02:13:26.378778+0000","last_became_active":"2023-09-13T02:12:24.588173+0000","last_became_peered":"2023-09-13T02:12:24.588173+0000","last_unstale":"2023-09-13T02:13:26.378778+0000","last_undegraded":"2023-09-13T02:13:26.378778+0000","last_fullsized":"2023-09-13T02:13:26.378778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:50.824236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'27","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.383062+0000","last_change":"2023-09-13T02:12:24.590981+0000","last_active":"2023-09-13T02:13:26.383062+0000","last_peered":"2023-09-13T02:13:26.383062+0000","last_clean":"2023-09-13T02:13:26.383062+0000","last_became_active":"2023-09-13T02:12:24.590677+0000","last_became_peered":"2023-09-13T02:12:24.590677+0000","last_unstale":"2023-09-13T02:13:26.383062+0000","last_undegraded":"2023-09-13T02:13:26.383062+0000","last_fullsized":"2023-09-13T02:13:26.383062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'22","reported_seq":35,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.370221+0000","last_change":"2023-09-13T02:12:24.586738+0000","last_active":"2023-09-13T02:13:26.370221+0000","last_peered":"2023-09-13T02:13:26.370221+0000","last_clean":"2023-09-13T02:13:26.370221+0000","last_became_active":"2023-09-13T02:12:24.586251+0000","last_became_peered":"2023-09-13T02:12:24.586251+0000","last_unstale":"2023-09-13T02:13:26.370221+0000","last_undegraded":"2023-09-13T02:13:26.370221+0000","last_fullsized":"2023-09-13T02:13:26.370221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:25.830036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.914084+0000","last_change":"2023-09-13T02:12:23.579164+0000","last_active":"2023-09-13T02:13:05.914084+0000","last_peered":"2023-09-13T02:13:05.914084+0000","last_clean":"2023-09-13T02:13:05.914084+0000","last_became_active":"2023-09-13T02:12:23.578889+0000","last_became_peered":"2023-09-13T02:12:23.578889+0000","last_unstale":"2023-09-13T02:13:05.914084+0000","last_undegraded":"2023-09-13T02:13:05.914084+0000","last_fullsized":"2023-09-13T02:13:05.914084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.376150+0000","last_change":"2023-09-13T02:12:24.579559+0000","last_active":"2023-09-13T02:13:26.376150+0000","last_peered":"2023-09-13T02:13:26.376150+0000","last_clean":"2023-09-13T02:13:26.376150+0000","last_became_active":"2023-09-13T02:12:24.579243+0000","last_became_peered":"2023-09-13T02:12:24.579243+0000","last_unstale":"2023-09-13T02:13:26.376150+0000","last_undegraded":"2023-09-13T02:13:26.376150+0000","last_fullsized":"2023-09-13T02:13:26.376150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.364759+0000","last_change":"2023-09-13T02:12:23.577022+0000","last_active":"2023-09-13T02:13:05.364759+0000","last_peered":"2023-09-13T02:13:05.364759+0000","last_clean":"2023-09-13T02:13:05.364759+0000","last_became_active":"2023-09-13T02:12:23.576754+0000","last_became_peered":"2023-09-13T02:12:23.576754+0000","last_unstale":"2023-09-13T02:13:05.364759+0000","last_undegraded":"2023-09-13T02:13:05.364759+0000","last_fullsized":"2023-09-13T02:13:05.364759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:49.820358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:17.908498+0000","last_change":"2023-09-13T02:12:23.579634+0000","last_active":"2023-09-13T02:13:17.908498+0000","last_peered":"2023-09-13T02:13:17.908498+0000","last_clean":"2023-09-13T02:13:17.908498+0000","last_became_active":"2023-09-13T02:12:23.579351+0000","last_became_peered":"2023-09-13T02:12:23.579351+0000","last_unstale":"2023-09-13T02:13:17.908498+0000","last_undegraded":"2023-09-13T02:13:17.908498+0000","last_fullsized":"2023-09-13T02:13:17.908498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:24.826159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.379347+0000","last_change":"2023-09-13T02:12:24.590474+0000","last_active":"2023-09-13T02:13:26.379347+0000","last_peered":"2023-09-13T02:13:26.379347+0000","last_clean":"2023-09-13T02:13:26.379347+0000","last_became_active":"2023-09-13T02:12:24.590126+0000","last_became_peered":"2023-09-13T02:12:24.590126+0000","last_unstale":"2023-09-13T02:13:26.379347+0000","last_undegraded":"2023-09-13T02:13:26.379347+0000","last_fullsized":"2023-09-13T02:13:26.379347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.903735+0000","last_change":"2023-09-13T02:12:23.586264+0000","last_active":"2023-09-13T02:13:04.903735+0000","last_peered":"2023-09-13T02:13:04.903735+0000","last_clean":"2023-09-13T02:13:04.903735+0000","last_became_active":"2023-09-13T02:12:23.585953+0000","last_became_peered":"2023-09-13T02:12:23.585953+0000","last_unstale":"2023-09-13T02:13:04.903735+0000","last_undegraded":"2023-09-13T02:13:04.903735+0000","last_fullsized":"2023-09-13T02:13:04.903735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:27.359818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378167+0000","last_change":"2023-09-13T02:12:24.585138+0000","last_active":"2023-09-13T02:13:26.378167+0000","last_peered":"2023-09-13T02:13:26.378167+0000","last_clean":"2023-09-13T02:13:26.378167+0000","last_became_active":"2023-09-13T02:12:24.584901+0000","last_became_peered":"2023-09-13T02:12:24.584901+0000","last_unstale":"2023-09-13T02:13:26.378167+0000","last_undegraded":"2023-09-13T02:13:26.378167+0000","last_fullsized":"2023-09-13T02:13:26.378167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.912367+0000","last_change":"2023-09-13T02:12:23.583663+0000","last_active":"2023-09-13T02:13:05.912367+0000","last_peered":"2023-09-13T02:13:05.912367+0000","last_clean":"2023-09-13T02:13:05.912367+0000","last_became_active":"2023-09-13T02:12:23.583305+0000","last_became_peered":"2023-09-13T02:12:23.583305+0000","last_unstale":"2023-09-13T02:13:05.912367+0000","last_undegraded":"2023-09-13T02:13:05.912367+0000","last_fullsized":"2023-09-13T02:13:05.912367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:32.660244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.388445+0000","last_change":"2023-09-13T02:12:24.595264+0000","last_active":"2023-09-13T02:13:26.388445+0000","last_peered":"2023-09-13T02:13:26.388445+0000","last_clean":"2023-09-13T02:13:26.388445+0000","last_became_active":"2023-09-13T02:12:24.594434+0000","last_became_peered":"2023-09-13T02:12:24.594434+0000","last_unstale":"2023-09-13T02:13:26.388445+0000","last_undegraded":"2023-09-13T02:13:26.388445+0000","last_fullsized":"2023-09-13T02:13:26.388445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:17:30.897344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.042686+0000","last_change":"2023-09-13T02:12:23.584935+0000","last_active":"2023-09-13T02:13:06.042686+0000","last_peered":"2023-09-13T02:13:06.042686+0000","last_clean":"2023-09-13T02:13:06.042686+0000","last_became_active":"2023-09-13T02:12:23.584657+0000","last_became_peered":"2023-09-13T02:12:23.584657+0000","last_unstale":"2023-09-13T02:13:06.042686+0000","last_undegraded":"2023-09-13T02:13:06.042686+0000","last_fullsized":"2023-09-13T02:13:06.042686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:36.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'28","reported_seq":41,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.369701+0000","last_change":"2023-09-13T02:12:24.588694+0000","last_active":"2023-09-13T02:13:26.369701+0000","last_peered":"2023-09-13T02:13:26.369701+0000","last_clean":"2023-09-13T02:13:26.369701+0000","last_became_active":"2023-09-13T02:12:24.588455+0000","last_became_peered":"2023-09-13T02:12:24.588455+0000","last_unstale":"2023-09-13T02:13:26.369701+0000","last_undegraded":"2023-09-13T02:13:26.369701+0000","last_fullsized":"2023-09-13T02:13:26.369701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'10","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:25.893290+0000","last_change":"2023-09-13T02:12:23.582781+0000","last_active":"2023-09-13T02:13:25.893290+0000","last_peered":"2023-09-13T02:13:25.893290+0000","last_clean":"2023-09-13T02:13:25.893290+0000","last_became_active":"2023-09-13T02:12:23.582506+0000","last_became_peered":"2023-09-13T02:12:23.582506+0000","last_unstale":"2023-09-13T02:13:25.893290+0000","last_undegraded":"2023-09-13T02:13:25.893290+0000","last_fullsized":"2023-09-13T02:13:25.893290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:03.890491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'37","reported_seq":50,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.391591+0000","last_change":"2023-09-13T02:12:24.594514+0000","last_active":"2023-09-13T02:13:26.391591+0000","last_peered":"2023-09-13T02:13:26.391591+0000","last_clean":"2023-09-13T02:13:26.391591+0000","last_became_active":"2023-09-13T02:12:24.592367+0000","last_became_peered":"2023-09-13T02:12:24.592367+0000","last_unstale":"2023-09-13T02:13:26.391591+0000","last_undegraded":"2023-09-13T02:13:26.391591+0000","last_fullsized":"2023-09-13T02:13:26.391591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:08.045218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'101","reported_seq":115,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.395152+0000","last_change":"2023-09-13T02:12:23.579000+0000","last_active":"2023-09-13T02:13:26.395152+0000","last_peered":"2023-09-13T02:13:26.395152+0000","last_clean":"2023-09-13T02:13:26.395152+0000","last_became_active":"2023-09-13T02:12:23.578748+0000","last_became_peered":"2023-09-13T02:12:23.578748+0000","last_unstale":"2023-09-13T02:13:26.395152+0000","last_undegraded":"2023-09-13T02:13:26.395152+0000","last_fullsized":"2023-09-13T02:13:26.395152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:38.025574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400311,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'20","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.381851+0000","last_change":"2023-09-13T02:12:24.593514+0000","last_active":"2023-09-13T02:13:26.381851+0000","last_peered":"2023-09-13T02:13:26.381851+0000","last_clean":"2023-09-13T02:13:26.381851+0000","last_became_active":"2023-09-13T02:12:24.593092+0000","last_became_peered":"2023-09-13T02:12:24.593092+0000","last_unstale":"2023-09-13T02:13:26.381851+0000","last_undegraded":"2023-09-13T02:13:26.381851+0000","last_fullsized":"2023-09-13T02:13:26.381851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:18:08.378805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364390+0000","last_change":"2023-09-13T02:12:23.579348+0000","last_active":"2023-09-13T02:13:06.364390+0000","last_peered":"2023-09-13T02:13:06.364390+0000","last_clean":"2023-09-13T02:13:06.364390+0000","last_became_active":"2023-09-13T02:12:23.579079+0000","last_became_peered":"2023-09-13T02:12:23.579079+0000","last_unstale":"2023-09-13T02:13:06.364390+0000","last_undegraded":"2023-09-13T02:13:06.364390+0000","last_fullsized":"2023-09-13T02:13:06.364390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:07.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'35","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378378+0000","last_change":"2023-09-13T02:12:24.587235+0000","last_active":"2023-09-13T02:13:26.378378+0000","last_peered":"2023-09-13T02:13:26.378378+0000","last_clean":"2023-09-13T02:13:26.378378+0000","last_became_active":"2023-09-13T02:12:24.586930+0000","last_became_peered":"2023-09-13T02:12:24.586930+0000","last_unstale":"2023-09-13T02:13:26.378378+0000","last_undegraded":"2023-09-13T02:13:26.378378+0000","last_fullsized":"2023-09-13T02:13:26.378378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.904408+0000","last_change":"2023-09-13T02:12:23.585680+0000","last_active":"2023-09-13T02:13:04.904408+0000","last_peered":"2023-09-13T02:13:04.904408+0000","last_clean":"2023-09-13T02:13:04.904408+0000","last_became_active":"2023-09-13T02:12:23.585417+0000","last_became_peered":"2023-09-13T02:12:23.585417+0000","last_unstale":"2023-09-13T02:13:04.904408+0000","last_undegraded":"2023-09-13T02:13:04.904408+0000","last_fullsized":"2023-09-13T02:13:04.904408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:03.890491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'46","reported_seq":59,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393959+0000","last_change":"2023-09-13T02:12:24.592703+0000","last_active":"2023-09-13T02:13:26.393959+0000","last_peered":"2023-09-13T02:13:26.393959+0000","last_clean":"2023-09-13T02:13:26.393959+0000","last_became_active":"2023-09-13T02:12:24.591849+0000","last_became_peered":"2023-09-13T02:12:24.591849+0000","last_unstale":"2023-09-13T02:13:26.393959+0000","last_undegraded":"2023-09-13T02:13:26.393959+0000","last_fullsized":"2023-09-13T02:13:26.393959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:17:30.897344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.363813+0000","last_change":"2023-09-13T02:12:23.576659+0000","last_active":"2023-09-13T02:13:05.363813+0000","last_peered":"2023-09-13T02:13:05.363813+0000","last_clean":"2023-09-13T02:13:05.363813+0000","last_became_active":"2023-09-13T02:12:23.576022+0000","last_became_peered":"2023-09-13T02:12:23.576022+0000","last_unstale":"2023-09-13T02:13:05.363813+0000","last_undegraded":"2023-09-13T02:13:05.363813+0000","last_fullsized":"2023-09-13T02:13:05.363813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:51.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'18","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382451+0000","last_change":"2023-09-13T02:12:24.591552+0000","last_active":"2023-09-13T02:13:26.382451+0000","last_peered":"2023-09-13T02:13:26.382451+0000","last_clean":"2023-09-13T02:13:26.382451+0000","last_became_active":"2023-09-13T02:12:24.591247+0000","last_became_peered":"2023-09-13T02:12:24.591247+0000","last_unstale":"2023-09-13T02:13:26.382451+0000","last_undegraded":"2023-09-13T02:13:26.382451+0000","last_fullsized":"2023-09-13T02:13:26.382451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'9","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.910464+0000","last_change":"2023-09-13T02:12:23.570753+0000","last_active":"2023-09-13T02:13:05.910464+0000","last_peered":"2023-09-13T02:13:05.910464+0000","last_clean":"2023-09-13T02:13:05.910464+0000","last_became_active":"2023-09-13T02:12:23.570461+0000","last_became_peered":"2023-09-13T02:12:23.570461+0000","last_unstale":"2023-09-13T02:13:05.910464+0000","last_undegraded":"2023-09-13T02:13:05.910464+0000","last_fullsized":"2023-09-13T02:13:05.910464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'18","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393593+0000","last_change":"2023-09-13T02:12:24.591474+0000","last_active":"2023-09-13T02:13:26.393593+0000","last_peered":"2023-09-13T02:13:26.393593+0000","last_clean":"2023-09-13T02:13:26.393593+0000","last_became_active":"2023-09-13T02:12:24.591036+0000","last_became_peered":"2023-09-13T02:12:24.591036+0000","last_unstale":"2023-09-13T02:13:26.393593+0000","last_undegraded":"2023-09-13T02:13:26.393593+0000","last_fullsized":"2023-09-13T02:13:26.393593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.273406+0000","last_change":"2023-09-13T02:12:23.584508+0000","last_active":"2023-09-13T02:13:05.273406+0000","last_peered":"2023-09-13T02:13:05.273406+0000","last_clean":"2023-09-13T02:13:05.273406+0000","last_became_active":"2023-09-13T02:12:23.584235+0000","last_became_peered":"2023-09-13T02:12:23.584235+0000","last_unstale":"2023-09-13T02:13:05.273406+0000","last_undegraded":"2023-09-13T02:13:05.273406+0000","last_fullsized":"2023-09-13T02:13:05.273406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'15","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393266+0000","last_change":"2023-09-13T02:12:24.593312+0000","last_active":"2023-09-13T02:13:26.393266+0000","last_peered":"2023-09-13T02:13:26.393266+0000","last_clean":"2023-09-13T02:13:26.393266+0000","last_became_active":"2023-09-13T02:12:24.592242+0000","last_became_peered":"2023-09-13T02:12:24.592242+0000","last_unstale":"2023-09-13T02:13:26.393266+0000","last_undegraded":"2023-09-13T02:13:26.393266+0000","last_fullsized":"2023-09-13T02:13:26.393266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:03:12.365120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.908624+0000","last_change":"2023-09-13T02:12:23.578204+0000","last_active":"2023-09-13T02:13:04.908624+0000","last_peered":"2023-09-13T02:13:04.908624+0000","last_clean":"2023-09-13T02:13:04.908624+0000","last_became_active":"2023-09-13T02:12:23.577918+0000","last_became_peered":"2023-09-13T02:12:23.577918+0000","last_unstale":"2023-09-13T02:13:04.908624+0000","last_undegraded":"2023-09-13T02:13:04.908624+0000","last_fullsized":"2023-09-13T02:13:04.908624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:24.826159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'27","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393646+0000","last_change":"2023-09-13T02:12:24.595748+0000","last_active":"2023-09-13T02:13:26.393646+0000","last_peered":"2023-09-13T02:13:26.393646+0000","last_clean":"2023-09-13T02:13:26.393646+0000","last_became_active":"2023-09-13T02:12:24.595462+0000","last_became_peered":"2023-09-13T02:12:24.595462+0000","last_unstale":"2023-09-13T02:13:26.393646+0000","last_undegraded":"2023-09-13T02:13:26.393646+0000","last_fullsized":"2023-09-13T02:13:26.393646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:52:10.210519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.905766+0000","last_change":"2023-09-13T02:12:23.570346+0000","last_active":"2023-09-13T02:13:04.905766+0000","last_peered":"2023-09-13T02:13:04.905766+0000","last_clean":"2023-09-13T02:13:04.905766+0000","last_became_active":"2023-09-13T02:12:23.570066+0000","last_became_peered":"2023-09-13T02:12:23.570066+0000","last_unstale":"2023-09-13T02:13:04.905766+0000","last_undegraded":"2023-09-13T02:13:04.905766+0000","last_fullsized":"2023-09-13T02:13:04.905766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:36.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'18","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382510+0000","last_change":"2023-09-13T02:12:24.595650+0000","last_active":"2023-09-13T02:13:26.382510+0000","last_peered":"2023-09-13T02:13:26.382510+0000","last_clean":"2023-09-13T02:13:26.382510+0000","last_became_active":"2023-09-13T02:12:24.595327+0000","last_became_peered":"2023-09-13T02:12:24.595327+0000","last_unstale":"2023-09-13T02:13:26.382510+0000","last_undegraded":"2023-09-13T02:13:26.382510+0000","last_fullsized":"2023-09-13T02:13:26.382510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:43:26.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.909441+0000","last_change":"2023-09-13T02:12:23.583113+0000","last_active":"2023-09-13T02:13:05.909441+0000","last_peered":"2023-09-13T02:13:05.909441+0000","last_clean":"2023-09-13T02:13:05.909441+0000","last_became_active":"2023-09-13T02:12:23.582841+0000","last_became_peered":"2023-09-13T02:12:23.582841+0000","last_unstale":"2023-09-13T02:13:05.909441+0000","last_undegraded":"2023-09-13T02:13:05.909441+0000","last_fullsized":"2023-09-13T02:13:05.909441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'22","reported_seq":35,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393154+0000","last_change":"2023-09-13T02:12:24.590616+0000","last_active":"2023-09-13T02:13:26.393154+0000","last_peered":"2023-09-13T02:13:26.393154+0000","last_clean":"2023-09-13T02:13:26.393154+0000","last_became_active":"2023-09-13T02:12:24.590343+0000","last_became_peered":"2023-09-13T02:12:24.590343+0000","last_unstale":"2023-09-13T02:13:26.393154+0000","last_undegraded":"2023-09-13T02:13:26.393154+0000","last_fullsized":"2023-09-13T02:13:26.393154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:15.126313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.363945+0000","last_change":"2023-09-13T02:12:13.261542+0000","last_active":"2023-09-13T02:13:05.363945+0000","last_peered":"2023-09-13T02:13:05.363945+0000","last_clean":"2023-09-13T02:13:05.363945+0000","last_became_active":"2023-09-13T02:12:13.260630+0000","last_became_peered":"2023-09-13T02:12:13.260630+0000","last_unstale":"2023-09-13T02:13:05.363945+0000","last_undegraded":"2023-09-13T02:13:05.363945+0000","last_fullsized":"2023-09-13T02:13:05.363945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:12.209844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:12.209844+0000","last_clean_scrub_stamp":"2023-09-13T02:12:12.209844+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:07:47.139624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.903886+0000","last_change":"2023-09-13T02:12:23.584227+0000","last_active":"2023-09-13T02:13:04.903886+0000","last_peered":"2023-09-13T02:13:04.903886+0000","last_clean":"2023-09-13T02:13:04.903886+0000","last_became_active":"2023-09-13T02:12:23.583874+0000","last_became_peered":"2023-09-13T02:12:23.583874+0000","last_unstale":"2023-09-13T02:13:04.903886+0000","last_undegraded":"2023-09-13T02:13:04.903886+0000","last_fullsized":"2023-09-13T02:13:04.903886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'24","reported_seq":44,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.373186+0000","last_change":"2023-09-13T02:13:05.919047+0000","last_active":"2023-09-13T02:13:26.373186+0000","last_peered":"2023-09-13T02:13:26.373186+0000","last_clean":"2023-09-13T02:13:26.373186+0000","last_became_active":"2023-09-13T02:13:05.918736+0000","last_became_peered":"2023-09-13T02:13:05.918736+0000","last_unstale":"2023-09-13T02:13:26.373186+0000","last_undegraded":"2023-09-13T02:13:26.373186+0000","last_fullsized":"2023-09-13T02:13:26.373186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:13:36.591729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364003+0000","last_change":"2023-09-13T02:12:23.580928+0000","last_active":"2023-09-13T02:13:06.364003+0000","last_peered":"2023-09-13T02:13:06.364003+0000","last_clean":"2023-09-13T02:13:06.364003+0000","last_became_active":"2023-09-13T02:12:23.580670+0000","last_became_peered":"2023-09-13T02:12:23.580670+0000","last_unstale":"2023-09-13T02:13:06.364003+0000","last_undegraded":"2023-09-13T02:13:06.364003+0000","last_fullsized":"2023-09-13T02:13:06.364003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'15","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.377687+0000","last_change":"2023-09-13T02:12:24.579008+0000","last_active":"2023-09-13T02:13:26.377687+0000","last_peered":"2023-09-13T02:13:26.377687+0000","last_clean":"2023-09-13T02:13:26.377687+0000","last_became_active":"2023-09-13T02:12:24.578715+0000","last_became_peered":"2023-09-13T02:12:24.578715+0000","last_unstale":"2023-09-13T02:13:26.377687+0000","last_undegraded":"2023-09-13T02:13:26.377687+0000","last_fullsized":"2023-09-13T02:13:26.377687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:04.894368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'10","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.885825+0000","last_change":"2023-09-13T02:12:23.578080+0000","last_active":"2023-09-13T02:13:26.885825+0000","last_peered":"2023-09-13T02:13:26.885825+0000","last_clean":"2023-09-13T02:13:26.885825+0000","last_became_active":"2023-09-13T02:12:23.577786+0000","last_became_peered":"2023-09-13T02:12:23.577786+0000","last_unstale":"2023-09-13T02:13:26.885825+0000","last_undegraded":"2023-09-13T02:13:26.885825+0000","last_fullsized":"2023-09-13T02:13:26.885825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:51.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4747,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":12,"num_write":9,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'26","reported_seq":39,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.376423+0000","last_change":"2023-09-13T02:12:24.582717+0000","last_active":"2023-09-13T02:13:26.376423+0000","last_peered":"2023-09-13T02:13:26.376423+0000","last_clean":"2023-09-13T02:13:26.376423+0000","last_became_active":"2023-09-13T02:12:24.582439+0000","last_became_peered":"2023-09-13T02:12:24.582439+0000","last_unstale":"2023-09-13T02:13:26.376423+0000","last_undegraded":"2023-09-13T02:13:26.376423+0000","last_fullsized":"2023-09-13T02:13:26.376423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.904406+0000","last_change":"2023-09-13T02:12:23.585601+0000","last_active":"2023-09-13T02:13:04.904406+0000","last_peered":"2023-09-13T02:13:04.904406+0000","last_clean":"2023-09-13T02:13:04.904406+0000","last_became_active":"2023-09-13T02:12:23.585349+0000","last_became_peered":"2023-09-13T02:12:23.585349+0000","last_unstale":"2023-09-13T02:13:04.904406+0000","last_undegraded":"2023-09-13T02:13:04.904406+0000","last_fullsized":"2023-09-13T02:13:04.904406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:38.820251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'21","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.366251+0000","last_change":"2023-09-13T02:12:24.586175+0000","last_active":"2023-09-13T02:13:26.366251+0000","last_peered":"2023-09-13T02:13:26.366251+0000","last_clean":"2023-09-13T02:13:26.366251+0000","last_became_active":"2023-09-13T02:12:24.585054+0000","last_became_peered":"2023-09-13T02:12:24.585054+0000","last_unstale":"2023-09-13T02:13:26.366251+0000","last_undegraded":"2023-09-13T02:13:26.366251+0000","last_fullsized":"2023-09-13T02:13:26.366251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:39.029452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.905876+0000","last_change":"2023-09-13T02:12:23.580143+0000","last_active":"2023-09-13T02:13:04.905876+0000","last_peered":"2023-09-13T02:13:04.905876+0000","last_clean":"2023-09-13T02:13:04.905876+0000","last_became_active":"2023-09-13T02:12:23.579844+0000","last_became_peered":"2023-09-13T02:12:23.579844+0000","last_unstale":"2023-09-13T02:13:04.905876+0000","last_undegraded":"2023-09-13T02:13:04.905876+0000","last_fullsized":"2023-09-13T02:13:04.905876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:21:49.468231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'20","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382294+0000","last_change":"2023-09-13T02:12:24.592756+0000","last_active":"2023-09-13T02:13:26.382294+0000","last_peered":"2023-09-13T02:13:26.382294+0000","last_clean":"2023-09-13T02:13:26.382294+0000","last_became_active":"2023-09-13T02:12:24.592436+0000","last_became_peered":"2023-09-13T02:12:24.592436+0000","last_unstale":"2023-09-13T02:13:26.382294+0000","last_undegraded":"2023-09-13T02:13:26.382294+0000","last_fullsized":"2023-09-13T02:13:26.382294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:03:12.365120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.364613+0000","last_change":"2023-09-13T02:12:23.585605+0000","last_active":"2023-09-13T02:13:05.364613+0000","last_peered":"2023-09-13T02:13:05.364613+0000","last_clean":"2023-09-13T02:13:05.364613+0000","last_became_active":"2023-09-13T02:12:23.585411+0000","last_became_peered":"2023-09-13T02:12:23.585411+0000","last_unstale":"2023-09-13T02:13:05.364613+0000","last_undegraded":"2023-09-13T02:13:05.364613+0000","last_fullsized":"2023-09-13T02:13:05.364613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:40.286050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.376926+0000","last_change":"2023-09-13T02:12:24.582796+0000","last_active":"2023-09-13T02:13:26.376926+0000","last_peered":"2023-09-13T02:13:26.376926+0000","last_clean":"2023-09-13T02:13:26.376926+0000","last_became_active":"2023-09-13T02:12:24.582517+0000","last_became_peered":"2023-09-13T02:12:24.582517+0000","last_unstale":"2023-09-13T02:13:26.376926+0000","last_undegraded":"2023-09-13T02:13:26.376926+0000","last_fullsized":"2023-09-13T02:13:26.376926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:17.890299+0000","last_change":"2023-09-13T02:12:23.576140+0000","last_active":"2023-09-13T02:13:17.890299+0000","last_peered":"2023-09-13T02:13:17.890299+0000","last_clean":"2023-09-13T02:13:17.890299+0000","last_became_active":"2023-09-13T02:12:23.575875+0000","last_became_peered":"2023-09-13T02:12:23.575875+0000","last_unstale":"2023-09-13T02:13:17.890299+0000","last_undegraded":"2023-09-13T02:13:17.890299+0000","last_fullsized":"2023-09-13T02:13:17.890299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:07.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'20","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.381927+0000","last_change":"2023-09-13T02:12:24.592556+0000","last_active":"2023-09-13T02:13:26.381927+0000","last_peered":"2023-09-13T02:13:26.381927+0000","last_clean":"2023-09-13T02:13:26.381927+0000","last_became_active":"2023-09-13T02:12:24.592247+0000","last_became_peered":"2023-09-13T02:12:24.592247+0000","last_unstale":"2023-09-13T02:13:26.381927+0000","last_undegraded":"2023-09-13T02:13:26.381927+0000","last_fullsized":"2023-09-13T02:13:26.381927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:17.903307+0000","last_change":"2023-09-13T02:12:23.579687+0000","last_active":"2023-09-13T02:13:17.903307+0000","last_peered":"2023-09-13T02:13:17.903307+0000","last_clean":"2023-09-13T02:13:17.903307+0000","last_became_active":"2023-09-13T02:12:23.579389+0000","last_became_peered":"2023-09-13T02:12:23.579389+0000","last_unstale":"2023-09-13T02:13:17.903307+0000","last_undegraded":"2023-09-13T02:13:17.903307+0000","last_fullsized":"2023-09-13T02:13:17.903307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'21","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.372849+0000","last_change":"2023-09-13T02:12:24.585029+0000","last_active":"2023-09-13T02:13:26.372849+0000","last_peered":"2023-09-13T02:13:26.372849+0000","last_clean":"2023-09-13T02:13:26.372849+0000","last_became_active":"2023-09-13T02:12:24.584791+0000","last_became_peered":"2023-09-13T02:12:24.584791+0000","last_unstale":"2023-09-13T02:13:26.372849+0000","last_undegraded":"2023-09-13T02:13:26.372849+0000","last_fullsized":"2023-09-13T02:13:26.372849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.363984+0000","last_change":"2023-09-13T02:12:23.585601+0000","last_active":"2023-09-13T02:13:06.363984+0000","last_peered":"2023-09-13T02:13:06.363984+0000","last_clean":"2023-09-13T02:13:06.363984+0000","last_became_active":"2023-09-13T02:12:23.585321+0000","last_became_peered":"2023-09-13T02:12:23.585321+0000","last_unstale":"2023-09-13T02:13:06.363984+0000","last_undegraded":"2023-09-13T02:13:06.363984+0000","last_fullsized":"2023-09-13T02:13:06.363984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'7","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:23.884799+0000","last_change":"2023-09-13T02:12:24.586947+0000","last_active":"2023-09-13T02:13:23.884799+0000","last_peered":"2023-09-13T02:13:23.884799+0000","last_clean":"2023-09-13T02:13:23.884799+0000","last_became_active":"2023-09-13T02:12:24.586072+0000","last_became_peered":"2023-09-13T02:12:24.586072+0000","last_unstale":"2023-09-13T02:13:23.884799+0000","last_undegraded":"2023-09-13T02:13:23.884799+0000","last_fullsized":"2023-09-13T02:13:23.884799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:50.824236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.905358+0000","last_change":"2023-09-13T02:12:23.578914+0000","last_active":"2023-09-13T02:13:04.905358+0000","last_peered":"2023-09-13T02:13:04.905358+0000","last_clean":"2023-09-13T02:13:04.905358+0000","last_became_active":"2023-09-13T02:12:23.578649+0000","last_became_peered":"2023-09-13T02:12:23.578649+0000","last_unstale":"2023-09-13T02:13:04.905358+0000","last_undegraded":"2023-09-13T02:13:04.905358+0000","last_fullsized":"2023-09-13T02:13:04.905358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'27","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.375269+0000","last_change":"2023-09-13T02:13:05.914293+0000","last_active":"2023-09-13T02:13:26.375269+0000","last_peered":"2023-09-13T02:13:26.375269+0000","last_clean":"2023-09-13T02:13:26.375269+0000","last_became_active":"2023-09-13T02:13:05.914007+0000","last_became_peered":"2023-09-13T02:13:05.914007+0000","last_unstale":"2023-09-13T02:13:26.375269+0000","last_undegraded":"2023-09-13T02:13:26.375269+0000","last_fullsized":"2023-09-13T02:13:26.375269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:25:19.651146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.909740+0000","last_change":"2023-09-13T02:12:23.578387+0000","last_active":"2023-09-13T02:13:05.909740+0000","last_peered":"2023-09-13T02:13:05.909740+0000","last_clean":"2023-09-13T02:13:05.909740+0000","last_became_active":"2023-09-13T02:12:23.578121+0000","last_became_peered":"2023-09-13T02:12:23.578121+0000","last_unstale":"2023-09-13T02:13:05.909740+0000","last_undegraded":"2023-09-13T02:13:05.909740+0000","last_fullsized":"2023-09-13T02:13:05.909740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:32.660244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'27","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.379504+0000","last_change":"2023-09-13T02:12:24.587304+0000","last_active":"2023-09-13T02:13:26.379504+0000","last_peered":"2023-09-13T02:13:26.379504+0000","last_clean":"2023-09-13T02:13:26.379504+0000","last_became_active":"2023-09-13T02:12:24.587040+0000","last_became_peered":"2023-09-13T02:12:24.587040+0000","last_unstale":"2023-09-13T02:13:26.379504+0000","last_undegraded":"2023-09-13T02:13:26.379504+0000","last_fullsized":"2023-09-13T02:13:26.379504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:18.256464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364322+0000","last_change":"2023-09-13T02:12:23.578623+0000","last_active":"2023-09-13T02:13:06.364322+0000","last_peered":"2023-09-13T02:13:06.364322+0000","last_clean":"2023-09-13T02:13:06.364322+0000","last_became_active":"2023-09-13T02:12:23.578258+0000","last_became_peered":"2023-09-13T02:12:23.578258+0000","last_unstale":"2023-09-13T02:13:06.364322+0000","last_undegraded":"2023-09-13T02:13:06.364322+0000","last_fullsized":"2023-09-13T02:13:06.364322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:18:54.951761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'15","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.380766+0000","last_change":"2023-09-13T02:12:24.590763+0000","last_active":"2023-09-13T02:13:26.380766+0000","last_peered":"2023-09-13T02:13:26.380766+0000","last_clean":"2023-09-13T02:13:26.380766+0000","last_became_active":"2023-09-13T02:12:24.590494+0000","last_became_peered":"2023-09-13T02:12:24.590494+0000","last_unstale":"2023-09-13T02:13:26.380766+0000","last_undegraded":"2023-09-13T02:13:26.380766+0000","last_fullsized":"2023-09-13T02:13:26.380766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'45","reported_seq":58,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382151+0000","last_change":"2023-09-13T02:12:24.597290+0000","last_active":"2023-09-13T02:13:26.382151+0000","last_peered":"2023-09-13T02:13:26.382151+0000","last_clean":"2023-09-13T02:13:26.382151+0000","last_became_active":"2023-09-13T02:12:24.597024+0000","last_became_peered":"2023-09-13T02:12:24.597024+0000","last_unstale":"2023-09-13T02:13:26.382151+0000","last_undegraded":"2023-09-13T02:13:26.382151+0000","last_fullsized":"2023-09-13T02:13:26.382151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:15.126313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.364323+0000","last_change":"2023-09-13T02:12:23.584941+0000","last_active":"2023-09-13T02:13:05.364323+0000","last_peered":"2023-09-13T02:13:05.364323+0000","last_clean":"2023-09-13T02:13:05.364323+0000","last_became_active":"2023-09-13T02:12:23.584671+0000","last_became_peered":"2023-09-13T02:12:23.584671+0000","last_unstale":"2023-09-13T02:13:05.364323+0000","last_undegraded":"2023-09-13T02:13:05.364323+0000","last_fullsized":"2023-09-13T02:13:05.364323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:38.089400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'27","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382018+0000","last_change":"2023-09-13T02:12:24.596615+0000","last_active":"2023-09-13T02:13:26.382018+0000","last_peered":"2023-09-13T02:13:26.382018+0000","last_clean":"2023-09-13T02:13:26.382018+0000","last_became_active":"2023-09-13T02:12:24.595918+0000","last_became_peered":"2023-09-13T02:12:24.595918+0000","last_unstale":"2023-09-13T02:13:26.382018+0000","last_undegraded":"2023-09-13T02:13:26.382018+0000","last_fullsized":"2023-09-13T02:13:26.382018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:18:08.378805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364450+0000","last_change":"2023-09-13T02:12:23.579507+0000","last_active":"2023-09-13T02:13:06.364450+0000","last_peered":"2023-09-13T02:13:06.364450+0000","last_clean":"2023-09-13T02:13:06.364450+0000","last_became_active":"2023-09-13T02:12:23.579239+0000","last_became_peered":"2023-09-13T02:12:23.579239+0000","last_unstale":"2023-09-13T02:13:06.364450+0000","last_undegraded":"2023-09-13T02:13:06.364450+0000","last_fullsized":"2023-09-13T02:13:06.364450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:11.224076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'20","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.377093+0000","last_change":"2023-09-13T02:12:24.589292+0000","last_active":"2023-09-13T02:13:26.377093+0000","last_peered":"2023-09-13T02:13:26.377093+0000","last_clean":"2023-09-13T02:13:26.377093+0000","last_became_active":"2023-09-13T02:12:24.589039+0000","last_became_peered":"2023-09-13T02:12:24.589039+0000","last_unstale":"2023-09-13T02:13:26.377093+0000","last_undegraded":"2023-09-13T02:13:26.377093+0000","last_fullsized":"2023-09-13T02:13:26.377093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.914584+0000","last_change":"2023-09-13T02:12:23.584177+0000","last_active":"2023-09-13T02:13:05.914584+0000","last_peered":"2023-09-13T02:13:05.914584+0000","last_clean":"2023-09-13T02:13:05.914584+0000","last_became_active":"2023-09-13T02:12:23.583920+0000","last_became_peered":"2023-09-13T02:12:23.583920+0000","last_unstale":"2023-09-13T02:13:05.914584+0000","last_undegraded":"2023-09-13T02:13:05.914584+0000","last_fullsized":"2023-09-13T02:13:05.914584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:21:49.468231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'15","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.374143+0000","last_change":"2023-09-13T02:12:24.588205+0000","last_active":"2023-09-13T02:13:26.374143+0000","last_peered":"2023-09-13T02:13:26.374143+0000","last_clean":"2023-09-13T02:13:26.374143+0000","last_became_active":"2023-09-13T02:12:24.587697+0000","last_became_peered":"2023-09-13T02:12:24.587697+0000","last_unstale":"2023-09-13T02:13:26.374143+0000","last_undegraded":"2023-09-13T02:13:26.374143+0000","last_fullsized":"2023-09-13T02:13:26.374143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364646+0000","last_change":"2023-09-13T02:12:23.583748+0000","last_active":"2023-09-13T02:13:06.364646+0000","last_peered":"2023-09-13T02:13:06.364646+0000","last_clean":"2023-09-13T02:13:06.364646+0000","last_became_active":"2023-09-13T02:12:23.583443+0000","last_became_peered":"2023-09-13T02:12:23.583443+0000","last_unstale":"2023-09-13T02:13:06.364646+0000","last_undegraded":"2023-09-13T02:13:06.364646+0000","last_fullsized":"2023-09-13T02:13:06.364646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":26,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1567,"ondisk_log_size":1567,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":405856,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":9,"num_read_kb":12,"num_write":160,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":876544,"data_stored":811712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":171,"ondisk_log_size":171,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":831488,"data_stored":674158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.63600000000000001}]},{"osd":1,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.68100000000000005}]},{"osd":2,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.752},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.69299999999999995}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.504}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.52500000000000002}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.47699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":638976,"data_stored":483515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.498},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.432}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.44700000000000001}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.55100000000000005}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.52900000000000003}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.47999999999999998}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.372},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.32600000000000001}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.45700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":83294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.439}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.495}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.54500000000000004}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.621},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.58799999999999997}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.70499999999999996}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.76200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":83343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.54600000000000004}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.67200000000000004}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.57199999999999995}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.61599999999999999}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.45100000000000001}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.42199999999999999}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":647168,"data_stored":486953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.27800000000000002}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.318}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.38500000000000001}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.73399999999999999}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.56499999999999995}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.628},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.65900000000000003}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.71399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":86650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.29399999999999998}]},{"osd":1,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.254},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.26700000000000002}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.28100000000000003}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.311},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48599999999999999}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.504},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.33100000000000002}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.35899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":83385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.31900000000000001}]},{"osd":2,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.374},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.41499999999999998}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.39900000000000002}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.64000000000000001}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.61899999999999999}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.67100000000000004}]},{"osd":7,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":835584,"data_stored":673195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.29799999999999999}]},{"osd":2,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.33600000000000002}]},{"osd":3,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.32200000000000001}]},{"osd":4,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.65400000000000003}]},{"osd":5,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55300000000000005}]},{"osd":6,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.625},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.745}]},{"osd":7,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":4747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":405058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":400311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T02:13:30.993 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-13T02:13:30.993 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T02:13:31.129 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.129+0000 7f218a882640 1 -- 172.21.15.104:0/1255785322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f216c005380 msgr2=0x7f216c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:31.130 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.129+0000 7f218a882640 1 --2- 172.21.15.104:0/1255785322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f216c005380 0x7f216c00b980 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f217c009e20 tx=0x7f216c0057f0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.130 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.129+0000 7f218a882640 1 -- 172.21.15.104:0/1255785322 shutdown_connections 2023-09-13T02:13:31.130 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.129+0000 7f218a882640 1 --2- 172.21.15.104:0/1255785322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f216c005380 0x7f216c00b980 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.131 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.129+0000 7f218a882640 1 -- 172.21.15.104:0/1255785322 >> 172.21.15.104:0/1255785322 conn(0x7f21840b56f0 msgr2=0x7f21840b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:31.131 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.129+0000 7f218a882640 1 -- 172.21.15.104:0/1255785322 shutdown_connections 2023-09-13T02:13:31.131 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.129+0000 7f218a882640 1 -- 172.21.15.104:0/1255785322 wait complete. 2023-09-13T02:13:31.134 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.130+0000 7f218a882640 1 Processor -- start 2023-09-13T02:13:31.134 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.130+0000 7f218a882640 1 -- start start 2023-09-13T02:13:31.134 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f218a882640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f216c005380 0x7f21841db890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:31.135 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f218a882640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21841dbdd0 0x7f21841354b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:31.135 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f218a882640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21841dc250 0x7f21841359f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:31.135 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f218a882640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2184136af0 con 0x7f216c005380 2023-09-13T02:13:31.136 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f218a882640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2184136cd0 con 0x7f21841dc250 2023-09-13T02:13:31.136 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f218a882640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218413c990 con 0x7f21841dbdd0 2023-09-13T02:13:31.136 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f2183fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f216c005380 0x7f21841db890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:31.136 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f2183fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f216c005380 0x7f21841db890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49210/0 (socket says 172.21.15.104:49210) 2023-09-13T02:13:31.137 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f2183fff640 1 -- 172.21.15.104:0/3325091299 learned_addr learned my addr 172.21.15.104:0/3325091299 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:31.137 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f21837fe640 1 --2- 172.21.15.104:0/3325091299 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21841dbdd0 0x7f21841354b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:31.137 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f2183fff640 1 -- 172.21.15.104:0/3325091299 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21841dbdd0 msgr2=0x7f21841354b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:31.138 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f2183fff640 1 --2- 172.21.15.104:0/3325091299 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21841dbdd0 0x7f21841354b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.138 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f2183fff640 1 -- 172.21.15.104:0/3325091299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21841dc250 msgr2=0x7f21841359f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:31.138 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f2183fff640 1 --2- 172.21.15.104:0/3325091299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21841dc250 0x7f21841359f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.138 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f2183fff640 1 -- 172.21.15.104:0/3325091299 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21841379e0 con 0x7f216c005380 2023-09-13T02:13:31.139 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f2183fff640 1 --2- 172.21.15.104:0/3325091299 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f216c005380 0x7f21841db890 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2174004d20 tx=0x7f2174001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:31.139 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f2180ff9640 1 -- 172.21.15.104:0/3325091299 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174016030 con 0x7f216c005380 2023-09-13T02:13:31.139 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f2180ff9640 1 -- 172.21.15.104:0/3325091299 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f21740108c0 con 0x7f216c005380 2023-09-13T02:13:31.140 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f218a882640 1 -- 172.21.15.104:0/3325091299 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2184138020 con 0x7f216c005380 2023-09-13T02:13:31.140 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f2180ff9640 1 -- 172.21.15.104:0/3325091299 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174010c90 con 0x7f216c005380 2023-09-13T02:13:31.140 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.131+0000 7f218a882640 1 -- 172.21.15.104:0/3325091299 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2184071290 con 0x7f216c005380 2023-09-13T02:13:31.140 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.132+0000 7f218a882640 1 -- 172.21.15.104:0/3325091299 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218404e100 con 0x7f216c005380 2023-09-13T02:13:31.141 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.133+0000 7f2180ff9640 1 -- 172.21.15.104:0/3325091299 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f2174019070 con 0x7f216c005380 2023-09-13T02:13:31.141 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.133+0000 7f2180ff9640 1 --2- 172.21.15.104:0/3325091299 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f217006a520 0x7f217006c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:31.141 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.133+0000 7f2180ff9640 1 -- 172.21.15.104:0/3325091299 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2174017070 con 0x7f216c005380 2023-09-13T02:13:31.142 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.133+0000 7f21837fe640 1 --2- 172.21.15.104:0/3325091299 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f217006a520 0x7f217006c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:31.142 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.134+0000 7f21837fe640 1 --2- 172.21.15.104:0/3325091299 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f217006a520 0x7f217006c9e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2178000fb0 tx=0x7f2178001170 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:31.142 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.137+0000 7f2180ff9640 1 -- 172.21.15.104:0/3325091299 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f21740544b0 con 0x7f216c005380 2023-09-13T02:13:31.298 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.298+0000 7f218a882640 1 -- 172.21.15.104:0/3325091299 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21840b1ee0 con 0x7f217006a520 2023-09-13T02:13:31.304 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.304+0000 7f2180ff9640 1 -- 172.21.15.104:0/3325091299 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289496 (secure 0 0 0) 0x7f2178004d90 con 0x7f217006a520 2023-09-13T02:13:31.307 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:13:31.309 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2023-09-13T02:13:31.311 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.307+0000 7f218a882640 1 -- 172.21.15.104:0/3325091299 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f217006a520 msgr2=0x7f217006c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:31.311 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.307+0000 7f218a882640 1 --2- 172.21.15.104:0/3325091299 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f217006a520 0x7f217006c9e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2178000fb0 tx=0x7f2178001170 comp rx=0 tx=0).stop 2023-09-13T02:13:31.311 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.307+0000 7f218a882640 1 -- 172.21.15.104:0/3325091299 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f216c005380 msgr2=0x7f21841db890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:31.312 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.307+0000 7f218a882640 1 --2- 172.21.15.104:0/3325091299 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f216c005380 0x7f21841db890 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2174004d20 tx=0x7f2174001630 comp rx=0 tx=0).stop 2023-09-13T02:13:31.312 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.307+0000 7f218a882640 1 -- 172.21.15.104:0/3325091299 shutdown_connections 2023-09-13T02:13:31.312 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.307+0000 7f218a882640 1 --2- 172.21.15.104:0/3325091299 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f217006a520 0x7f217006c9e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.312 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.307+0000 7f218a882640 1 --2- 172.21.15.104:0/3325091299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21841dc250 0x7f21841359f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.313 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.307+0000 7f218a882640 1 --2- 172.21.15.104:0/3325091299 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21841dbdd0 0x7f21841354b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.313 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.307+0000 7f218a882640 1 --2- 172.21.15.104:0/3325091299 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f216c005380 0x7f21841db890 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.313 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.307+0000 7f218a882640 1 -- 172.21.15.104:0/3325091299 >> 172.21.15.104:0/3325091299 conn(0x7f21840b56f0 msgr2=0x7f218413ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:31.314 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.308+0000 7f218a882640 1 -- 172.21.15.104:0/3325091299 shutdown_connections 2023-09-13T02:13:31.314 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.308+0000 7f218a882640 1 -- 172.21.15.104:0/3325091299 wait complete. 2023-09-13T02:13:31.318 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-09-13T02:13:30.044754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":996237,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":125,"num_read_kb":112,"num_write":362,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1855,"ondisk_log_size":1855,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219964,"kb_used_data":3836,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754756,"statfs":{"total":773094113280,"available":772868870144,"internally_reserved":0,"allocated":3928064,"data_stored":2654493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":403459,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":12,"num_write":158,"num_write_kb":486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003269"},"pg_stats":[{"pgid":"3.3f","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.388177+0000","last_change":"2023-09-13T02:12:24.593673+0000","last_active":"2023-09-13T02:13:26.388177+0000","last_peered":"2023-09-13T02:13:26.388177+0000","last_clean":"2023-09-13T02:13:26.388177+0000","last_became_active":"2023-09-13T02:12:24.592754+0000","last_became_peered":"2023-09-13T02:12:24.592754+0000","last_unstale":"2023-09-13T02:13:26.388177+0000","last_undegraded":"2023-09-13T02:13:26.388177+0000","last_fullsized":"2023-09-13T02:13:26.388177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:43:34.341442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'12","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.373777+0000","last_change":"2023-09-13T02:12:24.580108+0000","last_active":"2023-09-13T02:13:26.373777+0000","last_peered":"2023-09-13T02:13:26.373777+0000","last_clean":"2023-09-13T02:13:26.373777+0000","last_became_active":"2023-09-13T02:12:24.579873+0000","last_became_peered":"2023-09-13T02:12:24.579873+0000","last_unstale":"2023-09-13T02:13:26.373777+0000","last_undegraded":"2023-09-13T02:13:26.373777+0000","last_fullsized":"2023-09-13T02:13:26.373777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'23","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.376076+0000","last_change":"2023-09-13T02:12:24.584533+0000","last_active":"2023-09-13T02:13:26.376076+0000","last_peered":"2023-09-13T02:13:26.376076+0000","last_clean":"2023-09-13T02:13:26.376076+0000","last_became_active":"2023-09-13T02:12:24.584249+0000","last_became_peered":"2023-09-13T02:12:24.584249+0000","last_unstale":"2023-09-13T02:13:26.376076+0000","last_undegraded":"2023-09-13T02:13:26.376076+0000","last_fullsized":"2023-09-13T02:13:26.376076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.383220+0000","last_change":"2023-09-13T02:12:24.596092+0000","last_active":"2023-09-13T02:13:26.383220+0000","last_peered":"2023-09-13T02:13:26.383220+0000","last_clean":"2023-09-13T02:13:26.383220+0000","last_became_active":"2023-09-13T02:12:24.595817+0000","last_became_peered":"2023-09-13T02:12:24.595817+0000","last_unstale":"2023-09-13T02:13:26.383220+0000","last_undegraded":"2023-09-13T02:13:26.383220+0000","last_fullsized":"2023-09-13T02:13:26.383220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:15.246952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'12","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.385312+0000","last_change":"2023-09-13T02:12:24.592410+0000","last_active":"2023-09-13T02:13:26.385312+0000","last_peered":"2023-09-13T02:13:26.385312+0000","last_clean":"2023-09-13T02:13:26.385312+0000","last_became_active":"2023-09-13T02:12:24.591503+0000","last_became_peered":"2023-09-13T02:12:24.591503+0000","last_unstale":"2023-09-13T02:13:26.385312+0000","last_undegraded":"2023-09-13T02:13:26.385312+0000","last_fullsized":"2023-09-13T02:13:26.385312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:43:26.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'18","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.380748+0000","last_change":"2023-09-13T02:13:06.365480+0000","last_active":"2023-09-13T02:13:26.380748+0000","last_peered":"2023-09-13T02:13:26.380748+0000","last_clean":"2023-09-13T02:13:26.380748+0000","last_became_active":"2023-09-13T02:13:06.365133+0000","last_became_peered":"2023-09-13T02:13:06.365133+0000","last_unstale":"2023-09-13T02:13:26.380748+0000","last_undegraded":"2023-09-13T02:13:26.380748+0000","last_fullsized":"2023-09-13T02:13:26.380748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:04:53.013012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"22'16","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.381276+0000","last_change":"2023-09-13T02:12:24.591304+0000","last_active":"2023-09-13T02:13:26.381276+0000","last_peered":"2023-09-13T02:13:26.381276+0000","last_clean":"2023-09-13T02:13:26.381276+0000","last_became_active":"2023-09-13T02:12:24.590654+0000","last_became_peered":"2023-09-13T02:12:24.590654+0000","last_unstale":"2023-09-13T02:13:26.381276+0000","last_undegraded":"2023-09-13T02:13:26.381276+0000","last_fullsized":"2023-09-13T02:13:26.381276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:15.246952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'27","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382837+0000","last_change":"2023-09-13T02:12:24.588844+0000","last_active":"2023-09-13T02:13:26.382837+0000","last_peered":"2023-09-13T02:13:26.382837+0000","last_clean":"2023-09-13T02:13:26.382837+0000","last_became_active":"2023-09-13T02:12:24.588438+0000","last_became_peered":"2023-09-13T02:12:24.588438+0000","last_unstale":"2023-09-13T02:13:26.382837+0000","last_undegraded":"2023-09-13T02:13:26.382837+0000","last_fullsized":"2023-09-13T02:13:26.382837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:37.796406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'33","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393395+0000","last_change":"2023-09-13T02:12:24.589946+0000","last_active":"2023-09-13T02:13:26.393395+0000","last_peered":"2023-09-13T02:13:26.393395+0000","last_clean":"2023-09-13T02:13:26.393395+0000","last_became_active":"2023-09-13T02:12:24.589606+0000","last_became_peered":"2023-09-13T02:12:24.589606+0000","last_unstale":"2023-09-13T02:13:26.393395+0000","last_undegraded":"2023-09-13T02:13:26.393395+0000","last_fullsized":"2023-09-13T02:13:26.393395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:41.609166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.385472+0000","last_change":"2023-09-13T02:12:24.588874+0000","last_active":"2023-09-13T02:13:26.385472+0000","last_peered":"2023-09-13T02:13:26.385472+0000","last_clean":"2023-09-13T02:13:26.385472+0000","last_became_active":"2023-09-13T02:12:24.588522+0000","last_became_peered":"2023-09-13T02:12:24.588522+0000","last_unstale":"2023-09-13T02:13:26.385472+0000","last_undegraded":"2023-09-13T02:13:26.385472+0000","last_fullsized":"2023-09-13T02:13:26.385472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'18","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.384182+0000","last_change":"2023-09-13T02:12:24.589173+0000","last_active":"2023-09-13T02:13:26.384182+0000","last_peered":"2023-09-13T02:13:26.384182+0000","last_clean":"2023-09-13T02:13:26.384182+0000","last_became_active":"2023-09-13T02:12:24.588891+0000","last_became_peered":"2023-09-13T02:12:24.588891+0000","last_unstale":"2023-09-13T02:13:26.384182+0000","last_undegraded":"2023-09-13T02:13:26.384182+0000","last_fullsized":"2023-09-13T02:13:26.384182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'21","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378152+0000","last_change":"2023-09-13T02:12:24.587494+0000","last_active":"2023-09-13T02:13:26.378152+0000","last_peered":"2023-09-13T02:13:26.378152+0000","last_clean":"2023-09-13T02:13:26.378152+0000","last_became_active":"2023-09-13T02:12:24.587023+0000","last_became_peered":"2023-09-13T02:12:24.587023+0000","last_unstale":"2023-09-13T02:13:26.378152+0000","last_undegraded":"2023-09-13T02:13:26.378152+0000","last_fullsized":"2023-09-13T02:13:26.378152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:41.175280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378034+0000","last_change":"2023-09-13T02:12:24.588000+0000","last_active":"2023-09-13T02:13:26.378034+0000","last_peered":"2023-09-13T02:13:26.378034+0000","last_clean":"2023-09-13T02:13:26.378034+0000","last_became_active":"2023-09-13T02:12:24.587730+0000","last_became_peered":"2023-09-13T02:12:24.587730+0000","last_unstale":"2023-09-13T02:13:26.378034+0000","last_undegraded":"2023-09-13T02:13:26.378034+0000","last_fullsized":"2023-09-13T02:13:26.378034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'23","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.373720+0000","last_change":"2023-09-13T02:12:24.584985+0000","last_active":"2023-09-13T02:13:26.373720+0000","last_peered":"2023-09-13T02:13:26.373720+0000","last_clean":"2023-09-13T02:13:26.373720+0000","last_became_active":"2023-09-13T02:12:24.584734+0000","last_became_peered":"2023-09-13T02:12:24.584734+0000","last_unstale":"2023-09-13T02:13:26.373720+0000","last_undegraded":"2023-09-13T02:13:26.373720+0000","last_fullsized":"2023-09-13T02:13:26.373720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:37.796406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'23","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378365+0000","last_change":"2023-09-13T02:12:24.578832+0000","last_active":"2023-09-13T02:13:26.378365+0000","last_peered":"2023-09-13T02:13:26.378365+0000","last_clean":"2023-09-13T02:13:26.378365+0000","last_became_active":"2023-09-13T02:12:24.578553+0000","last_became_peered":"2023-09-13T02:12:24.578553+0000","last_unstale":"2023-09-13T02:13:26.378365+0000","last_undegraded":"2023-09-13T02:13:26.378365+0000","last_fullsized":"2023-09-13T02:13:26.378365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.381433+0000","last_change":"2023-09-13T02:12:24.591151+0000","last_active":"2023-09-13T02:13:26.381433+0000","last_peered":"2023-09-13T02:13:26.381433+0000","last_clean":"2023-09-13T02:13:26.381433+0000","last_became_active":"2023-09-13T02:12:24.590871+0000","last_became_peered":"2023-09-13T02:12:24.590871+0000","last_unstale":"2023-09-13T02:13:26.381433+0000","last_undegraded":"2023-09-13T02:13:26.381433+0000","last_fullsized":"2023-09-13T02:13:26.381433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.388169+0000","last_change":"2023-09-13T02:12:24.592615+0000","last_active":"2023-09-13T02:13:26.388169+0000","last_peered":"2023-09-13T02:13:26.388169+0000","last_clean":"2023-09-13T02:13:26.388169+0000","last_became_active":"2023-09-13T02:12:24.592325+0000","last_became_peered":"2023-09-13T02:12:24.592325+0000","last_unstale":"2023-09-13T02:13:26.388169+0000","last_undegraded":"2023-09-13T02:13:26.388169+0000","last_fullsized":"2023-09-13T02:13:26.388169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:19:41.872878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'33","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.888218+0000","last_change":"2023-09-13T02:12:24.587859+0000","last_active":"2023-09-13T02:13:26.888218+0000","last_peered":"2023-09-13T02:13:26.888218+0000","last_clean":"2023-09-13T02:13:26.888218+0000","last_became_active":"2023-09-13T02:12:24.587552+0000","last_became_peered":"2023-09-13T02:12:24.587552+0000","last_unstale":"2023-09-13T02:13:26.888218+0000","last_undegraded":"2023-09-13T02:13:26.888218+0000","last_fullsized":"2023-09-13T02:13:26.888218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:39.029452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'23","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.387469+0000","last_change":"2023-09-13T02:12:24.591593+0000","last_active":"2023-09-13T02:13:26.387469+0000","last_peered":"2023-09-13T02:13:26.387469+0000","last_clean":"2023-09-13T02:13:26.387469+0000","last_became_active":"2023-09-13T02:12:24.590670+0000","last_became_peered":"2023-09-13T02:12:24.590670+0000","last_unstale":"2023-09-13T02:13:26.387469+0000","last_undegraded":"2023-09-13T02:13:26.387469+0000","last_fullsized":"2023-09-13T02:13:26.387469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:19:41.872878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'25","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378361+0000","last_change":"2023-09-13T02:12:24.593278+0000","last_active":"2023-09-13T02:13:26.378361+0000","last_peered":"2023-09-13T02:13:26.378361+0000","last_clean":"2023-09-13T02:13:26.378361+0000","last_became_active":"2023-09-13T02:12:24.591065+0000","last_became_peered":"2023-09-13T02:12:24.591065+0000","last_unstale":"2023-09-13T02:13:26.378361+0000","last_undegraded":"2023-09-13T02:13:26.378361+0000","last_fullsized":"2023-09-13T02:13:26.378361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'36","reported_seq":49,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378658+0000","last_change":"2023-09-13T02:12:24.587352+0000","last_active":"2023-09-13T02:13:26.378658+0000","last_peered":"2023-09-13T02:13:26.378658+0000","last_clean":"2023-09-13T02:13:26.378658+0000","last_became_active":"2023-09-13T02:12:24.586981+0000","last_became_peered":"2023-09-13T02:12:24.586981+0000","last_unstale":"2023-09-13T02:13:26.378658+0000","last_undegraded":"2023-09-13T02:13:26.378658+0000","last_fullsized":"2023-09-13T02:13:26.378658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.388258+0000","last_change":"2023-09-13T02:12:24.595423+0000","last_active":"2023-09-13T02:13:26.388258+0000","last_peered":"2023-09-13T02:13:26.388258+0000","last_clean":"2023-09-13T02:13:26.388258+0000","last_became_active":"2023-09-13T02:12:24.594351+0000","last_became_peered":"2023-09-13T02:12:24.594351+0000","last_unstale":"2023-09-13T02:13:26.388258+0000","last_undegraded":"2023-09-13T02:13:26.388258+0000","last_fullsized":"2023-09-13T02:13:26.388258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:18.256464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.379446+0000","last_change":"2023-09-13T02:12:24.590553+0000","last_active":"2023-09-13T02:13:26.379446+0000","last_peered":"2023-09-13T02:13:26.379446+0000","last_clean":"2023-09-13T02:13:26.379446+0000","last_became_active":"2023-09-13T02:12:24.590295+0000","last_became_peered":"2023-09-13T02:12:24.590295+0000","last_unstale":"2023-09-13T02:13:26.379446+0000","last_undegraded":"2023-09-13T02:13:26.379446+0000","last_fullsized":"2023-09-13T02:13:26.379446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.380900+0000","last_change":"2023-09-13T02:12:24.593925+0000","last_active":"2023-09-13T02:13:26.380900+0000","last_peered":"2023-09-13T02:13:26.380900+0000","last_clean":"2023-09-13T02:13:26.380900+0000","last_became_active":"2023-09-13T02:12:24.593673+0000","last_became_peered":"2023-09-13T02:12:24.593673+0000","last_unstale":"2023-09-13T02:13:26.380900+0000","last_undegraded":"2023-09-13T02:13:26.380900+0000","last_fullsized":"2023-09-13T02:13:26.380900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'8","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.888016+0000","last_change":"2023-09-13T02:12:24.590496+0000","last_active":"2023-09-13T02:13:26.888016+0000","last_peered":"2023-09-13T02:13:26.888016+0000","last_clean":"2023-09-13T02:13:26.888016+0000","last_became_active":"2023-09-13T02:12:24.590231+0000","last_became_peered":"2023-09-13T02:12:24.590231+0000","last_unstale":"2023-09-13T02:13:26.888016+0000","last_undegraded":"2023-09-13T02:13:26.888016+0000","last_fullsized":"2023-09-13T02:13:26.888016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'46","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.377698+0000","last_change":"2023-09-13T02:13:05.916706+0000","last_active":"2023-09-13T02:13:26.377698+0000","last_peered":"2023-09-13T02:13:26.377698+0000","last_clean":"2023-09-13T02:13:26.377698+0000","last_became_active":"2023-09-13T02:13:05.916435+0000","last_became_peered":"2023-09-13T02:13:05.916435+0000","last_unstale":"2023-09-13T02:13:26.377698+0000","last_undegraded":"2023-09-13T02:13:26.377698+0000","last_fullsized":"2023-09-13T02:13:26.377698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:39:21.058634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'18","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.377483+0000","last_change":"2023-09-13T02:12:24.584028+0000","last_active":"2023-09-13T02:13:26.377483+0000","last_peered":"2023-09-13T02:13:26.377483+0000","last_clean":"2023-09-13T02:13:26.377483+0000","last_became_active":"2023-09-13T02:12:24.583782+0000","last_became_peered":"2023-09-13T02:12:24.583782+0000","last_unstale":"2023-09-13T02:13:26.377483+0000","last_undegraded":"2023-09-13T02:13:26.377483+0000","last_fullsized":"2023-09-13T02:13:26.377483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'12","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.379349+0000","last_change":"2023-09-13T02:12:24.590548+0000","last_active":"2023-09-13T02:13:26.379349+0000","last_peered":"2023-09-13T02:13:26.379349+0000","last_clean":"2023-09-13T02:13:26.379349+0000","last_became_active":"2023-09-13T02:12:24.590189+0000","last_became_peered":"2023-09-13T02:12:24.590189+0000","last_unstale":"2023-09-13T02:13:26.379349+0000","last_undegraded":"2023-09-13T02:13:26.379349+0000","last_fullsized":"2023-09-13T02:13:26.379349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'21","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.376706+0000","last_change":"2023-09-13T02:12:24.583749+0000","last_active":"2023-09-13T02:13:26.376706+0000","last_peered":"2023-09-13T02:13:26.376706+0000","last_clean":"2023-09-13T02:13:26.376706+0000","last_became_active":"2023-09-13T02:12:24.583453+0000","last_became_peered":"2023-09-13T02:12:24.583453+0000","last_unstale":"2023-09-13T02:13:26.376706+0000","last_undegraded":"2023-09-13T02:13:26.376706+0000","last_fullsized":"2023-09-13T02:13:26.376706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.379356+0000","last_change":"2023-09-13T02:12:24.595007+0000","last_active":"2023-09-13T02:13:26.379356+0000","last_peered":"2023-09-13T02:13:26.379356+0000","last_clean":"2023-09-13T02:13:26.379356+0000","last_became_active":"2023-09-13T02:12:24.592875+0000","last_became_peered":"2023-09-13T02:12:24.592875+0000","last_unstale":"2023-09-13T02:13:26.379356+0000","last_undegraded":"2023-09-13T02:13:26.379356+0000","last_fullsized":"2023-09-13T02:13:26.379356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'36","reported_seq":49,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378778+0000","last_change":"2023-09-13T02:12:24.588586+0000","last_active":"2023-09-13T02:13:26.378778+0000","last_peered":"2023-09-13T02:13:26.378778+0000","last_clean":"2023-09-13T02:13:26.378778+0000","last_became_active":"2023-09-13T02:12:24.588173+0000","last_became_peered":"2023-09-13T02:12:24.588173+0000","last_unstale":"2023-09-13T02:13:26.378778+0000","last_undegraded":"2023-09-13T02:13:26.378778+0000","last_fullsized":"2023-09-13T02:13:26.378778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:50.824236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'27","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.383062+0000","last_change":"2023-09-13T02:12:24.590981+0000","last_active":"2023-09-13T02:13:26.383062+0000","last_peered":"2023-09-13T02:13:26.383062+0000","last_clean":"2023-09-13T02:13:26.383062+0000","last_became_active":"2023-09-13T02:12:24.590677+0000","last_became_peered":"2023-09-13T02:12:24.590677+0000","last_unstale":"2023-09-13T02:13:26.383062+0000","last_undegraded":"2023-09-13T02:13:26.383062+0000","last_fullsized":"2023-09-13T02:13:26.383062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'22","reported_seq":35,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.370221+0000","last_change":"2023-09-13T02:12:24.586738+0000","last_active":"2023-09-13T02:13:26.370221+0000","last_peered":"2023-09-13T02:13:26.370221+0000","last_clean":"2023-09-13T02:13:26.370221+0000","last_became_active":"2023-09-13T02:12:24.586251+0000","last_became_peered":"2023-09-13T02:12:24.586251+0000","last_unstale":"2023-09-13T02:13:26.370221+0000","last_undegraded":"2023-09-13T02:13:26.370221+0000","last_fullsized":"2023-09-13T02:13:26.370221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:25.830036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.914084+0000","last_change":"2023-09-13T02:12:23.579164+0000","last_active":"2023-09-13T02:13:05.914084+0000","last_peered":"2023-09-13T02:13:05.914084+0000","last_clean":"2023-09-13T02:13:05.914084+0000","last_became_active":"2023-09-13T02:12:23.578889+0000","last_became_peered":"2023-09-13T02:12:23.578889+0000","last_unstale":"2023-09-13T02:13:05.914084+0000","last_undegraded":"2023-09-13T02:13:05.914084+0000","last_fullsized":"2023-09-13T02:13:05.914084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.376150+0000","last_change":"2023-09-13T02:12:24.579559+0000","last_active":"2023-09-13T02:13:26.376150+0000","last_peered":"2023-09-13T02:13:26.376150+0000","last_clean":"2023-09-13T02:13:26.376150+0000","last_became_active":"2023-09-13T02:12:24.579243+0000","last_became_peered":"2023-09-13T02:12:24.579243+0000","last_unstale":"2023-09-13T02:13:26.376150+0000","last_undegraded":"2023-09-13T02:13:26.376150+0000","last_fullsized":"2023-09-13T02:13:26.376150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.364759+0000","last_change":"2023-09-13T02:12:23.577022+0000","last_active":"2023-09-13T02:13:05.364759+0000","last_peered":"2023-09-13T02:13:05.364759+0000","last_clean":"2023-09-13T02:13:05.364759+0000","last_became_active":"2023-09-13T02:12:23.576754+0000","last_became_peered":"2023-09-13T02:12:23.576754+0000","last_unstale":"2023-09-13T02:13:05.364759+0000","last_undegraded":"2023-09-13T02:13:05.364759+0000","last_fullsized":"2023-09-13T02:13:05.364759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:49.820358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:17.908498+0000","last_change":"2023-09-13T02:12:23.579634+0000","last_active":"2023-09-13T02:13:17.908498+0000","last_peered":"2023-09-13T02:13:17.908498+0000","last_clean":"2023-09-13T02:13:17.908498+0000","last_became_active":"2023-09-13T02:12:23.579351+0000","last_became_peered":"2023-09-13T02:12:23.579351+0000","last_unstale":"2023-09-13T02:13:17.908498+0000","last_undegraded":"2023-09-13T02:13:17.908498+0000","last_fullsized":"2023-09-13T02:13:17.908498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:24.826159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.379347+0000","last_change":"2023-09-13T02:12:24.590474+0000","last_active":"2023-09-13T02:13:26.379347+0000","last_peered":"2023-09-13T02:13:26.379347+0000","last_clean":"2023-09-13T02:13:26.379347+0000","last_became_active":"2023-09-13T02:12:24.590126+0000","last_became_peered":"2023-09-13T02:12:24.590126+0000","last_unstale":"2023-09-13T02:13:26.379347+0000","last_undegraded":"2023-09-13T02:13:26.379347+0000","last_fullsized":"2023-09-13T02:13:26.379347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.903735+0000","last_change":"2023-09-13T02:12:23.586264+0000","last_active":"2023-09-13T02:13:04.903735+0000","last_peered":"2023-09-13T02:13:04.903735+0000","last_clean":"2023-09-13T02:13:04.903735+0000","last_became_active":"2023-09-13T02:12:23.585953+0000","last_became_peered":"2023-09-13T02:12:23.585953+0000","last_unstale":"2023-09-13T02:13:04.903735+0000","last_undegraded":"2023-09-13T02:13:04.903735+0000","last_fullsized":"2023-09-13T02:13:04.903735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:27.359818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378167+0000","last_change":"2023-09-13T02:12:24.585138+0000","last_active":"2023-09-13T02:13:26.378167+0000","last_peered":"2023-09-13T02:13:26.378167+0000","last_clean":"2023-09-13T02:13:26.378167+0000","last_became_active":"2023-09-13T02:12:24.584901+0000","last_became_peered":"2023-09-13T02:12:24.584901+0000","last_unstale":"2023-09-13T02:13:26.378167+0000","last_undegraded":"2023-09-13T02:13:26.378167+0000","last_fullsized":"2023-09-13T02:13:26.378167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.912367+0000","last_change":"2023-09-13T02:12:23.583663+0000","last_active":"2023-09-13T02:13:05.912367+0000","last_peered":"2023-09-13T02:13:05.912367+0000","last_clean":"2023-09-13T02:13:05.912367+0000","last_became_active":"2023-09-13T02:12:23.583305+0000","last_became_peered":"2023-09-13T02:12:23.583305+0000","last_unstale":"2023-09-13T02:13:05.912367+0000","last_undegraded":"2023-09-13T02:13:05.912367+0000","last_fullsized":"2023-09-13T02:13:05.912367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:32.660244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.388445+0000","last_change":"2023-09-13T02:12:24.595264+0000","last_active":"2023-09-13T02:13:26.388445+0000","last_peered":"2023-09-13T02:13:26.388445+0000","last_clean":"2023-09-13T02:13:26.388445+0000","last_became_active":"2023-09-13T02:12:24.594434+0000","last_became_peered":"2023-09-13T02:12:24.594434+0000","last_unstale":"2023-09-13T02:13:26.388445+0000","last_undegraded":"2023-09-13T02:13:26.388445+0000","last_fullsized":"2023-09-13T02:13:26.388445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:17:30.897344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.042686+0000","last_change":"2023-09-13T02:12:23.584935+0000","last_active":"2023-09-13T02:13:06.042686+0000","last_peered":"2023-09-13T02:13:06.042686+0000","last_clean":"2023-09-13T02:13:06.042686+0000","last_became_active":"2023-09-13T02:12:23.584657+0000","last_became_peered":"2023-09-13T02:12:23.584657+0000","last_unstale":"2023-09-13T02:13:06.042686+0000","last_undegraded":"2023-09-13T02:13:06.042686+0000","last_fullsized":"2023-09-13T02:13:06.042686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:36.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'28","reported_seq":41,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.369701+0000","last_change":"2023-09-13T02:12:24.588694+0000","last_active":"2023-09-13T02:13:26.369701+0000","last_peered":"2023-09-13T02:13:26.369701+0000","last_clean":"2023-09-13T02:13:26.369701+0000","last_became_active":"2023-09-13T02:12:24.588455+0000","last_became_peered":"2023-09-13T02:12:24.588455+0000","last_unstale":"2023-09-13T02:13:26.369701+0000","last_undegraded":"2023-09-13T02:13:26.369701+0000","last_fullsized":"2023-09-13T02:13:26.369701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'10","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:25.893290+0000","last_change":"2023-09-13T02:12:23.582781+0000","last_active":"2023-09-13T02:13:25.893290+0000","last_peered":"2023-09-13T02:13:25.893290+0000","last_clean":"2023-09-13T02:13:25.893290+0000","last_became_active":"2023-09-13T02:12:23.582506+0000","last_became_peered":"2023-09-13T02:12:23.582506+0000","last_unstale":"2023-09-13T02:13:25.893290+0000","last_undegraded":"2023-09-13T02:13:25.893290+0000","last_fullsized":"2023-09-13T02:13:25.893290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:03.890491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'37","reported_seq":50,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.391591+0000","last_change":"2023-09-13T02:12:24.594514+0000","last_active":"2023-09-13T02:13:26.391591+0000","last_peered":"2023-09-13T02:13:26.391591+0000","last_clean":"2023-09-13T02:13:26.391591+0000","last_became_active":"2023-09-13T02:12:24.592367+0000","last_became_peered":"2023-09-13T02:12:24.592367+0000","last_unstale":"2023-09-13T02:13:26.391591+0000","last_undegraded":"2023-09-13T02:13:26.391591+0000","last_fullsized":"2023-09-13T02:13:26.391591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:08.045218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'101","reported_seq":115,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.395152+0000","last_change":"2023-09-13T02:12:23.579000+0000","last_active":"2023-09-13T02:13:26.395152+0000","last_peered":"2023-09-13T02:13:26.395152+0000","last_clean":"2023-09-13T02:13:26.395152+0000","last_became_active":"2023-09-13T02:12:23.578748+0000","last_became_peered":"2023-09-13T02:12:23.578748+0000","last_unstale":"2023-09-13T02:13:26.395152+0000","last_undegraded":"2023-09-13T02:13:26.395152+0000","last_fullsized":"2023-09-13T02:13:26.395152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:38.025574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400311,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'20","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.381851+0000","last_change":"2023-09-13T02:12:24.593514+0000","last_active":"2023-09-13T02:13:26.381851+0000","last_peered":"2023-09-13T02:13:26.381851+0000","last_clean":"2023-09-13T02:13:26.381851+0000","last_became_active":"2023-09-13T02:12:24.593092+0000","last_became_peered":"2023-09-13T02:12:24.593092+0000","last_unstale":"2023-09-13T02:13:26.381851+0000","last_undegraded":"2023-09-13T02:13:26.381851+0000","last_fullsized":"2023-09-13T02:13:26.381851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:18:08.378805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364390+0000","last_change":"2023-09-13T02:12:23.579348+0000","last_active":"2023-09-13T02:13:06.364390+0000","last_peered":"2023-09-13T02:13:06.364390+0000","last_clean":"2023-09-13T02:13:06.364390+0000","last_became_active":"2023-09-13T02:12:23.579079+0000","last_became_peered":"2023-09-13T02:12:23.579079+0000","last_unstale":"2023-09-13T02:13:06.364390+0000","last_undegraded":"2023-09-13T02:13:06.364390+0000","last_fullsized":"2023-09-13T02:13:06.364390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:07.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'35","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.378378+0000","last_change":"2023-09-13T02:12:24.587235+0000","last_active":"2023-09-13T02:13:26.378378+0000","last_peered":"2023-09-13T02:13:26.378378+0000","last_clean":"2023-09-13T02:13:26.378378+0000","last_became_active":"2023-09-13T02:12:24.586930+0000","last_became_peered":"2023-09-13T02:12:24.586930+0000","last_unstale":"2023-09-13T02:13:26.378378+0000","last_undegraded":"2023-09-13T02:13:26.378378+0000","last_fullsized":"2023-09-13T02:13:26.378378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.904408+0000","last_change":"2023-09-13T02:12:23.585680+0000","last_active":"2023-09-13T02:13:04.904408+0000","last_peered":"2023-09-13T02:13:04.904408+0000","last_clean":"2023-09-13T02:13:04.904408+0000","last_became_active":"2023-09-13T02:12:23.585417+0000","last_became_peered":"2023-09-13T02:12:23.585417+0000","last_unstale":"2023-09-13T02:13:04.904408+0000","last_undegraded":"2023-09-13T02:13:04.904408+0000","last_fullsized":"2023-09-13T02:13:04.904408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:03.890491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'46","reported_seq":59,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393959+0000","last_change":"2023-09-13T02:12:24.592703+0000","last_active":"2023-09-13T02:13:26.393959+0000","last_peered":"2023-09-13T02:13:26.393959+0000","last_clean":"2023-09-13T02:13:26.393959+0000","last_became_active":"2023-09-13T02:12:24.591849+0000","last_became_peered":"2023-09-13T02:12:24.591849+0000","last_unstale":"2023-09-13T02:13:26.393959+0000","last_undegraded":"2023-09-13T02:13:26.393959+0000","last_fullsized":"2023-09-13T02:13:26.393959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:17:30.897344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.363813+0000","last_change":"2023-09-13T02:12:23.576659+0000","last_active":"2023-09-13T02:13:05.363813+0000","last_peered":"2023-09-13T02:13:05.363813+0000","last_clean":"2023-09-13T02:13:05.363813+0000","last_became_active":"2023-09-13T02:12:23.576022+0000","last_became_peered":"2023-09-13T02:12:23.576022+0000","last_unstale":"2023-09-13T02:13:05.363813+0000","last_undegraded":"2023-09-13T02:13:05.363813+0000","last_fullsized":"2023-09-13T02:13:05.363813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:51.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'18","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382451+0000","last_change":"2023-09-13T02:12:24.591552+0000","last_active":"2023-09-13T02:13:26.382451+0000","last_peered":"2023-09-13T02:13:26.382451+0000","last_clean":"2023-09-13T02:13:26.382451+0000","last_became_active":"2023-09-13T02:12:24.591247+0000","last_became_peered":"2023-09-13T02:12:24.591247+0000","last_unstale":"2023-09-13T02:13:26.382451+0000","last_undegraded":"2023-09-13T02:13:26.382451+0000","last_fullsized":"2023-09-13T02:13:26.382451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'9","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.910464+0000","last_change":"2023-09-13T02:12:23.570753+0000","last_active":"2023-09-13T02:13:05.910464+0000","last_peered":"2023-09-13T02:13:05.910464+0000","last_clean":"2023-09-13T02:13:05.910464+0000","last_became_active":"2023-09-13T02:12:23.570461+0000","last_became_peered":"2023-09-13T02:12:23.570461+0000","last_unstale":"2023-09-13T02:13:05.910464+0000","last_undegraded":"2023-09-13T02:13:05.910464+0000","last_fullsized":"2023-09-13T02:13:05.910464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'18","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393593+0000","last_change":"2023-09-13T02:12:24.591474+0000","last_active":"2023-09-13T02:13:26.393593+0000","last_peered":"2023-09-13T02:13:26.393593+0000","last_clean":"2023-09-13T02:13:26.393593+0000","last_became_active":"2023-09-13T02:12:24.591036+0000","last_became_peered":"2023-09-13T02:12:24.591036+0000","last_unstale":"2023-09-13T02:13:26.393593+0000","last_undegraded":"2023-09-13T02:13:26.393593+0000","last_fullsized":"2023-09-13T02:13:26.393593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.273406+0000","last_change":"2023-09-13T02:12:23.584508+0000","last_active":"2023-09-13T02:13:05.273406+0000","last_peered":"2023-09-13T02:13:05.273406+0000","last_clean":"2023-09-13T02:13:05.273406+0000","last_became_active":"2023-09-13T02:12:23.584235+0000","last_became_peered":"2023-09-13T02:12:23.584235+0000","last_unstale":"2023-09-13T02:13:05.273406+0000","last_undegraded":"2023-09-13T02:13:05.273406+0000","last_fullsized":"2023-09-13T02:13:05.273406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'15","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393266+0000","last_change":"2023-09-13T02:12:24.593312+0000","last_active":"2023-09-13T02:13:26.393266+0000","last_peered":"2023-09-13T02:13:26.393266+0000","last_clean":"2023-09-13T02:13:26.393266+0000","last_became_active":"2023-09-13T02:12:24.592242+0000","last_became_peered":"2023-09-13T02:12:24.592242+0000","last_unstale":"2023-09-13T02:13:26.393266+0000","last_undegraded":"2023-09-13T02:13:26.393266+0000","last_fullsized":"2023-09-13T02:13:26.393266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:03:12.365120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.908624+0000","last_change":"2023-09-13T02:12:23.578204+0000","last_active":"2023-09-13T02:13:04.908624+0000","last_peered":"2023-09-13T02:13:04.908624+0000","last_clean":"2023-09-13T02:13:04.908624+0000","last_became_active":"2023-09-13T02:12:23.577918+0000","last_became_peered":"2023-09-13T02:12:23.577918+0000","last_unstale":"2023-09-13T02:13:04.908624+0000","last_undegraded":"2023-09-13T02:13:04.908624+0000","last_fullsized":"2023-09-13T02:13:04.908624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:24.826159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'27","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393646+0000","last_change":"2023-09-13T02:12:24.595748+0000","last_active":"2023-09-13T02:13:26.393646+0000","last_peered":"2023-09-13T02:13:26.393646+0000","last_clean":"2023-09-13T02:13:26.393646+0000","last_became_active":"2023-09-13T02:12:24.595462+0000","last_became_peered":"2023-09-13T02:12:24.595462+0000","last_unstale":"2023-09-13T02:13:26.393646+0000","last_undegraded":"2023-09-13T02:13:26.393646+0000","last_fullsized":"2023-09-13T02:13:26.393646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:52:10.210519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.905766+0000","last_change":"2023-09-13T02:12:23.570346+0000","last_active":"2023-09-13T02:13:04.905766+0000","last_peered":"2023-09-13T02:13:04.905766+0000","last_clean":"2023-09-13T02:13:04.905766+0000","last_became_active":"2023-09-13T02:12:23.570066+0000","last_became_peered":"2023-09-13T02:12:23.570066+0000","last_unstale":"2023-09-13T02:13:04.905766+0000","last_undegraded":"2023-09-13T02:13:04.905766+0000","last_fullsized":"2023-09-13T02:13:04.905766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:36.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'18","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382510+0000","last_change":"2023-09-13T02:12:24.595650+0000","last_active":"2023-09-13T02:13:26.382510+0000","last_peered":"2023-09-13T02:13:26.382510+0000","last_clean":"2023-09-13T02:13:26.382510+0000","last_became_active":"2023-09-13T02:12:24.595327+0000","last_became_peered":"2023-09-13T02:12:24.595327+0000","last_unstale":"2023-09-13T02:13:26.382510+0000","last_undegraded":"2023-09-13T02:13:26.382510+0000","last_fullsized":"2023-09-13T02:13:26.382510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:43:26.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.909441+0000","last_change":"2023-09-13T02:12:23.583113+0000","last_active":"2023-09-13T02:13:05.909441+0000","last_peered":"2023-09-13T02:13:05.909441+0000","last_clean":"2023-09-13T02:13:05.909441+0000","last_became_active":"2023-09-13T02:12:23.582841+0000","last_became_peered":"2023-09-13T02:12:23.582841+0000","last_unstale":"2023-09-13T02:13:05.909441+0000","last_undegraded":"2023-09-13T02:13:05.909441+0000","last_fullsized":"2023-09-13T02:13:05.909441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'22","reported_seq":35,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.393154+0000","last_change":"2023-09-13T02:12:24.590616+0000","last_active":"2023-09-13T02:13:26.393154+0000","last_peered":"2023-09-13T02:13:26.393154+0000","last_clean":"2023-09-13T02:13:26.393154+0000","last_became_active":"2023-09-13T02:12:24.590343+0000","last_became_peered":"2023-09-13T02:12:24.590343+0000","last_unstale":"2023-09-13T02:13:26.393154+0000","last_undegraded":"2023-09-13T02:13:26.393154+0000","last_fullsized":"2023-09-13T02:13:26.393154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:15.126313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.363945+0000","last_change":"2023-09-13T02:12:13.261542+0000","last_active":"2023-09-13T02:13:05.363945+0000","last_peered":"2023-09-13T02:13:05.363945+0000","last_clean":"2023-09-13T02:13:05.363945+0000","last_became_active":"2023-09-13T02:12:13.260630+0000","last_became_peered":"2023-09-13T02:12:13.260630+0000","last_unstale":"2023-09-13T02:13:05.363945+0000","last_undegraded":"2023-09-13T02:13:05.363945+0000","last_fullsized":"2023-09-13T02:13:05.363945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:12.209844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:12.209844+0000","last_clean_scrub_stamp":"2023-09-13T02:12:12.209844+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:07:47.139624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.903886+0000","last_change":"2023-09-13T02:12:23.584227+0000","last_active":"2023-09-13T02:13:04.903886+0000","last_peered":"2023-09-13T02:13:04.903886+0000","last_clean":"2023-09-13T02:13:04.903886+0000","last_became_active":"2023-09-13T02:12:23.583874+0000","last_became_peered":"2023-09-13T02:12:23.583874+0000","last_unstale":"2023-09-13T02:13:04.903886+0000","last_undegraded":"2023-09-13T02:13:04.903886+0000","last_fullsized":"2023-09-13T02:13:04.903886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'24","reported_seq":44,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.373186+0000","last_change":"2023-09-13T02:13:05.919047+0000","last_active":"2023-09-13T02:13:26.373186+0000","last_peered":"2023-09-13T02:13:26.373186+0000","last_clean":"2023-09-13T02:13:26.373186+0000","last_became_active":"2023-09-13T02:13:05.918736+0000","last_became_peered":"2023-09-13T02:13:05.918736+0000","last_unstale":"2023-09-13T02:13:26.373186+0000","last_undegraded":"2023-09-13T02:13:26.373186+0000","last_fullsized":"2023-09-13T02:13:26.373186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:13:36.591729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364003+0000","last_change":"2023-09-13T02:12:23.580928+0000","last_active":"2023-09-13T02:13:06.364003+0000","last_peered":"2023-09-13T02:13:06.364003+0000","last_clean":"2023-09-13T02:13:06.364003+0000","last_became_active":"2023-09-13T02:12:23.580670+0000","last_became_peered":"2023-09-13T02:12:23.580670+0000","last_unstale":"2023-09-13T02:13:06.364003+0000","last_undegraded":"2023-09-13T02:13:06.364003+0000","last_fullsized":"2023-09-13T02:13:06.364003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'15","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.377687+0000","last_change":"2023-09-13T02:12:24.579008+0000","last_active":"2023-09-13T02:13:26.377687+0000","last_peered":"2023-09-13T02:13:26.377687+0000","last_clean":"2023-09-13T02:13:26.377687+0000","last_became_active":"2023-09-13T02:12:24.578715+0000","last_became_peered":"2023-09-13T02:12:24.578715+0000","last_unstale":"2023-09-13T02:13:26.377687+0000","last_undegraded":"2023-09-13T02:13:26.377687+0000","last_fullsized":"2023-09-13T02:13:26.377687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:04.894368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'10","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.885825+0000","last_change":"2023-09-13T02:12:23.578080+0000","last_active":"2023-09-13T02:13:26.885825+0000","last_peered":"2023-09-13T02:13:26.885825+0000","last_clean":"2023-09-13T02:13:26.885825+0000","last_became_active":"2023-09-13T02:12:23.577786+0000","last_became_peered":"2023-09-13T02:12:23.577786+0000","last_unstale":"2023-09-13T02:13:26.885825+0000","last_undegraded":"2023-09-13T02:13:26.885825+0000","last_fullsized":"2023-09-13T02:13:26.885825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:51.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4747,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":12,"num_write":9,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'26","reported_seq":39,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.376423+0000","last_change":"2023-09-13T02:12:24.582717+0000","last_active":"2023-09-13T02:13:26.376423+0000","last_peered":"2023-09-13T02:13:26.376423+0000","last_clean":"2023-09-13T02:13:26.376423+0000","last_became_active":"2023-09-13T02:12:24.582439+0000","last_became_peered":"2023-09-13T02:12:24.582439+0000","last_unstale":"2023-09-13T02:13:26.376423+0000","last_undegraded":"2023-09-13T02:13:26.376423+0000","last_fullsized":"2023-09-13T02:13:26.376423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.904406+0000","last_change":"2023-09-13T02:12:23.585601+0000","last_active":"2023-09-13T02:13:04.904406+0000","last_peered":"2023-09-13T02:13:04.904406+0000","last_clean":"2023-09-13T02:13:04.904406+0000","last_became_active":"2023-09-13T02:12:23.585349+0000","last_became_peered":"2023-09-13T02:12:23.585349+0000","last_unstale":"2023-09-13T02:13:04.904406+0000","last_undegraded":"2023-09-13T02:13:04.904406+0000","last_fullsized":"2023-09-13T02:13:04.904406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:38.820251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'21","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.366251+0000","last_change":"2023-09-13T02:12:24.586175+0000","last_active":"2023-09-13T02:13:26.366251+0000","last_peered":"2023-09-13T02:13:26.366251+0000","last_clean":"2023-09-13T02:13:26.366251+0000","last_became_active":"2023-09-13T02:12:24.585054+0000","last_became_peered":"2023-09-13T02:12:24.585054+0000","last_unstale":"2023-09-13T02:13:26.366251+0000","last_undegraded":"2023-09-13T02:13:26.366251+0000","last_fullsized":"2023-09-13T02:13:26.366251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:39.029452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.905876+0000","last_change":"2023-09-13T02:12:23.580143+0000","last_active":"2023-09-13T02:13:04.905876+0000","last_peered":"2023-09-13T02:13:04.905876+0000","last_clean":"2023-09-13T02:13:04.905876+0000","last_became_active":"2023-09-13T02:12:23.579844+0000","last_became_peered":"2023-09-13T02:12:23.579844+0000","last_unstale":"2023-09-13T02:13:04.905876+0000","last_undegraded":"2023-09-13T02:13:04.905876+0000","last_fullsized":"2023-09-13T02:13:04.905876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:21:49.468231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'20","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382294+0000","last_change":"2023-09-13T02:12:24.592756+0000","last_active":"2023-09-13T02:13:26.382294+0000","last_peered":"2023-09-13T02:13:26.382294+0000","last_clean":"2023-09-13T02:13:26.382294+0000","last_became_active":"2023-09-13T02:12:24.592436+0000","last_became_peered":"2023-09-13T02:12:24.592436+0000","last_unstale":"2023-09-13T02:13:26.382294+0000","last_undegraded":"2023-09-13T02:13:26.382294+0000","last_fullsized":"2023-09-13T02:13:26.382294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:03:12.365120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.364613+0000","last_change":"2023-09-13T02:12:23.585605+0000","last_active":"2023-09-13T02:13:05.364613+0000","last_peered":"2023-09-13T02:13:05.364613+0000","last_clean":"2023-09-13T02:13:05.364613+0000","last_became_active":"2023-09-13T02:12:23.585411+0000","last_became_peered":"2023-09-13T02:12:23.585411+0000","last_unstale":"2023-09-13T02:13:05.364613+0000","last_undegraded":"2023-09-13T02:13:05.364613+0000","last_fullsized":"2023-09-13T02:13:05.364613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:40.286050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'30","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.376926+0000","last_change":"2023-09-13T02:12:24.582796+0000","last_active":"2023-09-13T02:13:26.376926+0000","last_peered":"2023-09-13T02:13:26.376926+0000","last_clean":"2023-09-13T02:13:26.376926+0000","last_became_active":"2023-09-13T02:12:24.582517+0000","last_became_peered":"2023-09-13T02:12:24.582517+0000","last_unstale":"2023-09-13T02:13:26.376926+0000","last_undegraded":"2023-09-13T02:13:26.376926+0000","last_fullsized":"2023-09-13T02:13:26.376926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:17.890299+0000","last_change":"2023-09-13T02:12:23.576140+0000","last_active":"2023-09-13T02:13:17.890299+0000","last_peered":"2023-09-13T02:13:17.890299+0000","last_clean":"2023-09-13T02:13:17.890299+0000","last_became_active":"2023-09-13T02:12:23.575875+0000","last_became_peered":"2023-09-13T02:12:23.575875+0000","last_unstale":"2023-09-13T02:13:17.890299+0000","last_undegraded":"2023-09-13T02:13:17.890299+0000","last_fullsized":"2023-09-13T02:13:17.890299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:07.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'20","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.381927+0000","last_change":"2023-09-13T02:12:24.592556+0000","last_active":"2023-09-13T02:13:26.381927+0000","last_peered":"2023-09-13T02:13:26.381927+0000","last_clean":"2023-09-13T02:13:26.381927+0000","last_became_active":"2023-09-13T02:12:24.592247+0000","last_became_peered":"2023-09-13T02:12:24.592247+0000","last_unstale":"2023-09-13T02:13:26.381927+0000","last_undegraded":"2023-09-13T02:13:26.381927+0000","last_fullsized":"2023-09-13T02:13:26.381927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:17.903307+0000","last_change":"2023-09-13T02:12:23.579687+0000","last_active":"2023-09-13T02:13:17.903307+0000","last_peered":"2023-09-13T02:13:17.903307+0000","last_clean":"2023-09-13T02:13:17.903307+0000","last_became_active":"2023-09-13T02:12:23.579389+0000","last_became_peered":"2023-09-13T02:12:23.579389+0000","last_unstale":"2023-09-13T02:13:17.903307+0000","last_undegraded":"2023-09-13T02:13:17.903307+0000","last_fullsized":"2023-09-13T02:13:17.903307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'21","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.372849+0000","last_change":"2023-09-13T02:12:24.585029+0000","last_active":"2023-09-13T02:13:26.372849+0000","last_peered":"2023-09-13T02:13:26.372849+0000","last_clean":"2023-09-13T02:13:26.372849+0000","last_became_active":"2023-09-13T02:12:24.584791+0000","last_became_peered":"2023-09-13T02:12:24.584791+0000","last_unstale":"2023-09-13T02:13:26.372849+0000","last_undegraded":"2023-09-13T02:13:26.372849+0000","last_fullsized":"2023-09-13T02:13:26.372849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.363984+0000","last_change":"2023-09-13T02:12:23.585601+0000","last_active":"2023-09-13T02:13:06.363984+0000","last_peered":"2023-09-13T02:13:06.363984+0000","last_clean":"2023-09-13T02:13:06.363984+0000","last_became_active":"2023-09-13T02:12:23.585321+0000","last_became_peered":"2023-09-13T02:12:23.585321+0000","last_unstale":"2023-09-13T02:13:06.363984+0000","last_undegraded":"2023-09-13T02:13:06.363984+0000","last_fullsized":"2023-09-13T02:13:06.363984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'7","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:23.884799+0000","last_change":"2023-09-13T02:12:24.586947+0000","last_active":"2023-09-13T02:13:23.884799+0000","last_peered":"2023-09-13T02:13:23.884799+0000","last_clean":"2023-09-13T02:13:23.884799+0000","last_became_active":"2023-09-13T02:12:24.586072+0000","last_became_peered":"2023-09-13T02:12:24.586072+0000","last_unstale":"2023-09-13T02:13:23.884799+0000","last_undegraded":"2023-09-13T02:13:23.884799+0000","last_fullsized":"2023-09-13T02:13:23.884799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:50.824236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.905358+0000","last_change":"2023-09-13T02:12:23.578914+0000","last_active":"2023-09-13T02:13:04.905358+0000","last_peered":"2023-09-13T02:13:04.905358+0000","last_clean":"2023-09-13T02:13:04.905358+0000","last_became_active":"2023-09-13T02:12:23.578649+0000","last_became_peered":"2023-09-13T02:12:23.578649+0000","last_unstale":"2023-09-13T02:13:04.905358+0000","last_undegraded":"2023-09-13T02:13:04.905358+0000","last_fullsized":"2023-09-13T02:13:04.905358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'27","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.375269+0000","last_change":"2023-09-13T02:13:05.914293+0000","last_active":"2023-09-13T02:13:26.375269+0000","last_peered":"2023-09-13T02:13:26.375269+0000","last_clean":"2023-09-13T02:13:26.375269+0000","last_became_active":"2023-09-13T02:13:05.914007+0000","last_became_peered":"2023-09-13T02:13:05.914007+0000","last_unstale":"2023-09-13T02:13:26.375269+0000","last_undegraded":"2023-09-13T02:13:26.375269+0000","last_fullsized":"2023-09-13T02:13:26.375269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:25:19.651146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.909740+0000","last_change":"2023-09-13T02:12:23.578387+0000","last_active":"2023-09-13T02:13:05.909740+0000","last_peered":"2023-09-13T02:13:05.909740+0000","last_clean":"2023-09-13T02:13:05.909740+0000","last_became_active":"2023-09-13T02:12:23.578121+0000","last_became_peered":"2023-09-13T02:12:23.578121+0000","last_unstale":"2023-09-13T02:13:05.909740+0000","last_undegraded":"2023-09-13T02:13:05.909740+0000","last_fullsized":"2023-09-13T02:13:05.909740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:32.660244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'27","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.379504+0000","last_change":"2023-09-13T02:12:24.587304+0000","last_active":"2023-09-13T02:13:26.379504+0000","last_peered":"2023-09-13T02:13:26.379504+0000","last_clean":"2023-09-13T02:13:26.379504+0000","last_became_active":"2023-09-13T02:12:24.587040+0000","last_became_peered":"2023-09-13T02:12:24.587040+0000","last_unstale":"2023-09-13T02:13:26.379504+0000","last_undegraded":"2023-09-13T02:13:26.379504+0000","last_fullsized":"2023-09-13T02:13:26.379504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:18.256464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364322+0000","last_change":"2023-09-13T02:12:23.578623+0000","last_active":"2023-09-13T02:13:06.364322+0000","last_peered":"2023-09-13T02:13:06.364322+0000","last_clean":"2023-09-13T02:13:06.364322+0000","last_became_active":"2023-09-13T02:12:23.578258+0000","last_became_peered":"2023-09-13T02:12:23.578258+0000","last_unstale":"2023-09-13T02:13:06.364322+0000","last_undegraded":"2023-09-13T02:13:06.364322+0000","last_fullsized":"2023-09-13T02:13:06.364322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:18:54.951761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'15","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.380766+0000","last_change":"2023-09-13T02:12:24.590763+0000","last_active":"2023-09-13T02:13:26.380766+0000","last_peered":"2023-09-13T02:13:26.380766+0000","last_clean":"2023-09-13T02:13:26.380766+0000","last_became_active":"2023-09-13T02:12:24.590494+0000","last_became_peered":"2023-09-13T02:12:24.590494+0000","last_unstale":"2023-09-13T02:13:26.380766+0000","last_undegraded":"2023-09-13T02:13:26.380766+0000","last_fullsized":"2023-09-13T02:13:26.380766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'45","reported_seq":58,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382151+0000","last_change":"2023-09-13T02:12:24.597290+0000","last_active":"2023-09-13T02:13:26.382151+0000","last_peered":"2023-09-13T02:13:26.382151+0000","last_clean":"2023-09-13T02:13:26.382151+0000","last_became_active":"2023-09-13T02:12:24.597024+0000","last_became_peered":"2023-09-13T02:12:24.597024+0000","last_unstale":"2023-09-13T02:13:26.382151+0000","last_undegraded":"2023-09-13T02:13:26.382151+0000","last_fullsized":"2023-09-13T02:13:26.382151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:15.126313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.364323+0000","last_change":"2023-09-13T02:12:23.584941+0000","last_active":"2023-09-13T02:13:05.364323+0000","last_peered":"2023-09-13T02:13:05.364323+0000","last_clean":"2023-09-13T02:13:05.364323+0000","last_became_active":"2023-09-13T02:12:23.584671+0000","last_became_peered":"2023-09-13T02:12:23.584671+0000","last_unstale":"2023-09-13T02:13:05.364323+0000","last_undegraded":"2023-09-13T02:13:05.364323+0000","last_fullsized":"2023-09-13T02:13:05.364323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:38.089400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'27","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.382018+0000","last_change":"2023-09-13T02:12:24.596615+0000","last_active":"2023-09-13T02:13:26.382018+0000","last_peered":"2023-09-13T02:13:26.382018+0000","last_clean":"2023-09-13T02:13:26.382018+0000","last_became_active":"2023-09-13T02:12:24.595918+0000","last_became_peered":"2023-09-13T02:12:24.595918+0000","last_unstale":"2023-09-13T02:13:26.382018+0000","last_undegraded":"2023-09-13T02:13:26.382018+0000","last_fullsized":"2023-09-13T02:13:26.382018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:18:08.378805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364450+0000","last_change":"2023-09-13T02:12:23.579507+0000","last_active":"2023-09-13T02:13:06.364450+0000","last_peered":"2023-09-13T02:13:06.364450+0000","last_clean":"2023-09-13T02:13:06.364450+0000","last_became_active":"2023-09-13T02:12:23.579239+0000","last_became_peered":"2023-09-13T02:12:23.579239+0000","last_unstale":"2023-09-13T02:13:06.364450+0000","last_undegraded":"2023-09-13T02:13:06.364450+0000","last_fullsized":"2023-09-13T02:13:06.364450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:11.224076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'20","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.377093+0000","last_change":"2023-09-13T02:12:24.589292+0000","last_active":"2023-09-13T02:13:26.377093+0000","last_peered":"2023-09-13T02:13:26.377093+0000","last_clean":"2023-09-13T02:13:26.377093+0000","last_became_active":"2023-09-13T02:12:24.589039+0000","last_became_peered":"2023-09-13T02:12:24.589039+0000","last_unstale":"2023-09-13T02:13:26.377093+0000","last_undegraded":"2023-09-13T02:13:26.377093+0000","last_fullsized":"2023-09-13T02:13:26.377093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.914584+0000","last_change":"2023-09-13T02:12:23.584177+0000","last_active":"2023-09-13T02:13:05.914584+0000","last_peered":"2023-09-13T02:13:05.914584+0000","last_clean":"2023-09-13T02:13:05.914584+0000","last_became_active":"2023-09-13T02:12:23.583920+0000","last_became_peered":"2023-09-13T02:12:23.583920+0000","last_unstale":"2023-09-13T02:13:05.914584+0000","last_undegraded":"2023-09-13T02:13:05.914584+0000","last_fullsized":"2023-09-13T02:13:05.914584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:21:49.468231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'15","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:26.374143+0000","last_change":"2023-09-13T02:12:24.588205+0000","last_active":"2023-09-13T02:13:26.374143+0000","last_peered":"2023-09-13T02:13:26.374143+0000","last_clean":"2023-09-13T02:13:26.374143+0000","last_became_active":"2023-09-13T02:12:24.587697+0000","last_became_peered":"2023-09-13T02:12:24.587697+0000","last_unstale":"2023-09-13T02:13:26.374143+0000","last_undegraded":"2023-09-13T02:13:26.374143+0000","last_fullsized":"2023-09-13T02:13:26.374143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364646+0000","last_change":"2023-09-13T02:12:23.583748+0000","last_active":"2023-09-13T02:13:06.364646+0000","last_peered":"2023-09-13T02:13:06.364646+0000","last_clean":"2023-09-13T02:13:06.364646+0000","last_became_active":"2023-09-13T02:12:23.583443+0000","last_became_peered":"2023-09-13T02:12:23.583443+0000","last_unstale":"2023-09-13T02:13:06.364646+0000","last_undegraded":"2023-09-13T02:13:06.364646+0000","last_fullsized":"2023-09-13T02:13:06.364646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":26,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1567,"ondisk_log_size":1567,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":405856,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":9,"num_read_kb":12,"num_write":160,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":876544,"data_stored":811712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":171,"ondisk_log_size":171,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":831488,"data_stored":674158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.63600000000000001}]},{"osd":1,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.68100000000000005}]},{"osd":2,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.752},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.69299999999999995}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.504}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.52500000000000002}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.47699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":638976,"data_stored":483515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.498},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.432}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.44700000000000001}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.55100000000000005}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.52900000000000003}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.47999999999999998}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.372},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.32600000000000001}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.45700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":83294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.439}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.495}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.54500000000000004}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.621},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.58799999999999997}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.70499999999999996}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.76200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":83343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.54600000000000004}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.67200000000000004}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.57199999999999995}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.61599999999999999}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.45100000000000001}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.42199999999999999}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":647168,"data_stored":486953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.27800000000000002}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.318}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.38500000000000001}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.73399999999999999}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.56499999999999995}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.628},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.65900000000000003}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.71399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":86650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.29399999999999998}]},{"osd":1,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.254},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.26700000000000002}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.28100000000000003}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.311},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48599999999999999}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.504},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.33100000000000002}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.35899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":83385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.31900000000000001}]},{"osd":2,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.374},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.41499999999999998}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.39900000000000002}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.64000000000000001}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.61899999999999999}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.67100000000000004}]},{"osd":7,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":835584,"data_stored":673195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.29799999999999999}]},{"osd":2,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.33600000000000002}]},{"osd":3,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.32200000000000001}]},{"osd":4,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.65400000000000003}]},{"osd":5,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55300000000000005}]},{"osd":6,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.625},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.745}]},{"osd":7,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":4747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":405058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":400311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T02:13:31.325 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T02:13:31.460 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.460+0000 7fa1ac91d640 1 -- 172.21.15.104:0/2378950783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1a80b1820 msgr2=0x7fa1a81482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:31.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.460+0000 7fa1ac91d640 1 --2- 172.21.15.104:0/2378950783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1a80b1820 0x7fa1a81482f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa19c009900 tx=0x7fa19c02bce0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.460+0000 7fa1ac91d640 1 -- 172.21.15.104:0/2378950783 shutdown_connections 2023-09-13T02:13:31.461 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.460+0000 7fa1ac91d640 1 --2- 172.21.15.104:0/2378950783 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1a80b5ba0 0x7fa1a814ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.462 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.460+0000 7fa1ac91d640 1 --2- 172.21.15.104:0/2378950783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1a80b1820 0x7fa1a81482f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.462 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.460+0000 7fa1ac91d640 1 -- 172.21.15.104:0/2378950783 >> 172.21.15.104:0/2378950783 conn(0x7fa1a80708b0 msgr2=0x7fa1a8070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:31.462 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.460+0000 7fa1ac91d640 1 -- 172.21.15.104:0/2378950783 shutdown_connections 2023-09-13T02:13:31.463 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.460+0000 7fa1ac91d640 1 -- 172.21.15.104:0/2378950783 wait complete. 2023-09-13T02:13:31.465 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.461+0000 7fa1ac91d640 1 Processor -- start 2023-09-13T02:13:31.466 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.461+0000 7fa1ac91d640 1 -- start start 2023-09-13T02:13:31.466 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1ac91d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1a80b5ba0 0x7fa1a8144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:31.466 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1ac91d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a8147b90 0x7fa1a8144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:31.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1ac91d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1a8142ad0 0x7fa1a8137ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:31.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1ac91d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a81450d0 con 0x7fa1a8142ad0 2023-09-13T02:13:31.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1ac91d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a80ba8b0 con 0x7fa1a8147b90 2023-09-13T02:13:31.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1ac91d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a8142220 con 0x7fa1a80b5ba0 2023-09-13T02:13:31.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1a6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1a8142ad0 0x7fa1a8137ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:31.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1a6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1a8142ad0 0x7fa1a8137ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49228/0 (socket says 172.21.15.104:49228) 2023-09-13T02:13:31.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1a6d9d640 1 -- 172.21.15.104:0/2783927073 learned_addr learned my addr 172.21.15.104:0/2783927073 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:31.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1a659c640 1 --2- 172.21.15.104:0/2783927073 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1a80b5ba0 0x7fa1a8144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:31.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1a5d9b640 1 --2- 172.21.15.104:0/2783927073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a8147b90 0x7fa1a8144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:31.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1a6d9d640 1 -- 172.21.15.104:0/2783927073 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1a80b5ba0 msgr2=0x7fa1a8144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:31.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1a6d9d640 1 --2- 172.21.15.104:0/2783927073 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1a80b5ba0 0x7fa1a8144080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.470 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1a6d9d640 1 -- 172.21.15.104:0/2783927073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a8147b90 msgr2=0x7fa1a8144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:31.470 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1a6d9d640 1 --2- 172.21.15.104:0/2783927073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a8147b90 0x7fa1a8144b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.470 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1a6d9d640 1 -- 172.21.15.104:0/2783927073 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c009560 con 0x7fa1a8142ad0 2023-09-13T02:13:31.471 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1a5d9b640 1 --2- 172.21.15.104:0/2783927073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a8147b90 0x7fa1a8144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:13:31.471 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1a659c640 1 --2- 172.21.15.104:0/2783927073 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1a80b5ba0 0x7fa1a8144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:13:31.471 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1a6d9d640 1 --2- 172.21.15.104:0/2783927073 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1a8142ad0 0x7fa1a8137ef0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000d720 tx=0x7fa1a000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:31.471 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa196ffd640 1 -- 172.21.15.104:0/2783927073 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0009bd0 con 0x7fa1a8142ad0 2023-09-13T02:13:31.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa196ffd640 1 -- 172.21.15.104:0/2783927073 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa1a0009e20 con 0x7fa1a8142ad0 2023-09-13T02:13:31.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1ac91d640 1 -- 172.21.15.104:0/2783927073 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a80b1000 con 0x7fa1a8142ad0 2023-09-13T02:13:31.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa196ffd640 1 -- 172.21.15.104:0/2783927073 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0005280 con 0x7fa1a8142ad0 2023-09-13T02:13:31.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.462+0000 7fa1ac91d640 1 -- 172.21.15.104:0/2783927073 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a80ba5d0 con 0x7fa1a8142ad0 2023-09-13T02:13:31.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.463+0000 7fa1ac91d640 1 -- 172.21.15.104:0/2783927073 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a81439c0 con 0x7fa1a8142ad0 2023-09-13T02:13:31.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.464+0000 7fa196ffd640 1 -- 172.21.15.104:0/2783927073 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fa1a00053e0 con 0x7fa1a8142ad0 2023-09-13T02:13:31.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.464+0000 7fa196ffd640 1 --2- 172.21.15.104:0/2783927073 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fa18806a4f0 0x7fa18806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:31.474 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.464+0000 7fa1a659c640 1 --2- 172.21.15.104:0/2783927073 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fa18806a4f0 0x7fa18806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:31.474 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.464+0000 7fa196ffd640 1 -- 172.21.15.104:0/2783927073 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa1a0088c70 con 0x7fa1a8142ad0 2023-09-13T02:13:31.474 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.465+0000 7fa1a659c640 1 --2- 172.21.15.104:0/2783927073 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fa18806a4f0 0x7fa18806c9b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa198009fc0 tx=0x7fa198009550 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:31.475 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.468+0000 7fa196ffd640 1 -- 172.21.15.104:0/2783927073 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa1a81439c0 con 0x7fa1a8142ad0 2023-09-13T02:13:31.635 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.635+0000 7fa1ac91d640 1 -- 172.21.15.104:0/2783927073 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1a81427f0 con 0x7fa1a8142ad0 2023-09-13T02:13:31.636 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.636+0000 7fa196ffd640 1 -- 172.21.15.104:0/2783927073 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16789 (secure 0 0 0) 0x7fa1a81427f0 con 0x7fa1a8142ad0 2023-09-13T02:13:31.637 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:13:31.637 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"fsid":"ac1f5a95-0d3a-406e-b4ca-c8ea43282cab","created":"2023-09-13T02:11:59.067178+0000","modified":"2023-09-13T02:13:05.901906+0000","last_up_change":"2023-09-13T02:12:11.207888+0000","last_in_change":"2023-09-13T02:12:02.278796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T02:12:12.071023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T02:12:22.114609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T02:12:22.880593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67190066-4851-4b1f-aae8-bad59e79ebb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6801","nonce":3271772377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6803","nonce":3271772377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6807","nonce":3271772377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6805","nonce":3271772377}]},"public_addr":"172.21.15.104:6801/3271772377","cluster_addr":"172.21.15.104:6803/3271772377","heartbeat_back_addr":"172.21.15.104:6807/3271772377","heartbeat_front_addr":"172.21.15.104:6805/3271772377","state":["exists","up"]},{"osd":1,"uuid":"f1907075-bb97-4a19-8dd6-322232caaf4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6809","nonce":3786698894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6811","nonce":3786698894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6815","nonce":3786698894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6813","nonce":3786698894}]},"public_addr":"172.21.15.104:6809/3786698894","cluster_addr":"172.21.15.104:6811/3786698894","heartbeat_back_addr":"172.21.15.104:6815/3786698894","heartbeat_front_addr":"172.21.15.104:6813/3786698894","state":["exists","up"]},{"osd":2,"uuid":"8c323c83-330c-4181-b622-10177c81f975","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6819","nonce":2319361072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6822","nonce":2319361072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6827","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6829","nonce":2319361072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6826","nonce":2319361072}]},"public_addr":"172.21.15.104:6819/2319361072","cluster_addr":"172.21.15.104:6822/2319361072","heartbeat_back_addr":"172.21.15.104:6829/2319361072","heartbeat_front_addr":"172.21.15.104:6826/2319361072","state":["exists","up"]},{"osd":3,"uuid":"811457f5-c408-488d-a4ed-b947d1c55e82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6818","nonce":621253853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6823","nonce":621253853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6831","nonce":621253853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6825","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6828","nonce":621253853}]},"public_addr":"172.21.15.104:6818/621253853","cluster_addr":"172.21.15.104:6823/621253853","heartbeat_back_addr":"172.21.15.104:6831/621253853","heartbeat_front_addr":"172.21.15.104:6828/621253853","state":["exists","up"]},{"osd":4,"uuid":"552010ea-7d61-47c7-b4ac-657845e55e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6801","nonce":3049794634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6803","nonce":3049794634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6807","nonce":3049794634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6805","nonce":3049794634}]},"public_addr":"172.21.15.119:6801/3049794634","cluster_addr":"172.21.15.119:6803/3049794634","heartbeat_back_addr":"172.21.15.119:6807/3049794634","heartbeat_front_addr":"172.21.15.119:6805/3049794634","state":["exists","up"]},{"osd":5,"uuid":"41f415b0-6886-44ed-bccc-57c46cc975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6809","nonce":2918159428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6811","nonce":2918159428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6815","nonce":2918159428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6813","nonce":2918159428}]},"public_addr":"172.21.15.119:6809/2918159428","cluster_addr":"172.21.15.119:6811/2918159428","heartbeat_back_addr":"172.21.15.119:6815/2918159428","heartbeat_front_addr":"172.21.15.119:6813/2918159428","state":["exists","up"]},{"osd":6,"uuid":"1f415570-dbcc-4cb9-930a-ad31a96c3ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6825","nonce":3509665357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6827","nonce":3509665357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6831","nonce":3509665357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6829","nonce":3509665357}]},"public_addr":"172.21.15.119:6825/3509665357","cluster_addr":"172.21.15.119:6827/3509665357","heartbeat_back_addr":"172.21.15.119:6831/3509665357","heartbeat_front_addr":"172.21.15.119:6829/3509665357","state":["exists","up"]},{"osd":7,"uuid":"ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6817","nonce":892749725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6819","nonce":892749725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6823","nonce":892749725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6821","nonce":892749725}]},"public_addr":"172.21.15.119:6817/892749725","cluster_addr":"172.21.15.119:6819/892749725","heartbeat_back_addr":"172.21.15.119:6823/892749725","heartbeat_front_addr":"172.21.15.119:6821/892749725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.489481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.468615+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.485958+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.424425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.456308+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.427607+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T02:13:31.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.638+0000 7fa1ac91d640 1 -- 172.21.15.104:0/2783927073 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fa18806a4f0 msgr2=0x7fa18806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:31.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.638+0000 7fa1ac91d640 1 --2- 172.21.15.104:0/2783927073 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fa18806a4f0 0x7fa18806c9b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa198009fc0 tx=0x7fa198009550 comp rx=0 tx=0).stop 2023-09-13T02:13:31.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.638+0000 7fa1ac91d640 1 -- 172.21.15.104:0/2783927073 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1a8142ad0 msgr2=0x7fa1a8137ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:31.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.638+0000 7fa1ac91d640 1 --2- 172.21.15.104:0/2783927073 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1a8142ad0 0x7fa1a8137ef0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000d720 tx=0x7fa1a000dbe0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.639+0000 7fa1ac91d640 1 -- 172.21.15.104:0/2783927073 shutdown_connections 2023-09-13T02:13:31.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.639+0000 7fa1ac91d640 1 --2- 172.21.15.104:0/2783927073 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fa18806a4f0 0x7fa18806c9b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.639+0000 7fa1ac91d640 1 --2- 172.21.15.104:0/2783927073 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1a8142ad0 0x7fa1a8137ef0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.639+0000 7fa1ac91d640 1 --2- 172.21.15.104:0/2783927073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a8147b90 0x7fa1a8144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.639+0000 7fa1ac91d640 1 --2- 172.21.15.104:0/2783927073 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1a80b5ba0 0x7fa1a8144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:31.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.639+0000 7fa1ac91d640 1 -- 172.21.15.104:0/2783927073 >> 172.21.15.104:0/2783927073 conn(0x7fa1a80708b0 msgr2=0x7fa1a81471b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:31.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.639+0000 7fa1ac91d640 1 -- 172.21.15.104:0/2783927073 shutdown_connections 2023-09-13T02:13:31.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:31.639+0000 7fa1ac91d640 1 -- 172.21.15.104:0/2783927073 wait complete. 2023-09-13T02:13:32.651 INFO:tasks.ceph:Scrubbing osd.0 2023-09-13T02:13:32.652 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-09-13T02:13:32.770 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.770+0000 7f0ad64e7640 1 -- 172.21.15.104:0/1816909883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ad013ab80 msgr2=0x7f0ad013afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:32.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.770+0000 7f0ad64e7640 1 --2- 172.21.15.104:0/1816909883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ad013ab80 0x7f0ad013afe0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4009860 tx=0x7f0ac402bcb0 comp rx=0 tx=0).stop 2023-09-13T02:13:32.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.770+0000 7f0ad64e7640 1 -- 172.21.15.104:0/1816909883 shutdown_connections 2023-09-13T02:13:32.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.770+0000 7f0ad64e7640 1 --2- 172.21.15.104:0/1816909883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ad013ab80 0x7f0ad013afe0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:32.772 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.770+0000 7f0ad64e7640 1 --2- 172.21.15.104:0/1816909883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ad00b02e0 0x7f0ad01443b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:32.772 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.770+0000 7f0ad64e7640 1 -- 172.21.15.104:0/1816909883 >> 172.21.15.104:0/1816909883 conn(0x7f0ad00b56f0 msgr2=0x7f0ad00b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:32.772 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.770+0000 7f0ad64e7640 1 -- 172.21.15.104:0/1816909883 shutdown_connections 2023-09-13T02:13:32.772 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.770+0000 7f0ad64e7640 1 -- 172.21.15.104:0/1816909883 wait complete. 2023-09-13T02:13:32.776 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.771+0000 7f0ad64e7640 1 Processor -- start 2023-09-13T02:13:32.776 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.771+0000 7f0ad64e7640 1 -- start start 2023-09-13T02:13:32.776 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.772+0000 7f0ad64e7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ad00b02e0 0x7f0ad013c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:32.776 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.772+0000 7f0ad64e7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ad013ab80 0x7f0ad01d88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:32.777 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.772+0000 7f0ad64e7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ad0140dc0 0x7f0ad01d8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:32.777 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.772+0000 7f0ad64e7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad01d8460 con 0x7f0ad0140dc0 2023-09-13T02:13:32.777 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.772+0000 7f0ad64e7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad013dd40 con 0x7f0ad00b02e0 2023-09-13T02:13:32.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.772+0000 7f0ad64e7640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad013dfe0 con 0x7f0ad013ab80 2023-09-13T02:13:32.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.772+0000 7f0ad4a84640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ad0140dc0 0x7f0ad01d8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:32.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.772+0000 7f0ad4a84640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ad0140dc0 0x7f0ad01d8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49240/0 (socket says 172.21.15.104:49240) 2023-09-13T02:13:32.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.772+0000 7f0ad4a84640 1 -- 172.21.15.104:0/3857254679 learned_addr learned my addr 172.21.15.104:0/3857254679 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:32.779 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.772+0000 7f0acffff640 1 --2- 172.21.15.104:0/3857254679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ad00b02e0 0x7f0ad013c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:32.779 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.772+0000 7f0acf7fe640 1 --2- 172.21.15.104:0/3857254679 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ad013ab80 0x7f0ad01d88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:32.779 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.772+0000 7f0ad4a84640 1 -- 172.21.15.104:0/3857254679 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ad013ab80 msgr2=0x7f0ad01d88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:32.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.772+0000 7f0ad4a84640 1 --2- 172.21.15.104:0/3857254679 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ad013ab80 0x7f0ad01d88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:32.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.772+0000 7f0ad4a84640 1 -- 172.21.15.104:0/3857254679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ad00b02e0 msgr2=0x7f0ad013c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:32.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.772+0000 7f0ad4a84640 1 --2- 172.21.15.104:0/3857254679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ad00b02e0 0x7f0ad013c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:32.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.772+0000 7f0ad4a84640 1 -- 172.21.15.104:0/3857254679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac0009560 con 0x7f0ad0140dc0 2023-09-13T02:13:32.781 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.772+0000 7f0acf7fe640 1 --2- 172.21.15.104:0/3857254679 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ad013ab80 0x7f0ad01d88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T02:13:32.781 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.773+0000 7f0ad4a84640 1 --2- 172.21.15.104:0/3857254679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ad0140dc0 0x7f0ad01d8df0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800c730 tx=0x7f0ac800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:32.781 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.773+0000 7f0accff9640 1 -- 172.21.15.104:0/3857254679 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8006d50 con 0x7f0ad0140dc0 2023-09-13T02:13:32.782 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.773+0000 7f0accff9640 1 -- 172.21.15.104:0/3857254679 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ac8003970 con 0x7f0ad0140dc0 2023-09-13T02:13:32.782 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.773+0000 7f0ad64e7640 1 -- 172.21.15.104:0/3857254679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac4009490 con 0x7f0ad0140dc0 2023-09-13T02:13:32.782 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.773+0000 7f0accff9640 1 -- 172.21.15.104:0/3857254679 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8003d80 con 0x7f0ad0140dc0 2023-09-13T02:13:32.782 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.773+0000 7f0ad64e7640 1 -- 172.21.15.104:0/3857254679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad013d400 con 0x7f0ad0140dc0 2023-09-13T02:13:32.783 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.774+0000 7f0ad64e7640 1 -- 172.21.15.104:0/3857254679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ad013af80 con 0x7f0ad0140dc0 2023-09-13T02:13:32.783 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.774+0000 7f0accff9640 1 -- 172.21.15.104:0/3857254679 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f0ac80050d0 con 0x7f0ad0140dc0 2023-09-13T02:13:32.783 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.775+0000 7f0accff9640 1 --2- 172.21.15.104:0/3857254679 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0abc06a4f0 0x7f0abc06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:32.784 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.775+0000 7f0acffff640 1 --2- 172.21.15.104:0/3857254679 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0abc06a4f0 0x7f0abc06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:32.784 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.775+0000 7f0accff9640 1 -- 172.21.15.104:0/3857254679 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0ac80886a0 con 0x7f0ad0140dc0 2023-09-13T02:13:32.784 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.775+0000 7f0accff9640 1 --2- 172.21.15.104:0/3857254679 >> [v2:172.21.15.104:6800/3271772377,v1:172.21.15.104:6801/3271772377] conn(0x7f0abc072810 0x7f0abc074c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:32.784 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.775+0000 7f0accff9640 1 -- 172.21.15.104:0/3857254679 --> [v2:172.21.15.104:6800/3271772377,v1:172.21.15.104:6801/3271772377] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0abc075360 con 0x7f0abc072810 2023-09-13T02:13:32.785 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.775+0000 7f0accff9640 1 -- 172.21.15.104:0/3857254679 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ac808ad60 con 0x7f0ad0140dc0 2023-09-13T02:13:32.785 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.775+0000 7f0acf7fe640 1 --2- 172.21.15.104:0/3857254679 >> [v2:172.21.15.104:6800/3271772377,v1:172.21.15.104:6801/3271772377] conn(0x7f0abc072810 0x7f0abc074c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:32.785 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.775+0000 7f0acffff640 1 --2- 172.21.15.104:0/3857254679 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0abc06a4f0 0x7f0abc06c9b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009530 tx=0x7f0ac0009260 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:32.785 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.775+0000 7f0acf7fe640 1 --2- 172.21.15.104:0/3857254679 >> [v2:172.21.15.104:6800/3271772377,v1:172.21.15.104:6801/3271772377] conn(0x7f0abc072810 0x7f0abc074c90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:32.786 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.776+0000 7f0accff9640 1 -- 172.21.15.104:0/3857254679 <== osd.0 v2:172.21.15.104:6800/3271772377 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0abc075360 con 0x7f0abc072810 2023-09-13T02:13:32.788 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.788+0000 7f0ad64e7640 1 -- 172.21.15.104:0/3857254679 --> [v2:172.21.15.104:6800/3271772377,v1:172.21.15.104:6801/3271772377] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0ad006ef00 con 0x7f0abc072810 2023-09-13T02:13:32.789 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.789+0000 7f0accff9640 1 -- 172.21.15.104:0/3857254679 <== osd.0 v2:172.21.15.104:6800/3271772377 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0ad006ef00 con 0x7f0abc072810 2023-09-13T02:13:32.789 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2023-09-13T02:13:32.790 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-13T02:13:32.790 INFO:teuthology.orchestra.run.smithi104.stdout:} 2023-09-13T02:13:32.791 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.789+0000 7f0ad64e7640 1 -- 172.21.15.104:0/3857254679 >> [v2:172.21.15.104:6800/3271772377,v1:172.21.15.104:6801/3271772377] conn(0x7f0abc072810 msgr2=0x7f0abc074c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:32.791 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.789+0000 7f0ad64e7640 1 --2- 172.21.15.104:0/3857254679 >> [v2:172.21.15.104:6800/3271772377,v1:172.21.15.104:6801/3271772377] conn(0x7f0abc072810 0x7f0abc074c90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:32.792 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.789+0000 7f0ad64e7640 1 -- 172.21.15.104:0/3857254679 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0abc06a4f0 msgr2=0x7f0abc06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:32.792 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.789+0000 7f0ad64e7640 1 --2- 172.21.15.104:0/3857254679 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0abc06a4f0 0x7f0abc06c9b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009530 tx=0x7f0ac0009260 comp rx=0 tx=0).stop 2023-09-13T02:13:32.792 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.789+0000 7f0ad64e7640 1 -- 172.21.15.104:0/3857254679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ad0140dc0 msgr2=0x7f0ad01d8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:32.792 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.789+0000 7f0ad64e7640 1 --2- 172.21.15.104:0/3857254679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ad0140dc0 0x7f0ad01d8df0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800c730 tx=0x7f0ac800cb30 comp rx=0 tx=0).stop 2023-09-13T02:13:32.793 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.789+0000 7f0ad4a84640 1 -- 172.21.15.104:0/3857254679 reap_dead start 2023-09-13T02:13:32.793 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.789+0000 7f0ad64e7640 1 -- 172.21.15.104:0/3857254679 shutdown_connections 2023-09-13T02:13:32.793 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.789+0000 7f0ad64e7640 1 -- 172.21.15.104:0/3857254679 >> 172.21.15.104:0/3857254679 conn(0x7f0ad00b56f0 msgr2=0x7f0ad0141250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:32.794 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.789+0000 7f0ad64e7640 1 -- 172.21.15.104:0/3857254679 shutdown_connections 2023-09-13T02:13:32.794 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.789+0000 7f0ad64e7640 1 -- 172.21.15.104:0/3857254679 wait complete. 2023-09-13T02:13:32.800 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-09-13T02:13:32.903 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.903+0000 7f70be41f640 1 -- 172.21.15.104:0/963667065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70b8142940 msgr2=0x7f70b814d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:32.903 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.903+0000 7f70be41f640 1 --2- 172.21.15.104:0/963667065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70b8142940 0x7f70b814d950 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f70b0005fd0 tx=0x7f70b002c250 comp rx=0 tx=0).stop 2023-09-13T02:13:32.904 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.903+0000 7f70be41f640 1 -- 172.21.15.104:0/963667065 shutdown_connections 2023-09-13T02:13:32.904 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.903+0000 7f70be41f640 1 --2- 172.21.15.104:0/963667065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70b8142940 0x7f70b814d950 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:32.904 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.903+0000 7f70be41f640 1 -- 172.21.15.104:0/963667065 >> 172.21.15.104:0/963667065 conn(0x7f70b80b56f0 msgr2=0x7f70b80b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:32.905 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.903+0000 7f70be41f640 1 -- 172.21.15.104:0/963667065 shutdown_connections 2023-09-13T02:13:32.905 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.903+0000 7f70be41f640 1 -- 172.21.15.104:0/963667065 wait complete. 2023-09-13T02:13:32.907 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.904+0000 7f70be41f640 1 Processor -- start 2023-09-13T02:13:32.908 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.904+0000 7f70be41f640 1 -- start start 2023-09-13T02:13:32.908 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.904+0000 7f70be41f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70b80aefb0 0x7f70b80a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:32.908 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.904+0000 7f70be41f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70b80b1280 0x7f70b8070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:32.909 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.904+0000 7f70be41f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70b8142940 0x7f70b813eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:32.909 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.904+0000 7f70be41f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80a67f0 con 0x7f70b80b1280 2023-09-13T02:13:32.909 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.904+0000 7f70be41f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b813fcc0 con 0x7f70b80aefb0 2023-09-13T02:13:32.910 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.904+0000 7f70be41f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b813e0e0 con 0x7f70b8142940 2023-09-13T02:13:32.910 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.904+0000 7f70b77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70b80b1280 0x7f70b8070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:32.910 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.904+0000 7f70b77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70b80b1280 0x7f70b8070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49260/0 (socket says 172.21.15.104:49260) 2023-09-13T02:13:32.911 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.904+0000 7f70b77fe640 1 -- 172.21.15.104:0/3874033011 learned_addr learned my addr 172.21.15.104:0/3874033011 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:32.911 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.905+0000 7f70bc9bc640 1 --2- 172.21.15.104:0/3874033011 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70b8142940 0x7f70b813eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:32.911 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.905+0000 7f70b7fff640 1 --2- 172.21.15.104:0/3874033011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70b80aefb0 0x7f70b80a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:32.911 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.905+0000 7f70b77fe640 1 -- 172.21.15.104:0/3874033011 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70b8142940 msgr2=0x7f70b813eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:32.912 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.905+0000 7f70b77fe640 1 --2- 172.21.15.104:0/3874033011 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70b8142940 0x7f70b813eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:32.912 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.905+0000 7f70b77fe640 1 -- 172.21.15.104:0/3874033011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70b80aefb0 msgr2=0x7f70b80a6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:32.912 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.905+0000 7f70b77fe640 1 --2- 172.21.15.104:0/3874033011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70b80aefb0 0x7f70b80a6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:32.912 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.905+0000 7f70b77fe640 1 -- 172.21.15.104:0/3874033011 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b0009900 con 0x7f70b80b1280 2023-09-13T02:13:32.913 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.905+0000 7f70b77fe640 1 --2- 172.21.15.104:0/3874033011 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70b80b1280 0x7f70b8070960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00c430 tx=0x7f70ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:32.913 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.905+0000 7f70b4ff9640 1 -- 172.21.15.104:0/3874033011 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac011790 con 0x7f70b80b1280 2023-09-13T02:13:32.913 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.905+0000 7f70b4ff9640 1 -- 172.21.15.104:0/3874033011 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f70ac0119e0 con 0x7f70b80b1280 2023-09-13T02:13:32.914 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.905+0000 7f70be41f640 1 -- 172.21.15.104:0/3874033011 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b813f420 con 0x7f70b80b1280 2023-09-13T02:13:32.914 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.905+0000 7f70b4ff9640 1 -- 172.21.15.104:0/3874033011 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac011e30 con 0x7f70b80b1280 2023-09-13T02:13:32.914 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.905+0000 7f70be41f640 1 -- 172.21.15.104:0/3874033011 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b813f9b0 con 0x7f70b80b1280 2023-09-13T02:13:32.914 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.906+0000 7f70be41f640 1 -- 172.21.15.104:0/3874033011 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b813e600 con 0x7f70b80b1280 2023-09-13T02:13:32.915 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.907+0000 7f70b4ff9640 1 -- 172.21.15.104:0/3874033011 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f70ac01c460 con 0x7f70b80b1280 2023-09-13T02:13:32.915 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.907+0000 7f70b4ff9640 1 --2- 172.21.15.104:0/3874033011 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f70a406a4f0 0x7f70a406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:32.915 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.907+0000 7f70b7fff640 1 --2- 172.21.15.104:0/3874033011 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f70a406a4f0 0x7f70a406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:32.916 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.907+0000 7f70b4ff9640 1 -- 172.21.15.104:0/3874033011 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f70ac088b20 con 0x7f70b80b1280 2023-09-13T02:13:32.916 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.907+0000 7f70b7fff640 1 --2- 172.21.15.104:0/3874033011 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f70a406a4f0 0x7f70a406c9b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f70a8000f60 tx=0x7f70a8009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:32.916 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:32.911+0000 7f70b4ff9640 1 -- 172.21.15.104:0/3874033011 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f70b813e600 con 0x7f70b80b1280 2023-09-13T02:13:33.091 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.091+0000 7f70be41f640 1 -- 172.21.15.104:0/3874033011 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f70b813fe30 con 0x7f70a406a4f0 2023-09-13T02:13:33.092 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.091+0000 7f70b4ff9640 1 -- 172.21.15.104:0/3874033011 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f70b813fe30 con 0x7f70a406a4f0 2023-09-13T02:13:33.093 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 0 to deep-scrub 2023-09-13T02:13:33.094 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.093+0000 7f70be41f640 1 -- 172.21.15.104:0/3874033011 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f70a406a4f0 msgr2=0x7f70a406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.095 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.093+0000 7f70be41f640 1 --2- 172.21.15.104:0/3874033011 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f70a406a4f0 0x7f70a406c9b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f70a8000f60 tx=0x7f70a8009040 comp rx=0 tx=0).stop 2023-09-13T02:13:33.095 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.093+0000 7f70be41f640 1 -- 172.21.15.104:0/3874033011 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70b80b1280 msgr2=0x7f70b8070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.096 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.093+0000 7f70be41f640 1 --2- 172.21.15.104:0/3874033011 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70b80b1280 0x7f70b8070960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00c430 tx=0x7f70ac00c8f0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.097 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.093+0000 7f70be41f640 1 -- 172.21.15.104:0/3874033011 shutdown_connections 2023-09-13T02:13:33.097 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.093+0000 7f70be41f640 1 --2- 172.21.15.104:0/3874033011 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f70a406a4f0 0x7f70a406c9b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.098 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.093+0000 7f70be41f640 1 --2- 172.21.15.104:0/3874033011 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70b8142940 0x7f70b813eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.098 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.093+0000 7f70be41f640 1 --2- 172.21.15.104:0/3874033011 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70b80b1280 0x7f70b8070960 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.099 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.093+0000 7f70be41f640 1 --2- 172.21.15.104:0/3874033011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70b80aefb0 0x7f70b80a6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.099 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.093+0000 7f70be41f640 1 -- 172.21.15.104:0/3874033011 >> 172.21.15.104:0/3874033011 conn(0x7f70b80b56f0 msgr2=0x7f70b80b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:33.099 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.093+0000 7f70be41f640 1 -- 172.21.15.104:0/3874033011 shutdown_connections 2023-09-13T02:13:33.100 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.093+0000 7f70be41f640 1 -- 172.21.15.104:0/3874033011 wait complete. 2023-09-13T02:13:33.105 INFO:tasks.ceph:Scrubbing osd.1 2023-09-13T02:13:33.106 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-09-13T02:13:33.212 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.211+0000 7f0d7bb11640 1 -- 172.21.15.104:0/2335111213 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d60003b30 msgr2=0x7f0d60003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.212 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.211+0000 7f0d7bb11640 1 --2- 172.21.15.104:0/2335111213 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d60003b30 0x7f0d60003f30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009ed0 tx=0x7f0d600057f0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.212 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.211+0000 7f0d7a0ae640 1 -- 172.21.15.104:0/2335111213 reap_dead start 2023-09-13T02:13:33.213 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.211+0000 7f0d7bb11640 1 -- 172.21.15.104:0/2335111213 shutdown_connections 2023-09-13T02:13:33.213 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.211+0000 7f0d7bb11640 1 -- 172.21.15.104:0/2335111213 >> 172.21.15.104:0/2335111213 conn(0x7f0d740708b0 msgr2=0x7f0d74070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:33.213 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.211+0000 7f0d7bb11640 1 -- 172.21.15.104:0/2335111213 shutdown_connections 2023-09-13T02:13:33.213 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.212+0000 7f0d7bb11640 1 -- 172.21.15.104:0/2335111213 wait complete. 2023-09-13T02:13:33.216 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.212+0000 7f0d7bb11640 1 Processor -- start 2023-09-13T02:13:33.217 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.212+0000 7f0d7bb11640 1 -- start start 2023-09-13T02:13:33.217 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.213+0000 7f0d7bb11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d60003b30 0x7f0d7413ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.217 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.213+0000 7f0d7bb11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d741447c0 0x7f0d741dd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.218 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.213+0000 7f0d7bb11640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d741dd7a0 0x7f0d740ae940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.218 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.213+0000 7f0d7bb11640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d741ddc30 con 0x7f0d741dd7a0 2023-09-13T02:13:33.218 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.213+0000 7f0d7bb11640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d74144f80 con 0x7f0d741447c0 2023-09-13T02:13:33.219 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.213+0000 7f0d7bb11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d74143960 con 0x7f0d60003b30 2023-09-13T02:13:33.219 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.213+0000 7f0d7a0ae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d741dd7a0 0x7f0d740ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.219 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.213+0000 7f0d7a0ae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d741dd7a0 0x7f0d740ae940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49286/0 (socket says 172.21.15.104:49286) 2023-09-13T02:13:33.220 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.213+0000 7f0d7a0ae640 1 -- 172.21.15.104:0/843608886 learned_addr learned my addr 172.21.15.104:0/843608886 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:33.220 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.213+0000 7f0d798ad640 1 --2- 172.21.15.104:0/843608886 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d60003b30 0x7f0d7413ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.220 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.213+0000 7f0d790ac640 1 --2- 172.21.15.104:0/843608886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d741447c0 0x7f0d741dd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.220 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.213+0000 7f0d7a0ae640 1 -- 172.21.15.104:0/843608886 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d60003b30 msgr2=0x7f0d7413ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.221 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.213+0000 7f0d7a0ae640 1 --2- 172.21.15.104:0/843608886 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d60003b30 0x7f0d7413ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.221 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.213+0000 7f0d7a0ae640 1 -- 172.21.15.104:0/843608886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d741447c0 msgr2=0x7f0d741dd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.221 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.213+0000 7f0d7a0ae640 1 --2- 172.21.15.104:0/843608886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d741447c0 0x7f0d741dd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.221 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.213+0000 7f0d7a0ae640 1 -- 172.21.15.104:0/843608886 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d74143f50 con 0x7f0d741dd7a0 2023-09-13T02:13:33.222 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.214+0000 7f0d7a0ae640 1 --2- 172.21.15.104:0/843608886 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d741dd7a0 0x7f0d740ae940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0d7406b460 tx=0x7f0d6c0013a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:33.222 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.214+0000 7f0d6a7fc640 1 -- 172.21.15.104:0/843608886 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c011660 con 0x7f0d741dd7a0 2023-09-13T02:13:33.222 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.214+0000 7f0d6a7fc640 1 -- 172.21.15.104:0/843608886 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0d6c0118d0 con 0x7f0d741dd7a0 2023-09-13T02:13:33.222 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.214+0000 7f0d7bb11640 1 -- 172.21.15.104:0/843608886 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d74144ca0 con 0x7f0d741dd7a0 2023-09-13T02:13:33.223 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.214+0000 7f0d6a7fc640 1 -- 172.21.15.104:0/843608886 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c011ce0 con 0x7f0d741dd7a0 2023-09-13T02:13:33.223 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.214+0000 7f0d7bb11640 1 -- 172.21.15.104:0/843608886 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d740b5320 con 0x7f0d741dd7a0 2023-09-13T02:13:33.223 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.215+0000 7f0d7bb11640 1 -- 172.21.15.104:0/843608886 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d741437e0 con 0x7f0d741dd7a0 2023-09-13T02:13:33.224 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.215+0000 7f0d6a7fc640 1 -- 172.21.15.104:0/843608886 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f0d6c0103c0 con 0x7f0d741dd7a0 2023-09-13T02:13:33.224 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.215+0000 7f0d6a7fc640 1 --2- 172.21.15.104:0/843608886 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0d5806a4f0 0x7f0d5806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.224 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.215+0000 7f0d798ad640 1 --2- 172.21.15.104:0/843608886 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0d5806a4f0 0x7f0d5806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.224 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.215+0000 7f0d6a7fc640 1 -- 172.21.15.104:0/843608886 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f0d6c089080 con 0x7f0d741dd7a0 2023-09-13T02:13:33.225 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.216+0000 7f0d6a7fc640 1 --2- 172.21.15.104:0/843608886 >> [v2:172.21.15.104:6808/3786698894,v1:172.21.15.104:6809/3786698894] conn(0x7f0d580728f0 0x7f0d58074d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.225 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.216+0000 7f0d6a7fc640 1 -- 172.21.15.104:0/843608886 --> [v2:172.21.15.104:6808/3786698894,v1:172.21.15.104:6809/3786698894] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d58075460 con 0x7f0d580728f0 2023-09-13T02:13:33.225 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.216+0000 7f0d6a7fc640 1 -- 172.21.15.104:0/843608886 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d6c08b740 con 0x7f0d741dd7a0 2023-09-13T02:13:33.225 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.216+0000 7f0d790ac640 1 --2- 172.21.15.104:0/843608886 >> [v2:172.21.15.104:6808/3786698894,v1:172.21.15.104:6809/3786698894] conn(0x7f0d580728f0 0x7f0d58074d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.226 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.216+0000 7f0d798ad640 1 --2- 172.21.15.104:0/843608886 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0d5806a4f0 0x7f0d5806c9b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0d70037000 tx=0x7f0d70004a40 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:33.226 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.216+0000 7f0d790ac640 1 --2- 172.21.15.104:0/843608886 >> [v2:172.21.15.104:6808/3786698894,v1:172.21.15.104:6809/3786698894] conn(0x7f0d580728f0 0x7f0d58074d90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:33.226 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.217+0000 7f0d6a7fc640 1 -- 172.21.15.104:0/843608886 <== osd.1 v2:172.21.15.104:6808/3786698894 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0d58075460 con 0x7f0d580728f0 2023-09-13T02:13:33.229 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.229+0000 7f0d7bb11640 1 -- 172.21.15.104:0/843608886 --> [v2:172.21.15.104:6808/3786698894,v1:172.21.15.104:6809/3786698894] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0d741482f0 con 0x7f0d580728f0 2023-09-13T02:13:33.229 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.229+0000 7f0d6a7fc640 1 -- 172.21.15.104:0/843608886 <== osd.1 v2:172.21.15.104:6808/3786698894 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0d64004b30 con 0x7f0d580728f0 2023-09-13T02:13:33.230 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2023-09-13T02:13:33.230 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-13T02:13:33.230 INFO:teuthology.orchestra.run.smithi104.stdout:} 2023-09-13T02:13:33.231 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.229+0000 7f0d7bb11640 1 -- 172.21.15.104:0/843608886 >> [v2:172.21.15.104:6808/3786698894,v1:172.21.15.104:6809/3786698894] conn(0x7f0d580728f0 msgr2=0x7f0d58074d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.232 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.229+0000 7f0d7bb11640 1 --2- 172.21.15.104:0/843608886 >> [v2:172.21.15.104:6808/3786698894,v1:172.21.15.104:6809/3786698894] conn(0x7f0d580728f0 0x7f0d58074d90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.232 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.230+0000 7f0d7bb11640 1 -- 172.21.15.104:0/843608886 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0d5806a4f0 msgr2=0x7f0d5806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.232 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.230+0000 7f0d7bb11640 1 --2- 172.21.15.104:0/843608886 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f0d5806a4f0 0x7f0d5806c9b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0d70037000 tx=0x7f0d70004a40 comp rx=0 tx=0).stop 2023-09-13T02:13:33.233 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.230+0000 7f0d7bb11640 1 -- 172.21.15.104:0/843608886 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d741dd7a0 msgr2=0x7f0d740ae940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.233 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.230+0000 7f0d7bb11640 1 --2- 172.21.15.104:0/843608886 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d741dd7a0 0x7f0d740ae940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0d7406b460 tx=0x7f0d6c0013a0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.233 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.230+0000 7f0d7a0ae640 1 -- 172.21.15.104:0/843608886 reap_dead start 2023-09-13T02:13:33.233 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.230+0000 7f0d7bb11640 1 -- 172.21.15.104:0/843608886 shutdown_connections 2023-09-13T02:13:33.234 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.230+0000 7f0d7bb11640 1 -- 172.21.15.104:0/843608886 >> 172.21.15.104:0/843608886 conn(0x7f0d740708b0 msgr2=0x7f0d740b7940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:33.234 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.230+0000 7f0d7bb11640 1 -- 172.21.15.104:0/843608886 shutdown_connections 2023-09-13T02:13:33.234 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.230+0000 7f0d7bb11640 1 -- 172.21.15.104:0/843608886 wait complete. 2023-09-13T02:13:33.240 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-09-13T02:13:33.343 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.342+0000 7f373be89640 1 -- 172.21.15.104:0/1634960621 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f37340b5ba0 msgr2=0x7f373414ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.343 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.342+0000 7f373be89640 1 --2- 172.21.15.104:0/1634960621 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f37340b5ba0 0x7f373414ec50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f372c005fd0 tx=0x7f372c02c240 comp rx=0 tx=0).stop 2023-09-13T02:13:33.343 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.342+0000 7f373be89640 1 -- 172.21.15.104:0/1634960621 shutdown_connections 2023-09-13T02:13:33.344 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.342+0000 7f373be89640 1 --2- 172.21.15.104:0/1634960621 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f37340b5ba0 0x7f373414ec50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.344 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.342+0000 7f373be89640 1 --2- 172.21.15.104:0/1634960621 >> v2:172.21.15.119:3300/0 conn(0x7f3734147b90 0x7f37341482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.344 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.342+0000 7f373be89640 1 -- 172.21.15.104:0/1634960621 >> 172.21.15.104:0/1634960621 conn(0x7f37340708b0 msgr2=0x7f3734070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:33.345 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.342+0000 7f373be89640 1 -- 172.21.15.104:0/1634960621 shutdown_connections 2023-09-13T02:13:33.345 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.342+0000 7f373be89640 1 -- 172.21.15.104:0/1634960621 wait complete. 2023-09-13T02:13:33.347 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.343+0000 7f373be89640 1 Processor -- start 2023-09-13T02:13:33.348 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.343+0000 7f373be89640 1 -- start start 2023-09-13T02:13:33.348 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.344+0000 7f373be89640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37340b5ba0 0x7f3734138f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.348 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.344+0000 7f373be89640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3734147b90 0x7f3734143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.344+0000 7f373be89640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37340ad7c0 0x7f37340adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.344+0000 7f373be89640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37340af600 con 0x7f37340ad7c0 2023-09-13T02:13:33.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.344+0000 7f373be89640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3734144150 con 0x7f37340b5ba0 2023-09-13T02:13:33.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.344+0000 7f373be89640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37340aefd0 con 0x7f3734147b90 2023-09-13T02:13:33.350 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.344+0000 7f373a426640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37340ad7c0 0x7f37340adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.350 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.344+0000 7f373a426640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37340ad7c0 0x7f37340adc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49302/0 (socket says 172.21.15.104:49302) 2023-09-13T02:13:33.350 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.344+0000 7f373a426640 1 -- 172.21.15.104:0/2686165723 learned_addr learned my addr 172.21.15.104:0/2686165723 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:33.351 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.344+0000 7f3739c25640 1 --2- 172.21.15.104:0/2686165723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37340b5ba0 0x7f3734138f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.351 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.344+0000 7f3739424640 1 --2- 172.21.15.104:0/2686165723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3734147b90 0x7f3734143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.351 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.344+0000 7f373a426640 1 -- 172.21.15.104:0/2686165723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3734147b90 msgr2=0x7f3734143c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.351 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.344+0000 7f373a426640 1 --2- 172.21.15.104:0/2686165723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3734147b90 0x7f3734143c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.344+0000 7f373a426640 1 -- 172.21.15.104:0/2686165723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37340b5ba0 msgr2=0x7f3734138f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.344+0000 7f373a426640 1 --2- 172.21.15.104:0/2686165723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37340b5ba0 0x7f3734138f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.344+0000 7f373a426640 1 -- 172.21.15.104:0/2686165723 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c009900 con 0x7f37340ad7c0 2023-09-13T02:13:33.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.344+0000 7f373a426640 1 --2- 172.21.15.104:0/2686165723 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37340ad7c0 0x7f37340adc30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f372c009d90 tx=0x7f372c035e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:33.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.345+0000 7f372a7fc640 1 -- 172.21.15.104:0/2686165723 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c034440 con 0x7f37340ad7c0 2023-09-13T02:13:33.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.345+0000 7f372a7fc640 1 -- 172.21.15.104:0/2686165723 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f372c003e60 con 0x7f37340ad7c0 2023-09-13T02:13:33.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.345+0000 7f373be89640 1 -- 172.21.15.104:0/2686165723 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3734144390 con 0x7f37340ad7c0 2023-09-13T02:13:33.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.345+0000 7f372a7fc640 1 -- 172.21.15.104:0/2686165723 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c0044b0 con 0x7f37340ad7c0 2023-09-13T02:13:33.354 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.345+0000 7f373be89640 1 -- 172.21.15.104:0/2686165723 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3734139950 con 0x7f37340ad7c0 2023-09-13T02:13:33.354 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.346+0000 7f373be89640 1 -- 172.21.15.104:0/2686165723 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37340af740 con 0x7f37340ad7c0 2023-09-13T02:13:33.354 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.346+0000 7f372a7fc640 1 -- 172.21.15.104:0/2686165723 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f372c00a040 con 0x7f37340ad7c0 2023-09-13T02:13:33.355 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.346+0000 7f372a7fc640 1 --2- 172.21.15.104:0/2686165723 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f371806a4f0 0x7f371806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.355 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.346+0000 7f3739c25640 1 --2- 172.21.15.104:0/2686165723 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f371806a4f0 0x7f371806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.355 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.346+0000 7f372a7fc640 1 -- 172.21.15.104:0/2686165723 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f372c0ab840 con 0x7f37340ad7c0 2023-09-13T02:13:33.355 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.347+0000 7f3739c25640 1 --2- 172.21.15.104:0/2686165723 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f371806a4f0 0x7f371806c9b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3730009ac0 tx=0x7f3730005f90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:33.356 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.350+0000 7f372a7fc640 1 -- 172.21.15.104:0/2686165723 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f37340af740 con 0x7f37340ad7c0 2023-09-13T02:13:33.516 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.516+0000 7f373be89640 1 -- 172.21.15.104:0/2686165723 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f37340b04d0 con 0x7f371806a4f0 2023-09-13T02:13:33.517 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.516+0000 7f372a7fc640 1 -- 172.21.15.104:0/2686165723 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3730016070 con 0x7f371806a4f0 2023-09-13T02:13:33.517 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 1 to deep-scrub 2023-09-13T02:13:33.518 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.518+0000 7f373be89640 1 -- 172.21.15.104:0/2686165723 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f371806a4f0 msgr2=0x7f371806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.519 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.518+0000 7f373be89640 1 --2- 172.21.15.104:0/2686165723 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f371806a4f0 0x7f371806c9b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3730009ac0 tx=0x7f3730005f90 comp rx=0 tx=0).stop 2023-09-13T02:13:33.519 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.518+0000 7f373be89640 1 -- 172.21.15.104:0/2686165723 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37340ad7c0 msgr2=0x7f37340adc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.519 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.518+0000 7f373be89640 1 --2- 172.21.15.104:0/2686165723 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37340ad7c0 0x7f37340adc30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f372c009d90 tx=0x7f372c035e30 comp rx=0 tx=0).stop 2023-09-13T02:13:33.519 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.518+0000 7f373be89640 1 -- 172.21.15.104:0/2686165723 shutdown_connections 2023-09-13T02:13:33.520 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.518+0000 7f373be89640 1 --2- 172.21.15.104:0/2686165723 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f371806a4f0 0x7f371806c9b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.520 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.518+0000 7f373be89640 1 --2- 172.21.15.104:0/2686165723 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37340ad7c0 0x7f37340adc30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.520 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.518+0000 7f373be89640 1 --2- 172.21.15.104:0/2686165723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3734147b90 0x7f3734143c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.518+0000 7f373be89640 1 --2- 172.21.15.104:0/2686165723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37340b5ba0 0x7f3734138f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.518+0000 7f373be89640 1 -- 172.21.15.104:0/2686165723 >> 172.21.15.104:0/2686165723 conn(0x7f37340708b0 msgr2=0x7f3734139ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.518+0000 7f373be89640 1 -- 172.21.15.104:0/2686165723 shutdown_connections 2023-09-13T02:13:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.518+0000 7f373be89640 1 -- 172.21.15.104:0/2686165723 wait complete. 2023-09-13T02:13:33.528 INFO:tasks.ceph:Scrubbing osd.2 2023-09-13T02:13:33.529 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-09-13T02:13:33.634 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.633+0000 7f1bd6f05640 1 -- 172.21.15.104:0/734210464 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bd013be60 msgr2=0x7f1bd013c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.634 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.633+0000 7f1bd6f05640 1 --2- 172.21.15.104:0/734210464 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bd013be60 0x7f1bd013c310 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8005fd0 tx=0x7f1bc802bd90 comp rx=0 tx=0).stop 2023-09-13T02:13:33.635 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.633+0000 7f1bd6f05640 1 -- 172.21.15.104:0/734210464 shutdown_connections 2023-09-13T02:13:33.635 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.633+0000 7f1bd6f05640 1 --2- 172.21.15.104:0/734210464 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bd013be60 0x7f1bd013c310 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.635 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.633+0000 7f1bd6f05640 1 --2- 172.21.15.104:0/734210464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bd0070fd0 0x7f1bd01425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.635 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.633+0000 7f1bd6f05640 1 -- 172.21.15.104:0/734210464 >> 172.21.15.104:0/734210464 conn(0x7f1bd0069b30 msgr2=0x7f1bd00b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:33.636 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.633+0000 7f1bd6f05640 1 -- 172.21.15.104:0/734210464 shutdown_connections 2023-09-13T02:13:33.636 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.633+0000 7f1bd6f05640 1 -- 172.21.15.104:0/734210464 wait complete. 2023-09-13T02:13:33.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.634+0000 7f1bd6f05640 1 Processor -- start 2023-09-13T02:13:33.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.634+0000 7f1bd6f05640 1 -- start start 2023-09-13T02:13:33.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.635+0000 7f1bd6f05640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bd006fb50 0x7f1bd00ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.635+0000 7f1bd6f05640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd0070fd0 0x7f1bd00aaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.635+0000 7f1bd6f05640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bd013be60 0x7f1bd01dd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.635+0000 7f1bd6f05640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd013f3c0 con 0x7f1bd006fb50 2023-09-13T02:13:33.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.635+0000 7f1bd6f05640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00ab6e0 con 0x7f1bd0070fd0 2023-09-13T02:13:33.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.635+0000 7f1bd6f05640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00ac590 con 0x7f1bd013be60 2023-09-13T02:13:33.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.635+0000 7f1bd4ca1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bd006fb50 0x7f1bd00ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.635+0000 7f1bd4ca1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bd006fb50 0x7f1bd00ad270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49328/0 (socket says 172.21.15.104:49328) 2023-09-13T02:13:33.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.635+0000 7f1bd4ca1640 1 -- 172.21.15.104:0/3074462648 learned_addr learned my addr 172.21.15.104:0/3074462648 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:33.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.635+0000 7f1bd54a2640 1 --2- 172.21.15.104:0/3074462648 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bd013be60 0x7f1bd01dd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.635+0000 7f1bc7fff640 1 --2- 172.21.15.104:0/3074462648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd0070fd0 0x7f1bd00aaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.635+0000 7f1bd4ca1640 1 -- 172.21.15.104:0/3074462648 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bd013be60 msgr2=0x7f1bd01dd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.635+0000 7f1bd4ca1640 1 --2- 172.21.15.104:0/3074462648 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bd013be60 0x7f1bd01dd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.635+0000 7f1bd4ca1640 1 -- 172.21.15.104:0/3074462648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd0070fd0 msgr2=0x7f1bd00aaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.635+0000 7f1bd4ca1640 1 --2- 172.21.15.104:0/3074462648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd0070fd0 0x7f1bd00aaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.635+0000 7f1bd4ca1640 1 -- 172.21.15.104:0/3074462648 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc8009560 con 0x7f1bd006fb50 2023-09-13T02:13:33.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.636+0000 7f1bd4ca1640 1 --2- 172.21.15.104:0/3074462648 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bd006fb50 0x7f1bd00ad270 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00ebf0 tx=0x7f1bcc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:33.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.636+0000 7f1bc57fa640 1 -- 172.21.15.104:0/3074462648 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc010630 con 0x7f1bd006fb50 2023-09-13T02:13:33.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.636+0000 7f1bc57fa640 1 -- 172.21.15.104:0/3074462648 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1bcc00ced0 con 0x7f1bd006fb50 2023-09-13T02:13:33.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.636+0000 7f1bc57fa640 1 -- 172.21.15.104:0/3074462648 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc010b20 con 0x7f1bd006fb50 2023-09-13T02:13:33.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.636+0000 7f1bd6f05640 1 -- 172.21.15.104:0/3074462648 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd00aaf70 con 0x7f1bd006fb50 2023-09-13T02:13:33.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.636+0000 7f1bd6f05640 1 -- 172.21.15.104:0/3074462648 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd00ac800 con 0x7f1bd006fb50 2023-09-13T02:13:33.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.637+0000 7f1bd6f05640 1 -- 172.21.15.104:0/3074462648 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1bd004e100 con 0x7f1bd006fb50 2023-09-13T02:13:33.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.637+0000 7f1bc57fa640 1 -- 172.21.15.104:0/3074462648 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f1bcc010c80 con 0x7f1bd006fb50 2023-09-13T02:13:33.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.638+0000 7f1bc57fa640 1 --2- 172.21.15.104:0/3074462648 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f1bbc06a4f0 0x7f1bbc06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.638+0000 7f1bc7fff640 1 --2- 172.21.15.104:0/3074462648 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f1bbc06a4f0 0x7f1bbc06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.638+0000 7f1bc57fa640 1 -- 172.21.15.104:0/3074462648 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f1bcc014070 con 0x7f1bd006fb50 2023-09-13T02:13:33.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.638+0000 7f1bc57fa640 1 --2- 172.21.15.104:0/3074462648 >> [v2:172.21.15.104:6817/2319361072,v1:172.21.15.104:6819/2319361072] conn(0x7f1bbc0728f0 0x7f1bbc074d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.638+0000 7f1bc57fa640 1 -- 172.21.15.104:0/3074462648 --> [v2:172.21.15.104:6817/2319361072,v1:172.21.15.104:6819/2319361072] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1bbc075460 con 0x7f1bbc0728f0 2023-09-13T02:13:33.648 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.638+0000 7f1bc57fa640 1 -- 172.21.15.104:0/3074462648 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bcc08be40 con 0x7f1bd006fb50 2023-09-13T02:13:33.648 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.638+0000 7f1bd54a2640 1 --2- 172.21.15.104:0/3074462648 >> [v2:172.21.15.104:6817/2319361072,v1:172.21.15.104:6819/2319361072] conn(0x7f1bbc0728f0 0x7f1bbc074d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.648 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.638+0000 7f1bc7fff640 1 --2- 172.21.15.104:0/3074462648 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f1bbc06a4f0 0x7f1bbc06c9b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00b1b60 tx=0x7f1bc0009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:33.648 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.638+0000 7f1bd54a2640 1 --2- 172.21.15.104:0/3074462648 >> [v2:172.21.15.104:6817/2319361072,v1:172.21.15.104:6819/2319361072] conn(0x7f1bbc0728f0 0x7f1bbc074d90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:33.649 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.639+0000 7f1bc57fa640 1 -- 172.21.15.104:0/3074462648 <== osd.2 v2:172.21.15.104:6817/2319361072 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f1bbc075460 con 0x7f1bbc0728f0 2023-09-13T02:13:33.651 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.651+0000 7f1bd6f05640 1 -- 172.21.15.104:0/3074462648 --> [v2:172.21.15.104:6817/2319361072,v1:172.21.15.104:6819/2319361072] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1bd013b8f0 con 0x7f1bbc0728f0 2023-09-13T02:13:33.652 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.651+0000 7f1bc57fa640 1 -- 172.21.15.104:0/3074462648 <== osd.2 v2:172.21.15.104:6817/2319361072 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1bd013b8f0 con 0x7f1bbc0728f0 2023-09-13T02:13:33.652 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2023-09-13T02:13:33.652 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-13T02:13:33.653 INFO:teuthology.orchestra.run.smithi104.stdout:} 2023-09-13T02:13:33.654 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.652+0000 7f1bd6f05640 1 -- 172.21.15.104:0/3074462648 >> [v2:172.21.15.104:6817/2319361072,v1:172.21.15.104:6819/2319361072] conn(0x7f1bbc0728f0 msgr2=0x7f1bbc074d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.654 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.652+0000 7f1bd6f05640 1 --2- 172.21.15.104:0/3074462648 >> [v2:172.21.15.104:6817/2319361072,v1:172.21.15.104:6819/2319361072] conn(0x7f1bbc0728f0 0x7f1bbc074d90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.654 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.652+0000 7f1bd6f05640 1 -- 172.21.15.104:0/3074462648 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f1bbc06a4f0 msgr2=0x7f1bbc06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.652+0000 7f1bd6f05640 1 --2- 172.21.15.104:0/3074462648 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f1bbc06a4f0 0x7f1bbc06c9b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00b1b60 tx=0x7f1bc0009040 comp rx=0 tx=0).stop 2023-09-13T02:13:33.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.652+0000 7f1bd6f05640 1 -- 172.21.15.104:0/3074462648 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bd006fb50 msgr2=0x7f1bd00ad270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.655 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.652+0000 7f1bd6f05640 1 --2- 172.21.15.104:0/3074462648 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bd006fb50 0x7f1bd00ad270 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00ebf0 tx=0x7f1bcc00c6a0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.652+0000 7f1bd54a2640 1 -- 172.21.15.104:0/3074462648 reap_dead start 2023-09-13T02:13:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.652+0000 7f1bd6f05640 1 -- 172.21.15.104:0/3074462648 shutdown_connections 2023-09-13T02:13:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.652+0000 7f1bd6f05640 1 -- 172.21.15.104:0/3074462648 >> 172.21.15.104:0/3074462648 conn(0x7f1bd0069b30 msgr2=0x7f1bd00b4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.652+0000 7f1bd6f05640 1 -- 172.21.15.104:0/3074462648 shutdown_connections 2023-09-13T02:13:33.657 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.652+0000 7f1bd6f05640 1 -- 172.21.15.104:0/3074462648 wait complete. 2023-09-13T02:13:33.662 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-09-13T02:13:33.765 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.764+0000 7ff8ae4d7640 1 -- 172.21.15.104:0/1965627324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff890003970 msgr2=0x7ff890003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.765 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.764+0000 7ff8ae4d7640 1 --2- 172.21.15.104:0/1965627324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff890003970 0x7ff890003d90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff898009b50 tx=0x7ff8900057f0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.765 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.764+0000 7ff8aca74640 1 -- 172.21.15.104:0/1965627324 reap_dead start 2023-09-13T02:13:33.766 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.764+0000 7ff8ae4d7640 1 -- 172.21.15.104:0/1965627324 shutdown_connections 2023-09-13T02:13:33.766 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.764+0000 7ff8ae4d7640 1 -- 172.21.15.104:0/1965627324 >> 172.21.15.104:0/1965627324 conn(0x7ff8a80708b0 msgr2=0x7ff8a8070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:33.766 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.764+0000 7ff8ae4d7640 1 -- 172.21.15.104:0/1965627324 shutdown_connections 2023-09-13T02:13:33.767 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.764+0000 7ff8ae4d7640 1 -- 172.21.15.104:0/1965627324 wait complete. 2023-09-13T02:13:33.769 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.765+0000 7ff8ae4d7640 1 Processor -- start 2023-09-13T02:13:33.770 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8ae4d7640 1 -- start start 2023-09-13T02:13:33.770 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8ae4d7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff890003970 0x7ff8a8143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.770 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8ae4d7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8a81429c0 0x7ff8a81da210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8ae4d7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8a81da750 0x7ff8a81dd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8ae4d7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a81438c0 con 0x7ff8a81da750 2023-09-13T02:13:33.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8ae4d7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a81dabd0 con 0x7ff8a81429c0 2023-09-13T02:13:33.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8ae4d7640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a80ba210 con 0x7ff890003970 2023-09-13T02:13:33.772 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8aca74640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8a81da750 0x7ff8a81dd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.772 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8aca74640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8a81da750 0x7ff8a81dd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49336/0 (socket says 172.21.15.104:49336) 2023-09-13T02:13:33.772 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8aca74640 1 -- 172.21.15.104:0/380413232 learned_addr learned my addr 172.21.15.104:0/380413232 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:33.772 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8a77fe640 1 --2- 172.21.15.104:0/380413232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8a81429c0 0x7ff8a81da210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.773 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8a7fff640 1 --2- 172.21.15.104:0/380413232 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff890003970 0x7ff8a8143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.773 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8aca74640 1 -- 172.21.15.104:0/380413232 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff890003970 msgr2=0x7ff8a8143380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.773 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8aca74640 1 --2- 172.21.15.104:0/380413232 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff890003970 0x7ff8a8143380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.774 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8aca74640 1 -- 172.21.15.104:0/380413232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8a81429c0 msgr2=0x7ff8a81da210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.774 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8aca74640 1 --2- 172.21.15.104:0/380413232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8a81429c0 0x7ff8a81da210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.774 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8aca74640 1 -- 172.21.15.104:0/380413232 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a80ba460 con 0x7ff8a81da750 2023-09-13T02:13:33.775 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.766+0000 7ff8a77fe640 1 --2- 172.21.15.104:0/380413232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8a81429c0 0x7ff8a81da210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:13:33.775 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.767+0000 7ff8aca74640 1 --2- 172.21.15.104:0/380413232 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8a81da750 0x7ff8a81dd180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0005fd0 tx=0x7ff8a0010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:33.775 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.767+0000 7ff8a4ff9640 1 -- 172.21.15.104:0/380413232 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a000ee80 con 0x7ff8a81da750 2023-09-13T02:13:33.775 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.767+0000 7ff8a4ff9640 1 -- 172.21.15.104:0/380413232 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff8a0003a60 con 0x7ff8a81da750 2023-09-13T02:13:33.776 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.767+0000 7ff8ae4d7640 1 -- 172.21.15.104:0/380413232 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a81ced60 con 0x7ff8a81da750 2023-09-13T02:13:33.776 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.767+0000 7ff8a4ff9640 1 -- 172.21.15.104:0/380413232 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0003e70 con 0x7ff8a81da750 2023-09-13T02:13:33.776 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.767+0000 7ff8ae4d7640 1 -- 172.21.15.104:0/380413232 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a8142660 con 0x7ff8a81da750 2023-09-13T02:13:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.768+0000 7ff8ae4d7640 1 -- 172.21.15.104:0/380413232 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a804e100 con 0x7ff8a81da750 2023-09-13T02:13:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.768+0000 7ff8a4ff9640 1 -- 172.21.15.104:0/380413232 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff8a0019030 con 0x7ff8a81da750 2023-09-13T02:13:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.769+0000 7ff8a4ff9640 1 --2- 172.21.15.104:0/380413232 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff89406a4f0 0x7ff89406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.769+0000 7ff8a7fff640 1 --2- 172.21.15.104:0/380413232 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff89406a4f0 0x7ff89406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:33.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.769+0000 7ff8a4ff9640 1 -- 172.21.15.104:0/380413232 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5881+0+0 (secure 0 0 0) 0x7ff8a0017070 con 0x7ff8a81da750 2023-09-13T02:13:33.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.769+0000 7ff8a7fff640 1 --2- 172.21.15.104:0/380413232 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff89406a4f0 0x7ff89406c9b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff898036000 tx=0x7ff8980046c0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:33.779 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.773+0000 7ff8a4ff9640 1 -- 172.21.15.104:0/380413232 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff8a00549f0 con 0x7ff8a81da750 2023-09-13T02:13:33.941 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.941+0000 7ff8ae4d7640 1 -- 172.21.15.104:0/380413232 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8a80b04d0 con 0x7ff89406a4f0 2023-09-13T02:13:33.942 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.941+0000 7ff8a4ff9640 1 -- 172.21.15.104:0/380413232 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff898041070 con 0x7ff89406a4f0 2023-09-13T02:13:33.942 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 2 to deep-scrub 2023-09-13T02:13:33.944 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.943+0000 7ff8ae4d7640 1 -- 172.21.15.104:0/380413232 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff89406a4f0 msgr2=0x7ff89406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.944 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.943+0000 7ff8ae4d7640 1 --2- 172.21.15.104:0/380413232 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff89406a4f0 0x7ff89406c9b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff898036000 tx=0x7ff8980046c0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.944 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.943+0000 7ff8ae4d7640 1 -- 172.21.15.104:0/380413232 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8a81da750 msgr2=0x7ff8a81dd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:33.944 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.943+0000 7ff8ae4d7640 1 --2- 172.21.15.104:0/380413232 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8a81da750 0x7ff8a81dd180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0005fd0 tx=0x7ff8a0010f40 comp rx=0 tx=0).stop 2023-09-13T02:13:33.945 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.943+0000 7ff8ae4d7640 1 -- 172.21.15.104:0/380413232 shutdown_connections 2023-09-13T02:13:33.945 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.943+0000 7ff8ae4d7640 1 --2- 172.21.15.104:0/380413232 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff89406a4f0 0x7ff89406c9b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.945 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.943+0000 7ff8ae4d7640 1 --2- 172.21.15.104:0/380413232 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8a81da750 0x7ff8a81dd180 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.946 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.943+0000 7ff8ae4d7640 1 --2- 172.21.15.104:0/380413232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8a81429c0 0x7ff8a81da210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.946 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.943+0000 7ff8ae4d7640 1 --2- 172.21.15.104:0/380413232 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff890003970 0x7ff8a8143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:33.946 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.943+0000 7ff8ae4d7640 1 -- 172.21.15.104:0/380413232 >> 172.21.15.104:0/380413232 conn(0x7ff8a80708b0 msgr2=0x7ff8a80b6230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:33.946 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.943+0000 7ff8ae4d7640 1 -- 172.21.15.104:0/380413232 shutdown_connections 2023-09-13T02:13:33.947 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:33.943+0000 7ff8ae4d7640 1 -- 172.21.15.104:0/380413232 wait complete. 2023-09-13T02:13:33.954 INFO:tasks.ceph:Scrubbing osd.3 2023-09-13T02:13:33.954 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-09-13T02:13:34.059 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.059+0000 7fc7774b4640 1 -- 172.21.15.104:0/749818693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc75c005180 msgr2=0x7fc75c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.060 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.059+0000 7fc7774b4640 1 --2- 172.21.15.104:0/749818693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc75c005180 0x7fc75c00b980 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc768001680 tx=0x7fc75c0057f0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.060 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.059+0000 7fc7774b4640 1 -- 172.21.15.104:0/749818693 shutdown_connections 2023-09-13T02:13:34.060 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.059+0000 7fc7774b4640 1 --2- 172.21.15.104:0/749818693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc75c005180 0x7fc75c00b980 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.061 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.059+0000 7fc7774b4640 1 -- 172.21.15.104:0/749818693 >> 172.21.15.104:0/749818693 conn(0x7fc770069b30 msgr2=0x7fc7700b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:34.061 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.059+0000 7fc7774b4640 1 -- 172.21.15.104:0/749818693 shutdown_connections 2023-09-13T02:13:34.061 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.059+0000 7fc7774b4640 1 -- 172.21.15.104:0/749818693 wait complete. 2023-09-13T02:13:34.064 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.060+0000 7fc7774b4640 1 Processor -- start 2023-09-13T02:13:34.065 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.060+0000 7fc7774b4640 1 -- start start 2023-09-13T02:13:34.065 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc7774b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc75c005180 0x7fc7701cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.065 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc7774b4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc77013f180 0x7fc7701dd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.065 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc7774b4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc77013f600 0x7fc7701dd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.066 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc7774b4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77013d8d0 con 0x7fc77013f600 2023-09-13T02:13:34.066 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc7774b4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77013d250 con 0x7fc75c005180 2023-09-13T02:13:34.066 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc7774b4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77013ce10 con 0x7fc77013f180 2023-09-13T02:13:34.067 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc775a51640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc77013f600 0x7fc7701dd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.067 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc775a51640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc77013f600 0x7fc7701dd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49350/0 (socket says 172.21.15.104:49350) 2023-09-13T02:13:34.067 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc775a51640 1 -- 172.21.15.104:0/1194152276 learned_addr learned my addr 172.21.15.104:0/1194152276 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:34.067 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc774a4f640 1 --2- 172.21.15.104:0/1194152276 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc77013f180 0x7fc7701dd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.068 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc775250640 1 --2- 172.21.15.104:0/1194152276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc75c005180 0x7fc7701cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.068 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc775a51640 1 -- 172.21.15.104:0/1194152276 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc77013f180 msgr2=0x7fc7701dd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.068 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc775a51640 1 --2- 172.21.15.104:0/1194152276 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc77013f180 0x7fc7701dd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.069 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc775a51640 1 -- 172.21.15.104:0/1194152276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc75c005180 msgr2=0x7fc7701cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.069 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc775a51640 1 --2- 172.21.15.104:0/1194152276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc75c005180 0x7fc7701cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.069 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc775a51640 1 -- 172.21.15.104:0/1194152276 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77013e7d0 con 0x7fc77013f600 2023-09-13T02:13:34.069 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc775a51640 1 --2- 172.21.15.104:0/1194152276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc77013f600 0x7fc7701dd810 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc7680017a0 tx=0x7fc768003e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:34.070 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.061+0000 7fc765ffb640 1 -- 172.21.15.104:0/1194152276 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7680068e0 con 0x7fc77013f600 2023-09-13T02:13:34.070 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.062+0000 7fc765ffb640 1 -- 172.21.15.104:0/1194152276 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc76802c850 con 0x7fc77013f600 2023-09-13T02:13:34.070 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.062+0000 7fc7774b4640 1 -- 172.21.15.104:0/1194152276 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77013ca00 con 0x7fc77013f600 2023-09-13T02:13:34.071 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.062+0000 7fc765ffb640 1 -- 172.21.15.104:0/1194152276 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76802cc60 con 0x7fc77013f600 2023-09-13T02:13:34.071 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.062+0000 7fc7774b4640 1 -- 172.21.15.104:0/1194152276 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77006b670 con 0x7fc77013f600 2023-09-13T02:13:34.071 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.063+0000 7fc7774b4640 1 -- 172.21.15.104:0/1194152276 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc77013cc80 con 0x7fc77013f600 2023-09-13T02:13:34.071 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.063+0000 7fc765ffb640 1 -- 172.21.15.104:0/1194152276 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc76803e410 con 0x7fc77013f600 2023-09-13T02:13:34.072 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.063+0000 7fc765ffb640 1 --2- 172.21.15.104:0/1194152276 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fc75406a520 0x7fc75406c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.072 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.064+0000 7fc765ffb640 1 -- 172.21.15.104:0/1194152276 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fc7680a9b80 con 0x7fc77013f600 2023-09-13T02:13:34.072 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.064+0000 7fc775250640 1 --2- 172.21.15.104:0/1194152276 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fc75406a520 0x7fc75406c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.072 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.064+0000 7fc765ffb640 1 --2- 172.21.15.104:0/1194152276 >> [v2:172.21.15.104:6816/621253853,v1:172.21.15.104:6818/621253853] conn(0x7fc754072920 0x7fc754074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.073 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.064+0000 7fc765ffb640 1 -- 172.21.15.104:0/1194152276 --> [v2:172.21.15.104:6816/621253853,v1:172.21.15.104:6818/621253853] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc754075490 con 0x7fc754072920 2023-09-13T02:13:34.073 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.064+0000 7fc765ffb640 1 -- 172.21.15.104:0/1194152276 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7680ae260 con 0x7fc77013f600 2023-09-13T02:13:34.073 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.064+0000 7fc774a4f640 1 --2- 172.21.15.104:0/1194152276 >> [v2:172.21.15.104:6816/621253853,v1:172.21.15.104:6818/621253853] conn(0x7fc754072920 0x7fc754074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.074 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.064+0000 7fc775250640 1 --2- 172.21.15.104:0/1194152276 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fc75406a520 0x7fc75406c9e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc76c006fd0 tx=0x7fc76c0014f0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:34.074 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.064+0000 7fc774a4f640 1 --2- 172.21.15.104:0/1194152276 >> [v2:172.21.15.104:6816/621253853,v1:172.21.15.104:6818/621253853] conn(0x7fc754072920 0x7fc754074dc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:34.074 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.065+0000 7fc765ffb640 1 -- 172.21.15.104:0/1194152276 <== osd.3 v2:172.21.15.104:6816/621253853 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc754075490 con 0x7fc754072920 2023-09-13T02:13:34.077 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.077+0000 7fc7774b4640 1 -- 172.21.15.104:0/1194152276 --> [v2:172.21.15.104:6816/621253853,v1:172.21.15.104:6818/621253853] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc77013da10 con 0x7fc754072920 2023-09-13T02:13:34.077 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.077+0000 7fc765ffb640 1 -- 172.21.15.104:0/1194152276 <== osd.3 v2:172.21.15.104:6816/621253853 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc77013da10 con 0x7fc754072920 2023-09-13T02:13:34.078 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2023-09-13T02:13:34.078 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-13T02:13:34.079 INFO:teuthology.orchestra.run.smithi104.stdout:} 2023-09-13T02:13:34.079 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.078+0000 7fc7774b4640 1 -- 172.21.15.104:0/1194152276 >> [v2:172.21.15.104:6816/621253853,v1:172.21.15.104:6818/621253853] conn(0x7fc754072920 msgr2=0x7fc754074dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.080 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.078+0000 7fc7774b4640 1 --2- 172.21.15.104:0/1194152276 >> [v2:172.21.15.104:6816/621253853,v1:172.21.15.104:6818/621253853] conn(0x7fc754072920 0x7fc754074dc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.080 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.078+0000 7fc7774b4640 1 -- 172.21.15.104:0/1194152276 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fc75406a520 msgr2=0x7fc75406c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.080 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.078+0000 7fc7774b4640 1 --2- 172.21.15.104:0/1194152276 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fc75406a520 0x7fc75406c9e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc76c006fd0 tx=0x7fc76c0014f0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.081 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.078+0000 7fc7774b4640 1 -- 172.21.15.104:0/1194152276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc77013f600 msgr2=0x7fc7701dd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.081 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.078+0000 7fc7774b4640 1 --2- 172.21.15.104:0/1194152276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc77013f600 0x7fc7701dd810 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc7680017a0 tx=0x7fc768003e40 comp rx=0 tx=0).stop 2023-09-13T02:13:34.081 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.078+0000 7fc775a51640 1 -- 172.21.15.104:0/1194152276 reap_dead start 2023-09-13T02:13:34.082 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.078+0000 7fc7774b4640 1 -- 172.21.15.104:0/1194152276 shutdown_connections 2023-09-13T02:13:34.082 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.078+0000 7fc7774b4640 1 -- 172.21.15.104:0/1194152276 >> 172.21.15.104:0/1194152276 conn(0x7fc770069b30 msgr2=0x7fc7700b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:34.082 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.078+0000 7fc7774b4640 1 -- 172.21.15.104:0/1194152276 shutdown_connections 2023-09-13T02:13:34.082 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.078+0000 7fc7774b4640 1 -- 172.21.15.104:0/1194152276 wait complete. 2023-09-13T02:13:34.088 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-09-13T02:13:34.190 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.190+0000 7f3a990d4640 1 -- 172.21.15.104:0/2356499563 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9414caf0 msgr2=0x7f3a9414eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.191 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.190+0000 7f3a990d4640 1 --2- 172.21.15.104:0/2356499563 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9414caf0 0x7f3a9414eee0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c005fd0 tx=0x7f3a8c02c2e0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.191 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.190+0000 7f3a990d4640 1 -- 172.21.15.104:0/2356499563 shutdown_connections 2023-09-13T02:13:34.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.190+0000 7f3a990d4640 1 --2- 172.21.15.104:0/2356499563 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9414caf0 0x7f3a9414eee0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.190+0000 7f3a990d4640 1 --2- 172.21.15.104:0/2356499563 >> v2:172.21.15.119:3300/0 conn(0x7f3a940acda0 0x7f3a940b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.190+0000 7f3a990d4640 1 -- 172.21.15.104:0/2356499563 >> 172.21.15.104:0/2356499563 conn(0x7f3a940b56f0 msgr2=0x7f3a940b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:34.193 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.190+0000 7f3a990d4640 1 -- 172.21.15.104:0/2356499563 shutdown_connections 2023-09-13T02:13:34.193 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.190+0000 7f3a990d4640 1 -- 172.21.15.104:0/2356499563 wait complete. 2023-09-13T02:13:34.196 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.191+0000 7f3a990d4640 1 Processor -- start 2023-09-13T02:13:34.196 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.191+0000 7f3a990d4640 1 -- start start 2023-09-13T02:13:34.196 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.192+0000 7f3a990d4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a940acda0 0x7f3a940a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.196 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.192+0000 7f3a990d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a940ad180 0x7f3a9413fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.197 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.192+0000 7f3a990d4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9414caf0 0x7f3a941dd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.197 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.192+0000 7f3a990d4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940a85d0 con 0x7f3a940ad180 2023-09-13T02:13:34.197 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.192+0000 7f3a990d4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940a6c80 con 0x7f3a940acda0 2023-09-13T02:13:34.198 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.192+0000 7f3a990d4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940a9380 con 0x7f3a9414caf0 2023-09-13T02:13:34.198 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.192+0000 7f3a9259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a940ad180 0x7f3a9413fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.198 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.192+0000 7f3a9259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a940ad180 0x7f3a9413fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49360/0 (socket says 172.21.15.104:49360) 2023-09-13T02:13:34.199 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.192+0000 7f3a9259c640 1 -- 172.21.15.104:0/3615831382 learned_addr learned my addr 172.21.15.104:0/3615831382 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:34.199 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.192+0000 7f3a9359e640 1 --2- 172.21.15.104:0/3615831382 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9414caf0 0x7f3a941dd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.199 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.192+0000 7f3a92d9d640 1 --2- 172.21.15.104:0/3615831382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a940acda0 0x7f3a940a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.199 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.192+0000 7f3a9259c640 1 -- 172.21.15.104:0/3615831382 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9414caf0 msgr2=0x7f3a941dd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.200 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.192+0000 7f3a9259c640 1 --2- 172.21.15.104:0/3615831382 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9414caf0 0x7f3a941dd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.200 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.192+0000 7f3a9259c640 1 -- 172.21.15.104:0/3615831382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a940acda0 msgr2=0x7f3a940a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.200 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.192+0000 7f3a9259c640 1 --2- 172.21.15.104:0/3615831382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a940acda0 0x7f3a940a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.200 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.192+0000 7f3a9259c640 1 -- 172.21.15.104:0/3615831382 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c009900 con 0x7f3a940ad180 2023-09-13T02:13:34.201 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.192+0000 7f3a92d9d640 1 --2- 172.21.15.104:0/3615831382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a940acda0 0x7f3a940a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:13:34.201 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.193+0000 7f3a9259c640 1 --2- 172.21.15.104:0/3615831382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a940ad180 0x7f3a9413fae0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800c400 tx=0x7f3a8800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:34.201 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.193+0000 7f3a7b7fe640 1 -- 172.21.15.104:0/3615831382 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a880052d0 con 0x7f3a940ad180 2023-09-13T02:13:34.201 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.193+0000 7f3a7b7fe640 1 -- 172.21.15.104:0/3615831382 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3a880035f0 con 0x7f3a940ad180 2023-09-13T02:13:34.202 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.193+0000 7f3a990d4640 1 -- 172.21.15.104:0/3615831382 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a940a8390 con 0x7f3a940ad180 2023-09-13T02:13:34.202 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.193+0000 7f3a7b7fe640 1 -- 172.21.15.104:0/3615831382 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a88003a40 con 0x7f3a940ad180 2023-09-13T02:13:34.202 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.193+0000 7f3a990d4640 1 -- 172.21.15.104:0/3615831382 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a940a73a0 con 0x7f3a940ad180 2023-09-13T02:13:34.203 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.194+0000 7f3a990d4640 1 -- 172.21.15.104:0/3615831382 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a940a70c0 con 0x7f3a940ad180 2023-09-13T02:13:34.203 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.194+0000 7f3a7b7fe640 1 -- 172.21.15.104:0/3615831382 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f3a88003ba0 con 0x7f3a940ad180 2023-09-13T02:13:34.203 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.195+0000 7f3a7b7fe640 1 --2- 172.21.15.104:0/3615831382 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f3a8006a4f0 0x7f3a8006c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.203 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.195+0000 7f3a92d9d640 1 --2- 172.21.15.104:0/3615831382 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f3a8006a4f0 0x7f3a8006c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.204 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.195+0000 7f3a7b7fe640 1 -- 172.21.15.104:0/3615831382 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f3a880880d0 con 0x7f3a940ad180 2023-09-13T02:13:34.204 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.195+0000 7f3a92d9d640 1 --2- 172.21.15.104:0/3615831382 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f3a8006a4f0 0x7f3a8006c9b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3a940b55a0 tx=0x7f3a84005f90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:34.205 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.199+0000 7f3a7b7fe640 1 -- 172.21.15.104:0/3615831382 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3a940a70c0 con 0x7f3a940ad180 2023-09-13T02:13:34.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.364+0000 7f3a990d4640 1 -- 172.21.15.104:0/3615831382 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a941450a0 con 0x7f3a8006a4f0 2023-09-13T02:13:34.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.364+0000 7f3a7b7fe640 1 -- 172.21.15.104:0/3615831382 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3a84016070 con 0x7f3a8006a4f0 2023-09-13T02:13:34.365 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 3 to deep-scrub 2023-09-13T02:13:34.366 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.366+0000 7f3a990d4640 1 -- 172.21.15.104:0/3615831382 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f3a8006a4f0 msgr2=0x7f3a8006c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.367 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.366+0000 7f3a990d4640 1 --2- 172.21.15.104:0/3615831382 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f3a8006a4f0 0x7f3a8006c9b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3a940b55a0 tx=0x7f3a84005f90 comp rx=0 tx=0).stop 2023-09-13T02:13:34.367 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.366+0000 7f3a990d4640 1 -- 172.21.15.104:0/3615831382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a940ad180 msgr2=0x7f3a9413fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.367 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.366+0000 7f3a990d4640 1 --2- 172.21.15.104:0/3615831382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a940ad180 0x7f3a9413fae0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800c400 tx=0x7f3a8800c8c0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.368 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.366+0000 7f3a990d4640 1 -- 172.21.15.104:0/3615831382 shutdown_connections 2023-09-13T02:13:34.368 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.366+0000 7f3a990d4640 1 --2- 172.21.15.104:0/3615831382 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f3a8006a4f0 0x7f3a8006c9b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.368 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.366+0000 7f3a990d4640 1 --2- 172.21.15.104:0/3615831382 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9414caf0 0x7f3a941dd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.368 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.366+0000 7f3a990d4640 1 --2- 172.21.15.104:0/3615831382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a940ad180 0x7f3a9413fae0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.369 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.366+0000 7f3a990d4640 1 --2- 172.21.15.104:0/3615831382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a940acda0 0x7f3a940a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.369 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.366+0000 7f3a990d4640 1 -- 172.21.15.104:0/3615831382 >> 172.21.15.104:0/3615831382 conn(0x7f3a940b56f0 msgr2=0x7f3a9413ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:34.369 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.366+0000 7f3a990d4640 1 -- 172.21.15.104:0/3615831382 shutdown_connections 2023-09-13T02:13:34.369 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.366+0000 7f3a990d4640 1 -- 172.21.15.104:0/3615831382 wait complete. 2023-09-13T02:13:34.377 INFO:tasks.ceph:Scrubbing osd.4 2023-09-13T02:13:34.377 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-09-13T02:13:34.488 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.483+0000 7f3d12ef2640 1 -- 172.21.15.104:0/806937428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf40047c0 msgr2=0x7f3cf4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.489 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.483+0000 7f3d12ef2640 1 --2- 172.21.15.104:0/806937428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf40047c0 0x7f3cf4004c40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3d00001680 tx=0x7f3cf40057f0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.489 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.483+0000 7f3d1148f640 1 -- 172.21.15.104:0/806937428 reap_dead start 2023-09-13T02:13:34.489 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.483+0000 7f3d12ef2640 1 -- 172.21.15.104:0/806937428 shutdown_connections 2023-09-13T02:13:34.490 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.483+0000 7f3d12ef2640 1 -- 172.21.15.104:0/806937428 >> 172.21.15.104:0/806937428 conn(0x7f3d0c069b30 msgr2=0x7f3d0c0b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:34.490 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.483+0000 7f3d12ef2640 1 -- 172.21.15.104:0/806937428 shutdown_connections 2023-09-13T02:13:34.490 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.483+0000 7f3d12ef2640 1 -- 172.21.15.104:0/806937428 wait complete. 2023-09-13T02:13:34.491 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.484+0000 7f3d12ef2640 1 Processor -- start 2023-09-13T02:13:34.491 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.484+0000 7f3d12ef2640 1 -- start start 2023-09-13T02:13:34.491 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.485+0000 7f3d12ef2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf40047c0 0x7f3d0c13a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.491 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.485+0000 7f3d12ef2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d0c0a6a80 0x7f3d0c1db180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.492 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.485+0000 7f3d12ef2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d0c1db6c0 0x7f3d0c137940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.492 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.485+0000 7f3d12ef2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0ae3b0 con 0x7f3cf40047c0 2023-09-13T02:13:34.492 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.485+0000 7f3d12ef2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c1dbb40 con 0x7f3d0c0a6a80 2023-09-13T02:13:34.492 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.485+0000 7f3d12ef2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c139230 con 0x7f3d0c1db6c0 2023-09-13T02:13:34.493 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.485+0000 7f3d10c8e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf40047c0 0x7f3d0c13a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.493 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.485+0000 7f3d10c8e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf40047c0 0x7f3d0c13a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49374/0 (socket says 172.21.15.104:49374) 2023-09-13T02:13:34.493 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.485+0000 7f3d10c8e640 1 -- 172.21.15.104:0/1544294592 learned_addr learned my addr 172.21.15.104:0/1544294592 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:34.494 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.485+0000 7f3d1148f640 1 --2- 172.21.15.104:0/1544294592 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d0c1db6c0 0x7f3d0c137940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.494 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.485+0000 7f3d0bfff640 1 --2- 172.21.15.104:0/1544294592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d0c0a6a80 0x7f3d0c1db180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.494 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.485+0000 7f3d10c8e640 1 -- 172.21.15.104:0/1544294592 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d0c1db6c0 msgr2=0x7f3d0c137940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.494 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.485+0000 7f3d10c8e640 1 --2- 172.21.15.104:0/1544294592 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d0c1db6c0 0x7f3d0c137940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.495 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.485+0000 7f3d10c8e640 1 -- 172.21.15.104:0/1544294592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d0c0a6a80 msgr2=0x7f3d0c1db180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.495 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.485+0000 7f3d10c8e640 1 --2- 172.21.15.104:0/1544294592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d0c0a6a80 0x7f3d0c1db180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.495 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.485+0000 7f3d10c8e640 1 -- 172.21.15.104:0/1544294592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c0a7240 con 0x7f3cf40047c0 2023-09-13T02:13:34.496 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.485+0000 7f3d0bfff640 1 --2- 172.21.15.104:0/1544294592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d0c0a6a80 0x7f3d0c1db180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:13:34.496 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.486+0000 7f3d10c8e640 1 --2- 172.21.15.104:0/1544294592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf40047c0 0x7f3d0c13a550 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc006660 tx=0x7f3cfc003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:34.496 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.486+0000 7f3d097fa640 1 -- 172.21.15.104:0/1544294592 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc00f720 con 0x7f3cf40047c0 2023-09-13T02:13:34.496 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.486+0000 7f3d097fa640 1 -- 172.21.15.104:0/1544294592 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3cfc00f880 con 0x7f3cf40047c0 2023-09-13T02:13:34.497 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.486+0000 7f3d097fa640 1 -- 172.21.15.104:0/1544294592 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc00fc90 con 0x7f3cf40047c0 2023-09-13T02:13:34.497 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.486+0000 7f3d12ef2640 1 -- 172.21.15.104:0/1544294592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0c0a7520 con 0x7f3cf40047c0 2023-09-13T02:13:34.497 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.486+0000 7f3d12ef2640 1 -- 172.21.15.104:0/1544294592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0c1394d0 con 0x7f3cf40047c0 2023-09-13T02:13:34.498 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.487+0000 7f3d12ef2640 1 -- 172.21.15.104:0/1544294592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d0c04e100 con 0x7f3cf40047c0 2023-09-13T02:13:34.498 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.487+0000 7f3d097fa640 1 -- 172.21.15.104:0/1544294592 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f3cfc011430 con 0x7f3cf40047c0 2023-09-13T02:13:34.498 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.487+0000 7f3d097fa640 1 --2- 172.21.15.104:0/1544294592 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f3cf806a520 0x7f3cf806c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.498 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.488+0000 7f3d097fa640 1 -- 172.21.15.104:0/1544294592 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f3cfc089870 con 0x7f3cf40047c0 2023-09-13T02:13:34.499 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.488+0000 7f3d0bfff640 1 --2- 172.21.15.104:0/1544294592 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f3cf806a520 0x7f3cf806c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.499 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.488+0000 7f3d097fa640 1 --2- 172.21.15.104:0/1544294592 >> [v2:172.21.15.119:6800/3049794634,v1:172.21.15.119:6801/3049794634] conn(0x7f3cf8072920 0x7f3cf8074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.499 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.488+0000 7f3d097fa640 1 -- 172.21.15.104:0/1544294592 --> [v2:172.21.15.119:6800/3049794634,v1:172.21.15.119:6801/3049794634] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3cf8075490 con 0x7f3cf8072920 2023-09-13T02:13:34.500 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.488+0000 7f3d097fa640 1 -- 172.21.15.104:0/1544294592 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cfc08e2c0 con 0x7f3cf40047c0 2023-09-13T02:13:34.500 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.488+0000 7f3d1148f640 1 --2- 172.21.15.104:0/1544294592 >> [v2:172.21.15.119:6800/3049794634,v1:172.21.15.119:6801/3049794634] conn(0x7f3cf8072920 0x7f3cf8074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.500 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.488+0000 7f3d0bfff640 1 --2- 172.21.15.104:0/1544294592 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f3cf806a520 0x7f3cf806c9e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3d00034000 tx=0x7f3d00001190 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:34.500 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.488+0000 7f3d1148f640 1 --2- 172.21.15.104:0/1544294592 >> [v2:172.21.15.119:6800/3049794634,v1:172.21.15.119:6801/3049794634] conn(0x7f3cf8072920 0x7f3cf8074dc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:34.501 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.489+0000 7f3d097fa640 1 -- 172.21.15.104:0/1544294592 <== osd.4 v2:172.21.15.119:6800/3049794634 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f3cf8075490 con 0x7f3cf8072920 2023-09-13T02:13:34.502 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.502+0000 7f3d12ef2640 1 -- 172.21.15.104:0/1544294592 --> [v2:172.21.15.119:6800/3049794634,v1:172.21.15.119:6801/3049794634] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3d0c0008d0 con 0x7f3cf8072920 2023-09-13T02:13:34.502 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.502+0000 7f3d097fa640 1 -- 172.21.15.104:0/1544294592 <== osd.4 v2:172.21.15.119:6800/3049794634 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3d0c0008d0 con 0x7f3cf8072920 2023-09-13T02:13:34.503 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2023-09-13T02:13:34.503 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-13T02:13:34.503 INFO:teuthology.orchestra.run.smithi104.stdout:} 2023-09-13T02:13:34.504 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.502+0000 7f3d12ef2640 1 -- 172.21.15.104:0/1544294592 >> [v2:172.21.15.119:6800/3049794634,v1:172.21.15.119:6801/3049794634] conn(0x7f3cf8072920 msgr2=0x7f3cf8074dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.504 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.502+0000 7f3d12ef2640 1 --2- 172.21.15.104:0/1544294592 >> [v2:172.21.15.119:6800/3049794634,v1:172.21.15.119:6801/3049794634] conn(0x7f3cf8072920 0x7f3cf8074dc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.505 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.502+0000 7f3d12ef2640 1 -- 172.21.15.104:0/1544294592 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f3cf806a520 msgr2=0x7f3cf806c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.505 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.502+0000 7f3d12ef2640 1 --2- 172.21.15.104:0/1544294592 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f3cf806a520 0x7f3cf806c9e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3d00034000 tx=0x7f3d00001190 comp rx=0 tx=0).stop 2023-09-13T02:13:34.505 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.502+0000 7f3d12ef2640 1 -- 172.21.15.104:0/1544294592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf40047c0 msgr2=0x7f3d0c13a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.506 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.502+0000 7f3d12ef2640 1 --2- 172.21.15.104:0/1544294592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf40047c0 0x7f3d0c13a550 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc006660 tx=0x7f3cfc003a80 comp rx=0 tx=0).stop 2023-09-13T02:13:34.506 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.502+0000 7f3d1148f640 1 -- 172.21.15.104:0/1544294592 reap_dead start 2023-09-13T02:13:34.506 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.502+0000 7f3d12ef2640 1 -- 172.21.15.104:0/1544294592 shutdown_connections 2023-09-13T02:13:34.506 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.502+0000 7f3d12ef2640 1 -- 172.21.15.104:0/1544294592 >> 172.21.15.104:0/1544294592 conn(0x7f3d0c069b30 msgr2=0x7f3d0c1369c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:34.507 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.502+0000 7f3d12ef2640 1 -- 172.21.15.104:0/1544294592 shutdown_connections 2023-09-13T02:13:34.508 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.503+0000 7f3d12ef2640 1 -- 172.21.15.104:0/1544294592 wait complete. 2023-09-13T02:13:34.513 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-09-13T02:13:34.616 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.616+0000 7fec77f65640 1 -- 172.21.15.104:0/3705395280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec7013ab10 msgr2=0x7fec700aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.617 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.616+0000 7fec77f65640 1 --2- 172.21.15.104:0/3705395280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec7013ab10 0x7fec700aed90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fec60005fd0 tx=0x7fec6002d020 comp rx=0 tx=0).stop 2023-09-13T02:13:34.617 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.616+0000 7fec77f65640 1 -- 172.21.15.104:0/3705395280 shutdown_connections 2023-09-13T02:13:34.617 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.616+0000 7fec77f65640 1 --2- 172.21.15.104:0/3705395280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec7013ab10 0x7fec700aed90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.618 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.616+0000 7fec77f65640 1 --2- 172.21.15.104:0/3705395280 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec700ae980 0x7fec700b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.618 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.616+0000 7fec77f65640 1 -- 172.21.15.104:0/3705395280 >> 172.21.15.104:0/3705395280 conn(0x7fec700b56f0 msgr2=0x7fec700b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:34.618 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.616+0000 7fec77f65640 1 -- 172.21.15.104:0/3705395280 shutdown_connections 2023-09-13T02:13:34.619 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.616+0000 7fec77f65640 1 -- 172.21.15.104:0/3705395280 wait complete. 2023-09-13T02:13:34.622 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.617+0000 7fec77f65640 1 Processor -- start 2023-09-13T02:13:34.622 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.617+0000 7fec77f65640 1 -- start start 2023-09-13T02:13:34.622 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec77f65640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec7013a730 0x7fec70070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.623 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec77f65640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec7013ab10 0x7fec701dba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.623 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec77f65640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec701dbf40 0x7fec70134cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.624 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec77f65640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec701dc3c0 con 0x7fec701dbf40 2023-09-13T02:13:34.624 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec77f65640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7013da80 con 0x7fec7013a730 2023-09-13T02:13:34.624 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec77f65640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7013cb30 con 0x7fec7013ab10 2023-09-13T02:13:34.624 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec76502640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec701dbf40 0x7fec70134cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.625 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec76502640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec701dbf40 0x7fec70134cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49392/0 (socket says 172.21.15.104:49392) 2023-09-13T02:13:34.625 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec76502640 1 -- 172.21.15.104:0/2346548549 learned_addr learned my addr 172.21.15.104:0/2346548549 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:34.625 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec75500640 1 --2- 172.21.15.104:0/2346548549 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec7013ab10 0x7fec701dba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.626 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec75d01640 1 --2- 172.21.15.104:0/2346548549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec7013a730 0x7fec70070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.626 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec76502640 1 -- 172.21.15.104:0/2346548549 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec7013ab10 msgr2=0x7fec701dba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.626 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec76502640 1 --2- 172.21.15.104:0/2346548549 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec7013ab10 0x7fec701dba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.627 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec76502640 1 -- 172.21.15.104:0/2346548549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec7013a730 msgr2=0x7fec70070200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.627 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec76502640 1 --2- 172.21.15.104:0/2346548549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec7013a730 0x7fec70070200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.627 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec76502640 1 -- 172.21.15.104:0/2346548549 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6000a670 con 0x7fec701dbf40 2023-09-13T02:13:34.627 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec76502640 1 --2- 172.21.15.104:0/2346548549 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec701dbf40 0x7fec70134cb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fec6000a960 tx=0x7fec60004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:34.628 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec6e7fc640 1 -- 172.21.15.104:0/2346548549 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec600049a0 con 0x7fec701dbf40 2023-09-13T02:13:34.628 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec6e7fc640 1 -- 172.21.15.104:0/2346548549 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fec60004bf0 con 0x7fec701dbf40 2023-09-13T02:13:34.628 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec77f65640 1 -- 172.21.15.104:0/2346548549 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7013ce10 con 0x7fec701dbf40 2023-09-13T02:13:34.629 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec6e7fc640 1 -- 172.21.15.104:0/2346548549 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec600035f0 con 0x7fec701dbf40 2023-09-13T02:13:34.629 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.618+0000 7fec77f65640 1 -- 172.21.15.104:0/2346548549 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7013dcd0 con 0x7fec701dbf40 2023-09-13T02:13:34.629 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.619+0000 7fec77f65640 1 -- 172.21.15.104:0/2346548549 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7004e100 con 0x7fec701dbf40 2023-09-13T02:13:34.629 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.620+0000 7fec6e7fc640 1 -- 172.21.15.104:0/2346548549 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fec60003750 con 0x7fec701dbf40 2023-09-13T02:13:34.630 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.620+0000 7fec6e7fc640 1 --2- 172.21.15.104:0/2346548549 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fec5c06a4f0 0x7fec5c06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.630 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.620+0000 7fec75d01640 1 --2- 172.21.15.104:0/2346548549 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fec5c06a4f0 0x7fec5c06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.630 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.620+0000 7fec6e7fc640 1 -- 172.21.15.104:0/2346548549 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fec600ab760 con 0x7fec701dbf40 2023-09-13T02:13:34.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.620+0000 7fec75d01640 1 --2- 172.21.15.104:0/2346548549 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fec5c06a4f0 0x7fec5c06c9b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fec700b5d60 tx=0x7fec68003d90 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:34.631 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.624+0000 7fec6e7fc640 1 -- 172.21.15.104:0/2346548549 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fec60076d70 con 0x7fec701dbf40 2023-09-13T02:13:34.789 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.789+0000 7fec77f65640 1 -- 172.21.15.104:0/2346548549 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fec7013cca0 con 0x7fec5c06a4f0 2023-09-13T02:13:34.790 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.790+0000 7fec6e7fc640 1 -- 172.21.15.104:0/2346548549 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fec7013cca0 con 0x7fec5c06a4f0 2023-09-13T02:13:34.790 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 4 to deep-scrub 2023-09-13T02:13:34.792 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.791+0000 7fec77f65640 1 -- 172.21.15.104:0/2346548549 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fec5c06a4f0 msgr2=0x7fec5c06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.792 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.791+0000 7fec77f65640 1 --2- 172.21.15.104:0/2346548549 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fec5c06a4f0 0x7fec5c06c9b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fec700b5d60 tx=0x7fec68003d90 comp rx=0 tx=0).stop 2023-09-13T02:13:34.792 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.791+0000 7fec77f65640 1 -- 172.21.15.104:0/2346548549 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec701dbf40 msgr2=0x7fec70134cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.792 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.791+0000 7fec77f65640 1 --2- 172.21.15.104:0/2346548549 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec701dbf40 0x7fec70134cb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fec6000a960 tx=0x7fec60004270 comp rx=0 tx=0).stop 2023-09-13T02:13:34.793 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.791+0000 7fec77f65640 1 -- 172.21.15.104:0/2346548549 shutdown_connections 2023-09-13T02:13:34.793 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.791+0000 7fec77f65640 1 --2- 172.21.15.104:0/2346548549 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fec5c06a4f0 0x7fec5c06c9b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.793 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.791+0000 7fec77f65640 1 --2- 172.21.15.104:0/2346548549 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec701dbf40 0x7fec70134cb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.793 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.791+0000 7fec77f65640 1 --2- 172.21.15.104:0/2346548549 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec7013ab10 0x7fec701dba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.794 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.791+0000 7fec77f65640 1 --2- 172.21.15.104:0/2346548549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec7013a730 0x7fec70070200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.794 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.791+0000 7fec77f65640 1 -- 172.21.15.104:0/2346548549 >> 172.21.15.104:0/2346548549 conn(0x7fec700b56f0 msgr2=0x7fec70138ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:34.794 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.792+0000 7fec77f65640 1 -- 172.21.15.104:0/2346548549 shutdown_connections 2023-09-13T02:13:34.795 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.792+0000 7fec77f65640 1 -- 172.21.15.104:0/2346548549 wait complete. 2023-09-13T02:13:34.802 INFO:tasks.ceph:Scrubbing osd.5 2023-09-13T02:13:34.803 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-09-13T02:13:34.908 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.908+0000 7f2229256640 1 -- 172.21.15.104:0/1562339947 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22240b5ba0 msgr2=0x7f22241482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.908 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.908+0000 7f2229256640 1 --2- 172.21.15.104:0/1562339947 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22240b5ba0 0x7f22241482f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f221c005fd0 tx=0x7f221c02bd90 comp rx=0 tx=0).stop 2023-09-13T02:13:34.909 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.908+0000 7f2229256640 1 -- 172.21.15.104:0/1562339947 shutdown_connections 2023-09-13T02:13:34.909 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.908+0000 7f2229256640 1 --2- 172.21.15.104:0/1562339947 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22240b5ba0 0x7f22241482f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.909 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.908+0000 7f2229256640 1 -- 172.21.15.104:0/1562339947 >> 172.21.15.104:0/1562339947 conn(0x7f22240708b0 msgr2=0x7f2224070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:34.910 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.908+0000 7f2229256640 1 -- 172.21.15.104:0/1562339947 shutdown_connections 2023-09-13T02:13:34.910 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.908+0000 7f2229256640 1 -- 172.21.15.104:0/1562339947 wait complete. 2023-09-13T02:13:34.913 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.909+0000 7f2229256640 1 Processor -- start 2023-09-13T02:13:34.913 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.909+0000 7f2229256640 1 -- start start 2023-09-13T02:13:34.914 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f2229256640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22240b5ba0 0x7f222412fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.914 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f2229256640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2224147b90 0x7f22241dd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.914 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f2229256640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2224142530 0x7f22241dde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.915 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f2229256640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2224146b50 con 0x7f2224142530 2023-09-13T02:13:34.915 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f2229256640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2224146820 con 0x7f2224147b90 2023-09-13T02:13:34.915 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f2229256640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2224142ae0 con 0x7f22240b5ba0 2023-09-13T02:13:34.915 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f222359e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2224142530 0x7f22241dde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.916 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f222359e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2224142530 0x7f22241dde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49406/0 (socket says 172.21.15.104:49406) 2023-09-13T02:13:34.916 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f222359e640 1 -- 172.21.15.104:0/1291550929 learned_addr learned my addr 172.21.15.104:0/1291550929 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:34.916 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f2222d9d640 1 --2- 172.21.15.104:0/1291550929 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22240b5ba0 0x7f222412fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.917 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f222359e640 1 -- 172.21.15.104:0/1291550929 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22240b5ba0 msgr2=0x7f222412fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.917 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f222259c640 1 --2- 172.21.15.104:0/1291550929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2224147b90 0x7f22241dd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.917 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f222359e640 1 --2- 172.21.15.104:0/1291550929 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22240b5ba0 0x7f222412fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.917 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f222359e640 1 -- 172.21.15.104:0/1291550929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2224147b90 msgr2=0x7f22241dd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.918 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f222359e640 1 --2- 172.21.15.104:0/1291550929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2224147b90 0x7f22241dd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.918 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f222359e640 1 -- 172.21.15.104:0/1291550929 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c009560 con 0x7f2224142530 2023-09-13T02:13:34.918 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f222359e640 1 --2- 172.21.15.104:0/1291550929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2224142530 0x7f22241dde20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f221c009850 tx=0x7f221c02dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:34.918 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f220b7fe640 1 -- 172.21.15.104:0/1291550929 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c005650 con 0x7f2224142530 2023-09-13T02:13:34.919 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f220b7fe640 1 -- 172.21.15.104:0/1291550929 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f221c003800 con 0x7f2224142530 2023-09-13T02:13:34.919 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f2229256640 1 -- 172.21.15.104:0/1291550929 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22241457b0 con 0x7f2224142530 2023-09-13T02:13:34.919 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f220b7fe640 1 -- 172.21.15.104:0/1291550929 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c003bf0 con 0x7f2224142530 2023-09-13T02:13:34.920 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.910+0000 7f2229256640 1 -- 172.21.15.104:0/1291550929 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2224137ce0 con 0x7f2224142530 2023-09-13T02:13:34.920 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.911+0000 7f2229256640 1 -- 172.21.15.104:0/1291550929 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22241465f0 con 0x7f2224142530 2023-09-13T02:13:34.920 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.912+0000 7f220b7fe640 1 -- 172.21.15.104:0/1291550929 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f221c003d50 con 0x7f2224142530 2023-09-13T02:13:34.920 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.912+0000 7f220b7fe640 1 --2- 172.21.15.104:0/1291550929 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f221006a520 0x7f221006c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.921 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.912+0000 7f220b7fe640 1 -- 172.21.15.104:0/1291550929 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f221c0ab6b0 con 0x7f2224142530 2023-09-13T02:13:34.921 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.912+0000 7f2222d9d640 1 --2- 172.21.15.104:0/1291550929 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f221006a520 0x7f221006c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.921 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.912+0000 7f220b7fe640 1 --2- 172.21.15.104:0/1291550929 >> [v2:172.21.15.119:6808/2918159428,v1:172.21.15.119:6809/2918159428] conn(0x7f2210072920 0x7f2210074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:34.922 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.912+0000 7f220b7fe640 1 -- 172.21.15.104:0/1291550929 --> [v2:172.21.15.119:6808/2918159428,v1:172.21.15.119:6809/2918159428] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2210075490 con 0x7f2210072920 2023-09-13T02:13:34.922 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.912+0000 7f220b7fe640 1 -- 172.21.15.104:0/1291550929 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f221c0add70 con 0x7f2224142530 2023-09-13T02:13:34.922 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.912+0000 7f222259c640 1 --2- 172.21.15.104:0/1291550929 >> [v2:172.21.15.119:6808/2918159428,v1:172.21.15.119:6809/2918159428] conn(0x7f2210072920 0x7f2210074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:34.922 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.912+0000 7f2222d9d640 1 --2- 172.21.15.104:0/1291550929 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f221006a520 0x7f221006c9e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2214007bf0 tx=0x7f2214007240 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:34.923 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.913+0000 7f222259c640 1 --2- 172.21.15.104:0/1291550929 >> [v2:172.21.15.119:6808/2918159428,v1:172.21.15.119:6809/2918159428] conn(0x7f2210072920 0x7f2210074dc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:34.923 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.913+0000 7f220b7fe640 1 -- 172.21.15.104:0/1291550929 <== osd.5 v2:172.21.15.119:6808/2918159428 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f2210075490 con 0x7f2210072920 2023-09-13T02:13:34.925 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.926+0000 7f2229256640 1 -- 172.21.15.104:0/1291550929 --> [v2:172.21.15.119:6808/2918159428,v1:172.21.15.119:6809/2918159428] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f22240b0ec0 con 0x7f2210072920 2023-09-13T02:13:34.926 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.926+0000 7f220b7fe640 1 -- 172.21.15.104:0/1291550929 <== osd.5 v2:172.21.15.119:6808/2918159428 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2218001770 con 0x7f2210072920 2023-09-13T02:13:34.926 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2023-09-13T02:13:34.927 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-13T02:13:34.927 INFO:teuthology.orchestra.run.smithi104.stdout:} 2023-09-13T02:13:34.928 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.926+0000 7f2229256640 1 -- 172.21.15.104:0/1291550929 >> [v2:172.21.15.119:6808/2918159428,v1:172.21.15.119:6809/2918159428] conn(0x7f2210072920 msgr2=0x7f2210074dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.928 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.926+0000 7f2229256640 1 --2- 172.21.15.104:0/1291550929 >> [v2:172.21.15.119:6808/2918159428,v1:172.21.15.119:6809/2918159428] conn(0x7f2210072920 0x7f2210074dc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.929 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.926+0000 7f2229256640 1 -- 172.21.15.104:0/1291550929 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f221006a520 msgr2=0x7f221006c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.929 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.926+0000 7f2229256640 1 --2- 172.21.15.104:0/1291550929 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f221006a520 0x7f221006c9e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2214007bf0 tx=0x7f2214007240 comp rx=0 tx=0).stop 2023-09-13T02:13:34.929 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.926+0000 7f2229256640 1 -- 172.21.15.104:0/1291550929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2224142530 msgr2=0x7f22241dde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:34.929 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.926+0000 7f2229256640 1 --2- 172.21.15.104:0/1291550929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2224142530 0x7f22241dde20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f221c009850 tx=0x7f221c02dce0 comp rx=0 tx=0).stop 2023-09-13T02:13:34.930 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.926+0000 7f222359e640 1 -- 172.21.15.104:0/1291550929 reap_dead start 2023-09-13T02:13:34.930 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.926+0000 7f2229256640 1 -- 172.21.15.104:0/1291550929 shutdown_connections 2023-09-13T02:13:34.930 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.926+0000 7f2229256640 1 -- 172.21.15.104:0/1291550929 >> 172.21.15.104:0/1291550929 conn(0x7f22240708b0 msgr2=0x7f2224138eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:34.931 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.927+0000 7f2229256640 1 -- 172.21.15.104:0/1291550929 shutdown_connections 2023-09-13T02:13:34.931 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:34.927+0000 7f2229256640 1 -- 172.21.15.104:0/1291550929 wait complete. 2023-09-13T02:13:34.937 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-09-13T02:13:35.039 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.039+0000 7f21924cf640 1 -- 172.21.15.104:0/2037315578 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f218c0b5ba0 msgr2=0x7f218c1482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.040 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.039+0000 7f21924cf640 1 --2- 172.21.15.104:0/2037315578 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f218c0b5ba0 0x7f218c1482f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2184005fd0 tx=0x7f218402c0e0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.040 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.039+0000 7f21924cf640 1 -- 172.21.15.104:0/2037315578 shutdown_connections 2023-09-13T02:13:35.040 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.039+0000 7f21924cf640 1 --2- 172.21.15.104:0/2037315578 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f218c0b5ba0 0x7f218c1482f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.041 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.039+0000 7f21924cf640 1 -- 172.21.15.104:0/2037315578 >> 172.21.15.104:0/2037315578 conn(0x7f218c0708b0 msgr2=0x7f218c070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:35.041 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.039+0000 7f21924cf640 1 -- 172.21.15.104:0/2037315578 shutdown_connections 2023-09-13T02:13:35.041 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.039+0000 7f21924cf640 1 -- 172.21.15.104:0/2037315578 wait complete. 2023-09-13T02:13:35.044 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.040+0000 7f21924cf640 1 Processor -- start 2023-09-13T02:13:35.044 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.040+0000 7f21924cf640 1 -- start start 2023-09-13T02:13:35.045 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f21924cf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f218c0b5ba0 0x7f218c144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.045 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f21924cf640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f218c147b90 0x7f218c140f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.045 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f21924cf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f218c140330 0x7f218c1414c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.046 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f21924cf640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c13fad0 con 0x7f218c140330 2023-09-13T02:13:35.046 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f21924cf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c140810 con 0x7f218c0b5ba0 2023-09-13T02:13:35.046 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f21924cf640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218c13e400 con 0x7f218c147b90 2023-09-13T02:13:35.046 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f2190a6c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f218c140330 0x7f218c1414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.047 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f2190a6c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f218c140330 0x7f218c1414c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49426/0 (socket says 172.21.15.104:49426) 2023-09-13T02:13:35.047 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f2190a6c640 1 -- 172.21.15.104:0/464800726 learned_addr learned my addr 172.21.15.104:0/464800726 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:35.047 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f218b7fe640 1 --2- 172.21.15.104:0/464800726 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f218c147b90 0x7f218c140f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.048 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f218bfff640 1 --2- 172.21.15.104:0/464800726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f218c0b5ba0 0x7f218c144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.048 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f2190a6c640 1 -- 172.21.15.104:0/464800726 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f218c147b90 msgr2=0x7f218c140f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.048 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f2190a6c640 1 --2- 172.21.15.104:0/464800726 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f218c147b90 0x7f218c140f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.048 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f2190a6c640 1 -- 172.21.15.104:0/464800726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f218c0b5ba0 msgr2=0x7f218c144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.049 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f2190a6c640 1 --2- 172.21.15.104:0/464800726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f218c0b5ba0 0x7f218c144ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.049 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f2190a6c640 1 -- 172.21.15.104:0/464800726 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2184009840 con 0x7f218c140330 2023-09-13T02:13:35.049 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f218bfff640 1 --2- 172.21.15.104:0/464800726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f218c0b5ba0 0x7f218c144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:13:35.049 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f2190a6c640 1 --2- 172.21.15.104:0/464800726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f218c140330 0x7f218c1414c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2184036040 tx=0x7f2184004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:35.050 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f2188ff9640 1 -- 172.21.15.104:0/464800726 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184004670 con 0x7f218c140330 2023-09-13T02:13:35.050 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f2188ff9640 1 -- 172.21.15.104:0/464800726 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f21840345a0 con 0x7f218c140330 2023-09-13T02:13:35.050 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f2188ff9640 1 -- 172.21.15.104:0/464800726 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21840349b0 con 0x7f218c140330 2023-09-13T02:13:35.051 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f21924cf640 1 -- 172.21.15.104:0/464800726 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218c140af0 con 0x7f218c140330 2023-09-13T02:13:35.051 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.041+0000 7f21924cf640 1 -- 172.21.15.104:0/464800726 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218c13f5b0 con 0x7f218c140330 2023-09-13T02:13:35.051 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.042+0000 7f21924cf640 1 -- 172.21.15.104:0/464800726 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218c13e260 con 0x7f218c140330 2023-09-13T02:13:35.051 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.043+0000 7f2188ff9640 1 -- 172.21.15.104:0/464800726 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f2184034b10 con 0x7f218c140330 2023-09-13T02:13:35.052 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.043+0000 7f2188ff9640 1 --2- 172.21.15.104:0/464800726 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f217806a4f0 0x7f217806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.052 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.043+0000 7f218bfff640 1 --2- 172.21.15.104:0/464800726 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f217806a4f0 0x7f217806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.052 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.043+0000 7f2188ff9640 1 -- 172.21.15.104:0/464800726 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f21840abbe0 con 0x7f218c140330 2023-09-13T02:13:35.053 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.044+0000 7f218bfff640 1 --2- 172.21.15.104:0/464800726 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f217806a4f0 0x7f217806c9b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f217c0011e0 tx=0x7f217c009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:35.053 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.048+0000 7f2188ff9640 1 -- 172.21.15.104:0/464800726 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f218c13e260 con 0x7f218c140330 2023-09-13T02:13:35.213 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.213+0000 7f21924cf640 1 -- 172.21.15.104:0/464800726 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f218c13e260 con 0x7f217806a4f0 2023-09-13T02:13:35.213 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.213+0000 7f2188ff9640 1 -- 172.21.15.104:0/464800726 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f218c13e260 con 0x7f217806a4f0 2023-09-13T02:13:35.214 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 5 to deep-scrub 2023-09-13T02:13:35.215 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.215+0000 7f21924cf640 1 -- 172.21.15.104:0/464800726 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f217806a4f0 msgr2=0x7f217806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.215 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.215+0000 7f21924cf640 1 --2- 172.21.15.104:0/464800726 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f217806a4f0 0x7f217806c9b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f217c0011e0 tx=0x7f217c009040 comp rx=0 tx=0).stop 2023-09-13T02:13:35.216 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.215+0000 7f21924cf640 1 -- 172.21.15.104:0/464800726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f218c140330 msgr2=0x7f218c1414c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.216 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.215+0000 7f21924cf640 1 --2- 172.21.15.104:0/464800726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f218c140330 0x7f218c1414c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2184036040 tx=0x7f2184004270 comp rx=0 tx=0).stop 2023-09-13T02:13:35.216 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.215+0000 7f21924cf640 1 -- 172.21.15.104:0/464800726 shutdown_connections 2023-09-13T02:13:35.216 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.215+0000 7f21924cf640 1 --2- 172.21.15.104:0/464800726 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f217806a4f0 0x7f217806c9b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.217 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.215+0000 7f21924cf640 1 --2- 172.21.15.104:0/464800726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f218c140330 0x7f218c1414c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.217 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.215+0000 7f21924cf640 1 --2- 172.21.15.104:0/464800726 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f218c147b90 0x7f218c140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.217 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.215+0000 7f21924cf640 1 --2- 172.21.15.104:0/464800726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f218c0b5ba0 0x7f218c144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.218 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.215+0000 7f21924cf640 1 -- 172.21.15.104:0/464800726 >> 172.21.15.104:0/464800726 conn(0x7f218c0708b0 msgr2=0x7f218c1393b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:35.218 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.215+0000 7f21924cf640 1 -- 172.21.15.104:0/464800726 shutdown_connections 2023-09-13T02:13:35.218 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.215+0000 7f21924cf640 1 -- 172.21.15.104:0/464800726 wait complete. 2023-09-13T02:13:35.225 INFO:tasks.ceph:Scrubbing osd.6 2023-09-13T02:13:35.226 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-09-13T02:13:35.331 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.331+0000 7f876897d640 1 -- 172.21.15.104:0/4184398216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87640b0ae0 msgr2=0x7f8764140640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.332 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.331+0000 7f876897d640 1 --2- 172.21.15.104:0/4184398216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87640b0ae0 0x7f8764140640 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8754009830 tx=0x7f875402bc50 comp rx=0 tx=0).stop 2023-09-13T02:13:35.332 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.331+0000 7f876897d640 1 -- 172.21.15.104:0/4184398216 shutdown_connections 2023-09-13T02:13:35.332 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.331+0000 7f876897d640 1 --2- 172.21.15.104:0/4184398216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87640b0ae0 0x7f8764140640 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.332 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.331+0000 7f876897d640 1 -- 172.21.15.104:0/4184398216 >> 172.21.15.104:0/4184398216 conn(0x7f87640b56f0 msgr2=0x7f87640b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:35.333 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.331+0000 7f876897d640 1 -- 172.21.15.104:0/4184398216 shutdown_connections 2023-09-13T02:13:35.333 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.331+0000 7f876897d640 1 -- 172.21.15.104:0/4184398216 wait complete. 2023-09-13T02:13:35.336 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.332+0000 7f876897d640 1 Processor -- start 2023-09-13T02:13:35.336 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.332+0000 7f876897d640 1 -- start start 2023-09-13T02:13:35.337 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f876897d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87640b0ae0 0x7f87640701b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.337 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f876897d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f876413a500 0x7f87641daf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.337 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f876897d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87641444d0 0x7f876413d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.338 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f876897d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876413e1c0 con 0x7f87641444d0 2023-09-13T02:13:35.338 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f876897d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876413cd60 con 0x7f87640b0ae0 2023-09-13T02:13:35.338 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f876897d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87641c96f0 con 0x7f876413a500 2023-09-13T02:13:35.338 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f8762d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87641444d0 0x7f876413d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.339 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f8762d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87641444d0 0x7f876413d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49438/0 (socket says 172.21.15.104:49438) 2023-09-13T02:13:35.339 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f8762d9d640 1 -- 172.21.15.104:0/1844521830 learned_addr learned my addr 172.21.15.104:0/1844521830 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:35.339 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f8761d9b640 1 --2- 172.21.15.104:0/1844521830 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f876413a500 0x7f87641daf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.340 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f876259c640 1 --2- 172.21.15.104:0/1844521830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87640b0ae0 0x7f87640701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.340 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f8762d9d640 1 -- 172.21.15.104:0/1844521830 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f876413a500 msgr2=0x7f87641daf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.340 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f8762d9d640 1 --2- 172.21.15.104:0/1844521830 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f876413a500 0x7f87641daf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.340 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f8762d9d640 1 -- 172.21.15.104:0/1844521830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87640b0ae0 msgr2=0x7f87640701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.341 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f8762d9d640 1 --2- 172.21.15.104:0/1844521830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87640b0ae0 0x7f87640701b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.341 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f8762d9d640 1 -- 172.21.15.104:0/1844521830 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8754009490 con 0x7f87641444d0 2023-09-13T02:13:35.341 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f8762d9d640 1 --2- 172.21.15.104:0/1844521830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87641444d0 0x7f876413d6a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f875c00caa0 tx=0x7f875c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:35.342 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f8752ffd640 1 -- 172.21.15.104:0/1844521830 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c00ac00 con 0x7f87641444d0 2023-09-13T02:13:35.342 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f8752ffd640 1 -- 172.21.15.104:0/1844521830 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f875c00ae70 con 0x7f87641444d0 2023-09-13T02:13:35.342 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f876897d640 1 -- 172.21.15.104:0/1844521830 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87640ac5d0 con 0x7f87641444d0 2023-09-13T02:13:35.342 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f8752ffd640 1 -- 172.21.15.104:0/1844521830 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c003bb0 con 0x7f87641444d0 2023-09-13T02:13:35.343 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.333+0000 7f876897d640 1 -- 172.21.15.104:0/1844521830 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876413d1b0 con 0x7f87641444d0 2023-09-13T02:13:35.343 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.334+0000 7f876897d640 1 -- 172.21.15.104:0/1844521830 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f876413c7d0 con 0x7f87641444d0 2023-09-13T02:13:35.343 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.335+0000 7f8752ffd640 1 -- 172.21.15.104:0/1844521830 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f875c003d10 con 0x7f87641444d0 2023-09-13T02:13:35.343 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.335+0000 7f8752ffd640 1 --2- 172.21.15.104:0/1844521830 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f874406a4f0 0x7f874406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.344 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.335+0000 7f876259c640 1 --2- 172.21.15.104:0/1844521830 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f874406a4f0 0x7f874406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.344 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.335+0000 7f8752ffd640 1 -- 172.21.15.104:0/1844521830 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f875c0894c0 con 0x7f87641444d0 2023-09-13T02:13:35.344 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.335+0000 7f8752ffd640 1 --2- 172.21.15.104:0/1844521830 >> [v2:172.21.15.119:6824/3509665357,v1:172.21.15.119:6825/3509665357] conn(0x7f87440728f0 0x7f8744074d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.345 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.335+0000 7f8752ffd640 1 -- 172.21.15.104:0/1844521830 --> [v2:172.21.15.119:6824/3509665357,v1:172.21.15.119:6825/3509665357] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8744075460 con 0x7f87440728f0 2023-09-13T02:13:35.345 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.335+0000 7f8752ffd640 1 -- 172.21.15.104:0/1844521830 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f875c08bb80 con 0x7f87641444d0 2023-09-13T02:13:35.345 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.335+0000 7f8761d9b640 1 --2- 172.21.15.104:0/1844521830 >> [v2:172.21.15.119:6824/3509665357,v1:172.21.15.119:6825/3509665357] conn(0x7f87440728f0 0x7f8744074d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.345 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.335+0000 7f876259c640 1 --2- 172.21.15.104:0/1844521830 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f874406a4f0 0x7f874406c9b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8754036000 tx=0x7f8754004730 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:35.346 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.336+0000 7f8761d9b640 1 --2- 172.21.15.104:0/1844521830 >> [v2:172.21.15.119:6824/3509665357,v1:172.21.15.119:6825/3509665357] conn(0x7f87440728f0 0x7f8744074d90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:35.346 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.336+0000 7f8752ffd640 1 -- 172.21.15.104:0/1844521830 <== osd.6 v2:172.21.15.119:6824/3509665357 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f8744075460 con 0x7f87440728f0 2023-09-13T02:13:35.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.349+0000 7f876897d640 1 -- 172.21.15.104:0/1844521830 --> [v2:172.21.15.119:6824/3509665357,v1:172.21.15.119:6825/3509665357] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f876404e100 con 0x7f87440728f0 2023-09-13T02:13:35.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.349+0000 7f8752ffd640 1 -- 172.21.15.104:0/1844521830 <== osd.6 v2:172.21.15.119:6824/3509665357 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f876404e100 con 0x7f87440728f0 2023-09-13T02:13:35.350 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2023-09-13T02:13:35.350 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-13T02:13:35.350 INFO:teuthology.orchestra.run.smithi104.stdout:} 2023-09-13T02:13:35.351 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.350+0000 7f876897d640 1 -- 172.21.15.104:0/1844521830 >> [v2:172.21.15.119:6824/3509665357,v1:172.21.15.119:6825/3509665357] conn(0x7f87440728f0 msgr2=0x7f8744074d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.350+0000 7f876897d640 1 --2- 172.21.15.104:0/1844521830 >> [v2:172.21.15.119:6824/3509665357,v1:172.21.15.119:6825/3509665357] conn(0x7f87440728f0 0x7f8744074d90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.350+0000 7f876897d640 1 -- 172.21.15.104:0/1844521830 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f874406a4f0 msgr2=0x7f874406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.350+0000 7f876897d640 1 --2- 172.21.15.104:0/1844521830 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f874406a4f0 0x7f874406c9b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8754036000 tx=0x7f8754004730 comp rx=0 tx=0).stop 2023-09-13T02:13:35.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.350+0000 7f876897d640 1 -- 172.21.15.104:0/1844521830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87641444d0 msgr2=0x7f876413d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.350+0000 7f876897d640 1 --2- 172.21.15.104:0/1844521830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87641444d0 0x7f876413d6a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f875c00caa0 tx=0x7f875c00cf60 comp rx=0 tx=0).stop 2023-09-13T02:13:35.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.350+0000 7f8762d9d640 1 -- 172.21.15.104:0/1844521830 reap_dead start 2023-09-13T02:13:35.353 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.350+0000 7f876897d640 1 -- 172.21.15.104:0/1844521830 shutdown_connections 2023-09-13T02:13:35.354 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.350+0000 7f876897d640 1 -- 172.21.15.104:0/1844521830 >> 172.21.15.104:0/1844521830 conn(0x7f87640b56f0 msgr2=0x7f87640b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:35.354 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.350+0000 7f876897d640 1 -- 172.21.15.104:0/1844521830 shutdown_connections 2023-09-13T02:13:35.354 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.350+0000 7f876897d640 1 -- 172.21.15.104:0/1844521830 wait complete. 2023-09-13T02:13:35.360 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-09-13T02:13:35.462 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.462+0000 7feb50ff0640 1 -- 172.21.15.104:0/3160866460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb4c147b90 msgr2=0x7feb4c1482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.463 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.462+0000 7feb50ff0640 1 --2- 172.21.15.104:0/3160866460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb4c147b90 0x7feb4c1482f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0b5690 tx=0x7feb3c02c050 comp rx=0 tx=0).stop 2023-09-13T02:13:35.463 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.462+0000 7feb50ff0640 1 -- 172.21.15.104:0/3160866460 shutdown_connections 2023-09-13T02:13:35.463 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.462+0000 7feb50ff0640 1 --2- 172.21.15.104:0/3160866460 >> v2:172.21.15.119:3300/0 conn(0x7feb4c0b1820 0x7feb4c0afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.464 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.462+0000 7feb50ff0640 1 --2- 172.21.15.104:0/3160866460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb4c147b90 0x7feb4c1482f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.464 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.462+0000 7feb50ff0640 1 -- 172.21.15.104:0/3160866460 >> 172.21.15.104:0/3160866460 conn(0x7feb4c0708b0 msgr2=0x7feb4c070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:35.464 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.462+0000 7feb50ff0640 1 -- 172.21.15.104:0/3160866460 shutdown_connections 2023-09-13T02:13:35.464 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.462+0000 7feb50ff0640 1 -- 172.21.15.104:0/3160866460 wait complete. 2023-09-13T02:13:35.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.463+0000 7feb50ff0640 1 Processor -- start 2023-09-13T02:13:35.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.463+0000 7feb50ff0640 1 -- start start 2023-09-13T02:13:35.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb50ff0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb4c0b5ba0 0x7feb4c143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb50ff0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb4c147b90 0x7feb4c0b98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb50ff0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb4c13bb70 0x7feb4c13c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb50ff0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c144240 con 0x7feb4c0b5ba0 2023-09-13T02:13:35.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb50ff0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c0b9e20 con 0x7feb4c147b90 2023-09-13T02:13:35.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb50ff0640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c1410c0 con 0x7feb4c13bb70 2023-09-13T02:13:35.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb4a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb4c0b5ba0 0x7feb4c143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb4a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb4c0b5ba0 0x7feb4c143d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49448/0 (socket says 172.21.15.104:49448) 2023-09-13T02:13:35.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb4a59c640 1 -- 172.21.15.104:0/3558290525 learned_addr learned my addr 172.21.15.104:0/3558290525 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:35.470 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb4ad9d640 1 --2- 172.21.15.104:0/3558290525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb4c13bb70 0x7feb4c13c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.470 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb49d9b640 1 --2- 172.21.15.104:0/3558290525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb4c147b90 0x7feb4c0b98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.470 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb4a59c640 1 -- 172.21.15.104:0/3558290525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb4c13bb70 msgr2=0x7feb4c13c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.471 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb4a59c640 1 --2- 172.21.15.104:0/3558290525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb4c13bb70 0x7feb4c13c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.471 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb4a59c640 1 -- 172.21.15.104:0/3558290525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb4c147b90 msgr2=0x7feb4c0b98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.471 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb4a59c640 1 --2- 172.21.15.104:0/3558290525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb4c147b90 0x7feb4c0b98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb4a59c640 1 -- 172.21.15.104:0/3558290525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c009840 con 0x7feb4c0b5ba0 2023-09-13T02:13:35.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb4a59c640 1 --2- 172.21.15.104:0/3558290525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb4c0b5ba0 0x7feb4c143d00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feb3c036040 tx=0x7feb3c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:35.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb3affd640 1 -- 172.21.15.104:0/3558290525 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c03e460 con 0x7feb4c0b5ba0 2023-09-13T02:13:35.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb3affd640 1 -- 172.21.15.104:0/3558290525 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feb3c03e6b0 con 0x7feb4c0b5ba0 2023-09-13T02:13:35.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb50ff0640 1 -- 172.21.15.104:0/3558290525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4c1413a0 con 0x7feb4c0b5ba0 2023-09-13T02:13:35.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb3affd640 1 -- 172.21.15.104:0/3558290525 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c03eaa0 con 0x7feb4c0b5ba0 2023-09-13T02:13:35.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.464+0000 7feb50ff0640 1 -- 172.21.15.104:0/3558290525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb4c141d00 con 0x7feb4c0b5ba0 2023-09-13T02:13:35.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.465+0000 7feb50ff0640 1 -- 172.21.15.104:0/3558290525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4c1415b0 con 0x7feb4c0b5ba0 2023-09-13T02:13:35.474 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.466+0000 7feb3affd640 1 -- 172.21.15.104:0/3558290525 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7feb3c03ec00 con 0x7feb4c0b5ba0 2023-09-13T02:13:35.474 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.466+0000 7feb3affd640 1 --2- 172.21.15.104:0/3558290525 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7feb2c06a4f0 0x7feb2c06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.474 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.466+0000 7feb3affd640 1 -- 172.21.15.104:0/3558290525 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5881+0+0 (secure 0 0 0) 0x7feb3c0abbc0 con 0x7feb4c0b5ba0 2023-09-13T02:13:35.475 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.466+0000 7feb49d9b640 1 --2- 172.21.15.104:0/3558290525 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7feb2c06a4f0 0x7feb2c06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.475 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.466+0000 7feb49d9b640 1 --2- 172.21.15.104:0/3558290525 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7feb2c06a4f0 0x7feb2c06c9b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feb40005fd0 tx=0x7feb40005850 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:35.475 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.470+0000 7feb3affd640 1 -- 172.21.15.104:0/3558290525 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7feb3c077120 con 0x7feb4c0b5ba0 2023-09-13T02:13:35.638 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.638+0000 7feb50ff0640 1 -- 172.21.15.104:0/3558290525 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7feb4c04e100 con 0x7feb2c06a4f0 2023-09-13T02:13:35.638 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.638+0000 7feb3affd640 1 -- 172.21.15.104:0/3558290525 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7feb4c04e100 con 0x7feb2c06a4f0 2023-09-13T02:13:35.639 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 6 to deep-scrub 2023-09-13T02:13:35.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.640+0000 7feb50ff0640 1 -- 172.21.15.104:0/3558290525 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7feb2c06a4f0 msgr2=0x7feb2c06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.640+0000 7feb50ff0640 1 --2- 172.21.15.104:0/3558290525 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7feb2c06a4f0 0x7feb2c06c9b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feb40005fd0 tx=0x7feb40005850 comp rx=0 tx=0).stop 2023-09-13T02:13:35.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.640+0000 7feb50ff0640 1 -- 172.21.15.104:0/3558290525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb4c0b5ba0 msgr2=0x7feb4c143d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.640+0000 7feb50ff0640 1 --2- 172.21.15.104:0/3558290525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb4c0b5ba0 0x7feb4c143d00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feb3c036040 tx=0x7feb3c0042f0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.640+0000 7feb50ff0640 1 -- 172.21.15.104:0/3558290525 shutdown_connections 2023-09-13T02:13:35.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.640+0000 7feb50ff0640 1 --2- 172.21.15.104:0/3558290525 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7feb2c06a4f0 0x7feb2c06c9b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.640+0000 7feb50ff0640 1 --2- 172.21.15.104:0/3558290525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb4c13bb70 0x7feb4c13c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.640+0000 7feb50ff0640 1 --2- 172.21.15.104:0/3558290525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb4c147b90 0x7feb4c0b98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.642 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.640+0000 7feb50ff0640 1 --2- 172.21.15.104:0/3558290525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb4c0b5ba0 0x7feb4c143d00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.640+0000 7feb50ff0640 1 -- 172.21.15.104:0/3558290525 >> 172.21.15.104:0/3558290525 conn(0x7feb4c0708b0 msgr2=0x7feb4c13de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:35.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.640+0000 7feb50ff0640 1 -- 172.21.15.104:0/3558290525 shutdown_connections 2023-09-13T02:13:35.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.640+0000 7feb50ff0640 1 -- 172.21.15.104:0/3558290525 wait complete. 2023-09-13T02:13:35.651 INFO:tasks.ceph:Scrubbing osd.7 2023-09-13T02:13:35.651 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-09-13T02:13:35.757 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.756+0000 7fa43f81f640 1 -- 172.21.15.104:0/579690135 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa43813c4c0 msgr2=0x7fa438145cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.757 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.756+0000 7fa43f81f640 1 --2- 172.21.15.104:0/579690135 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa43813c4c0 0x7fa438145cf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa430005fd0 tx=0x7fa43002c1b0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.757 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.756+0000 7fa43f81f640 1 -- 172.21.15.104:0/579690135 shutdown_connections 2023-09-13T02:13:35.758 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.756+0000 7fa43f81f640 1 --2- 172.21.15.104:0/579690135 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa43813c4c0 0x7fa438145cf0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.758 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.756+0000 7fa43f81f640 1 --2- 172.21.15.104:0/579690135 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4380aefb0 0x7fa4381457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.758 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.756+0000 7fa43f81f640 1 -- 172.21.15.104:0/579690135 >> 172.21.15.104:0/579690135 conn(0x7fa4380b56f0 msgr2=0x7fa4380b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:35.759 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.756+0000 7fa43f81f640 1 -- 172.21.15.104:0/579690135 shutdown_connections 2023-09-13T02:13:35.759 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.756+0000 7fa43f81f640 1 -- 172.21.15.104:0/579690135 wait complete. 2023-09-13T02:13:35.762 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.757+0000 7fa43f81f640 1 Processor -- start 2023-09-13T02:13:35.762 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.757+0000 7fa43f81f640 1 -- start start 2023-09-13T02:13:35.762 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43f81f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa43806def0 0x7fa438070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.763 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43f81f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4380aefb0 0x7fa43813ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.763 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43f81f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa43813c4c0 0x7fa43813d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.763 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43f81f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4380a6cb0 con 0x7fa43813c4c0 2023-09-13T02:13:35.763 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43f81f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43813c980 con 0x7fa43806def0 2023-09-13T02:13:35.764 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43f81f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4380a7190 con 0x7fa4380aefb0 2023-09-13T02:13:35.764 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43ddbc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa43813c4c0 0x7fa43813d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.765 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43ddbc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa43813c4c0 0x7fa43813d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49464/0 (socket says 172.21.15.104:49464) 2023-09-13T02:13:35.765 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43ddbc640 1 -- 172.21.15.104:0/3594681666 learned_addr learned my addr 172.21.15.104:0/3594681666 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:35.765 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43cdba640 1 --2- 172.21.15.104:0/3594681666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4380aefb0 0x7fa43813ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.766 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43d5bb640 1 --2- 172.21.15.104:0/3594681666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa43806def0 0x7fa438070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.766 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43ddbc640 1 -- 172.21.15.104:0/3594681666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4380aefb0 msgr2=0x7fa43813ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.766 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43ddbc640 1 --2- 172.21.15.104:0/3594681666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4380aefb0 0x7fa43813ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.767 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43ddbc640 1 -- 172.21.15.104:0/3594681666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa43806def0 msgr2=0x7fa438070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.767 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43ddbc640 1 --2- 172.21.15.104:0/3594681666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa43806def0 0x7fa438070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.767 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43ddbc640 1 -- 172.21.15.104:0/3594681666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa430009900 con 0x7fa43813c4c0 2023-09-13T02:13:35.768 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43cdba640 1 --2- 172.21.15.104:0/3594681666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4380aefb0 0x7fa43813ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:13:35.768 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa43ddbc640 1 --2- 172.21.15.104:0/3594681666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa43813c4c0 0x7fa43813d350 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa430037040 tx=0x7fa430035db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:35.768 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.758+0000 7fa42dffb640 1 -- 172.21.15.104:0/3594681666 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430034440 con 0x7fa43813c4c0 2023-09-13T02:13:35.768 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.759+0000 7fa42dffb640 1 -- 172.21.15.104:0/3594681666 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa430004540 con 0x7fa43813c4c0 2023-09-13T02:13:35.769 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.759+0000 7fa43f81f640 1 -- 172.21.15.104:0/3594681666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43813bd80 con 0x7fa43813c4c0 2023-09-13T02:13:35.769 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.759+0000 7fa42dffb640 1 -- 172.21.15.104:0/3594681666 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43003f440 con 0x7fa43813c4c0 2023-09-13T02:13:35.769 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.759+0000 7fa43f81f640 1 -- 172.21.15.104:0/3594681666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43813f4b0 con 0x7fa43813c4c0 2023-09-13T02:13:35.769 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.760+0000 7fa43f81f640 1 -- 172.21.15.104:0/3594681666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa43813f000 con 0x7fa43813c4c0 2023-09-13T02:13:35.770 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.760+0000 7fa42dffb640 1 -- 172.21.15.104:0/3594681666 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fa43003b040 con 0x7fa43813c4c0 2023-09-13T02:13:35.770 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.760+0000 7fa42dffb640 1 --2- 172.21.15.104:0/3594681666 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fa41c06a4f0 0x7fa41c06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.770 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.761+0000 7fa42dffb640 1 -- 172.21.15.104:0/3594681666 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fa4300aba20 con 0x7fa43813c4c0 2023-09-13T02:13:35.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.761+0000 7fa43d5bb640 1 --2- 172.21.15.104:0/3594681666 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fa41c06a4f0 0x7fa41c06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.761+0000 7fa42dffb640 1 --2- 172.21.15.104:0/3594681666 >> [v2:172.21.15.119:6816/892749725,v1:172.21.15.119:6817/892749725] conn(0x7fa41c0728f0 0x7fa41c074d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.761+0000 7fa42dffb640 1 -- 172.21.15.104:0/3594681666 --> [v2:172.21.15.119:6816/892749725,v1:172.21.15.119:6817/892749725] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa41c075460 con 0x7fa41c0728f0 2023-09-13T02:13:35.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.761+0000 7fa42dffb640 1 -- 172.21.15.104:0/3594681666 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4300b02c0 con 0x7fa43813c4c0 2023-09-13T02:13:35.772 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.761+0000 7fa43cdba640 1 --2- 172.21.15.104:0/3594681666 >> [v2:172.21.15.119:6816/892749725,v1:172.21.15.119:6817/892749725] conn(0x7fa41c0728f0 0x7fa41c074d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.772 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.761+0000 7fa43d5bb640 1 --2- 172.21.15.104:0/3594681666 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fa41c06a4f0 0x7fa41c06c9b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa434005fd0 tx=0x7fa434005850 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:35.772 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.761+0000 7fa43cdba640 1 --2- 172.21.15.104:0/3594681666 >> [v2:172.21.15.119:6816/892749725,v1:172.21.15.119:6817/892749725] conn(0x7fa41c0728f0 0x7fa41c074d90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:35.772 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.762+0000 7fa42dffb640 1 -- 172.21.15.104:0/3594681666 <== osd.7 v2:172.21.15.119:6816/892749725 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa41c075460 con 0x7fa41c0728f0 2023-09-13T02:13:35.774 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.775+0000 7fa43f81f640 1 -- 172.21.15.104:0/3594681666 --> [v2:172.21.15.119:6816/892749725,v1:172.21.15.119:6817/892749725] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa43804e100 con 0x7fa41c0728f0 2023-09-13T02:13:35.775 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.775+0000 7fa42dffb640 1 -- 172.21.15.104:0/3594681666 <== osd.7 v2:172.21.15.119:6816/892749725 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa43804e100 con 0x7fa41c0728f0 2023-09-13T02:13:35.776 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2023-09-13T02:13:35.776 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-13T02:13:35.776 INFO:teuthology.orchestra.run.smithi104.stdout:} 2023-09-13T02:13:35.777 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.776+0000 7fa43f81f640 1 -- 172.21.15.104:0/3594681666 >> [v2:172.21.15.119:6816/892749725,v1:172.21.15.119:6817/892749725] conn(0x7fa41c0728f0 msgr2=0x7fa41c074d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.776+0000 7fa43f81f640 1 --2- 172.21.15.104:0/3594681666 >> [v2:172.21.15.119:6816/892749725,v1:172.21.15.119:6817/892749725] conn(0x7fa41c0728f0 0x7fa41c074d90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.776+0000 7fa43f81f640 1 -- 172.21.15.104:0/3594681666 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fa41c06a4f0 msgr2=0x7fa41c06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.776+0000 7fa43f81f640 1 --2- 172.21.15.104:0/3594681666 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fa41c06a4f0 0x7fa41c06c9b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa434005fd0 tx=0x7fa434005850 comp rx=0 tx=0).stop 2023-09-13T02:13:35.778 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.776+0000 7fa43f81f640 1 -- 172.21.15.104:0/3594681666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa43813c4c0 msgr2=0x7fa43813d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.779 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.776+0000 7fa43f81f640 1 --2- 172.21.15.104:0/3594681666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa43813c4c0 0x7fa43813d350 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa430037040 tx=0x7fa430035db0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.779 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.776+0000 7fa43ddbc640 1 -- 172.21.15.104:0/3594681666 reap_dead start 2023-09-13T02:13:35.779 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.776+0000 7fa43f81f640 1 -- 172.21.15.104:0/3594681666 shutdown_connections 2023-09-13T02:13:35.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.776+0000 7fa43f81f640 1 -- 172.21.15.104:0/3594681666 >> 172.21.15.104:0/3594681666 conn(0x7fa4380b56f0 msgr2=0x7fa4380b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:35.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.776+0000 7fa43f81f640 1 -- 172.21.15.104:0/3594681666 shutdown_connections 2023-09-13T02:13:35.780 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.776+0000 7fa43f81f640 1 -- 172.21.15.104:0/3594681666 wait complete. 2023-09-13T02:13:35.786 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-09-13T02:13:35.888 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.887+0000 7ffab8573640 1 -- 172.21.15.104:0/1888636493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffab006def0 msgr2=0x7ffab0145cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.888 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.887+0000 7ffab8573640 1 --2- 172.21.15.104:0/1888636493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffab006def0 0x7ffab0145cf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0005fd0 tx=0x7ffaa002bc60 comp rx=0 tx=0).stop 2023-09-13T02:13:35.888 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.888+0000 7ffab8573640 1 -- 172.21.15.104:0/1888636493 shutdown_connections 2023-09-13T02:13:35.889 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.888+0000 7ffab8573640 1 --2- 172.21.15.104:0/1888636493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffab006def0 0x7ffab0145cf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.889 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.888+0000 7ffab8573640 1 --2- 172.21.15.104:0/1888636493 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffab00aefb0 0x7ffab01457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.889 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.888+0000 7ffab8573640 1 -- 172.21.15.104:0/1888636493 >> 172.21.15.104:0/1888636493 conn(0x7ffab00b56f0 msgr2=0x7ffab00b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:35.890 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.888+0000 7ffab8573640 1 -- 172.21.15.104:0/1888636493 shutdown_connections 2023-09-13T02:13:35.890 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.888+0000 7ffab8573640 1 -- 172.21.15.104:0/1888636493 wait complete. 2023-09-13T02:13:35.892 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab8573640 1 Processor -- start 2023-09-13T02:13:35.893 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab8573640 1 -- start start 2023-09-13T02:13:35.893 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab8573640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffab006def0 0x7ffab0131d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.893 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab8573640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab00aefb0 0x7ffab01dbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.893 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab8573640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffab013bdb0 0x7ffab01dc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.894 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab8573640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab013ac80 con 0x7ffab006def0 2023-09-13T02:13:35.894 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab8573640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0139db0 con 0x7ffab00aefb0 2023-09-13T02:13:35.894 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab8573640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab01db6a0 con 0x7ffab013bdb0 2023-09-13T02:13:35.895 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab630f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffab006def0 0x7ffab0131d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.895 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab630f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffab006def0 0x7ffab0131d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49490/0 (socket says 172.21.15.104:49490) 2023-09-13T02:13:35.895 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab630f640 1 -- 172.21.15.104:0/2773157245 learned_addr learned my addr 172.21.15.104:0/2773157245 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:35.895 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab5b0e640 1 --2- 172.21.15.104:0/2773157245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab00aefb0 0x7ffab01dbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.896 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab6b10640 1 --2- 172.21.15.104:0/2773157245 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffab013bdb0 0x7ffab01dc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.896 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab630f640 1 -- 172.21.15.104:0/2773157245 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffab013bdb0 msgr2=0x7ffab01dc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.896 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab630f640 1 --2- 172.21.15.104:0/2773157245 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffab013bdb0 0x7ffab01dc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.896 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab630f640 1 -- 172.21.15.104:0/2773157245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab00aefb0 msgr2=0x7ffab01dbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:35.897 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab630f640 1 --2- 172.21.15.104:0/2773157245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab00aefb0 0x7ffab01dbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:35.897 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab630f640 1 -- 172.21.15.104:0/2773157245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0009560 con 0x7ffab006def0 2023-09-13T02:13:35.897 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.889+0000 7ffab6b10640 1 --2- 172.21.15.104:0/2773157245 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffab013bdb0 0x7ffab01dc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:13:35.898 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.890+0000 7ffab630f640 1 --2- 172.21.15.104:0/2773157245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffab006def0 0x7ffab0131d20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00b4a0 tx=0x7ffaac00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:35.898 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.890+0000 7ffaa6ffd640 1 -- 172.21.15.104:0/2773157245 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac010610 con 0x7ffab006def0 2023-09-13T02:13:35.898 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.890+0000 7ffaa6ffd640 1 -- 172.21.15.104:0/2773157245 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffaac010860 con 0x7ffab006def0 2023-09-13T02:13:35.898 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.890+0000 7ffab8573640 1 -- 172.21.15.104:0/2773157245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab013ae80 con 0x7ffab006def0 2023-09-13T02:13:35.899 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.890+0000 7ffaa6ffd640 1 -- 172.21.15.104:0/2773157245 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac010c70 con 0x7ffab006def0 2023-09-13T02:13:35.899 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.890+0000 7ffab8573640 1 -- 172.21.15.104:0/2773157245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab013a150 con 0x7ffab006def0 2023-09-13T02:13:35.899 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.891+0000 7ffab8573640 1 -- 172.21.15.104:0/2773157245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab004e100 con 0x7ffab006def0 2023-09-13T02:13:35.899 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.891+0000 7ffaa6ffd640 1 -- 172.21.15.104:0/2773157245 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ffaac017360 con 0x7ffab006def0 2023-09-13T02:13:35.900 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.892+0000 7ffaa6ffd640 1 --2- 172.21.15.104:0/2773157245 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ffa9406a4f0 0x7ffa9406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:35.900 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.892+0000 7ffab5b0e640 1 --2- 172.21.15.104:0/2773157245 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ffa9406a4f0 0x7ffa9406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:35.900 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.892+0000 7ffaa6ffd640 1 -- 172.21.15.104:0/2773157245 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5881+0+0 (secure 0 0 0) 0x7ffaac0888c0 con 0x7ffab006def0 2023-09-13T02:13:35.900 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.892+0000 7ffab5b0e640 1 --2- 172.21.15.104:0/2773157245 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ffa9406a4f0 0x7ffa9406c9b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0035000 tx=0x7ffaa0004730 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:35.901 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:35.896+0000 7ffaa6ffd640 1 -- 172.21.15.104:0/2773157245 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ffaac057960 con 0x7ffab006def0 2023-09-13T02:13:36.064 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.063+0000 7ffab8573640 1 -- 172.21.15.104:0/2773157245 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ffab0139f70 con 0x7ffa9406a4f0 2023-09-13T02:13:36.064 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.064+0000 7ffaa6ffd640 1 -- 172.21.15.104:0/2773157245 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ffab0139f70 con 0x7ffa9406a4f0 2023-09-13T02:13:36.064 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 7 to deep-scrub 2023-09-13T02:13:36.066 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.066+0000 7ffab8573640 1 -- 172.21.15.104:0/2773157245 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ffa9406a4f0 msgr2=0x7ffa9406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:36.066 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.066+0000 7ffab8573640 1 --2- 172.21.15.104:0/2773157245 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ffa9406a4f0 0x7ffa9406c9b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0035000 tx=0x7ffaa0004730 comp rx=0 tx=0).stop 2023-09-13T02:13:36.067 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.066+0000 7ffab8573640 1 -- 172.21.15.104:0/2773157245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffab006def0 msgr2=0x7ffab0131d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:36.067 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.066+0000 7ffab8573640 1 --2- 172.21.15.104:0/2773157245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffab006def0 0x7ffab0131d20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00b4a0 tx=0x7ffaac00b960 comp rx=0 tx=0).stop 2023-09-13T02:13:36.067 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.066+0000 7ffab8573640 1 -- 172.21.15.104:0/2773157245 shutdown_connections 2023-09-13T02:13:36.067 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.066+0000 7ffab8573640 1 --2- 172.21.15.104:0/2773157245 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ffa9406a4f0 0x7ffa9406c9b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:36.068 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.066+0000 7ffab8573640 1 --2- 172.21.15.104:0/2773157245 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffab013bdb0 0x7ffab01dc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:36.068 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.066+0000 7ffab8573640 1 --2- 172.21.15.104:0/2773157245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffab00aefb0 0x7ffab01dbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:36.068 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.066+0000 7ffab8573640 1 --2- 172.21.15.104:0/2773157245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffab006def0 0x7ffab0131d20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:36.069 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.066+0000 7ffab8573640 1 -- 172.21.15.104:0/2773157245 >> 172.21.15.104:0/2773157245 conn(0x7ffab00b56f0 msgr2=0x7ffab00aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:36.069 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.066+0000 7ffab8573640 1 -- 172.21.15.104:0/2773157245 shutdown_connections 2023-09-13T02:13:36.069 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.066+0000 7ffab8573640 1 -- 172.21.15.104:0/2773157245 wait complete. 2023-09-13T02:13:36.077 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T02:13:36.179 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.179+0000 7f93bd905640 1 -- 172.21.15.104:0/2526141201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93b8147b90 msgr2=0x7f93b81482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:36.180 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.179+0000 7f93bd905640 1 --2- 172.21.15.104:0/2526141201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93b8147b90 0x7f93b81482f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f93b81453c0 tx=0x7f93a802c1d0 comp rx=0 tx=0).stop 2023-09-13T02:13:36.180 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.179+0000 7f93bd905640 1 -- 172.21.15.104:0/2526141201 shutdown_connections 2023-09-13T02:13:36.180 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.179+0000 7f93bd905640 1 --2- 172.21.15.104:0/2526141201 >> v2:172.21.15.119:3300/0 conn(0x7f93b80b5ba0 0x7f93b814ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:36.181 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.179+0000 7f93bd905640 1 --2- 172.21.15.104:0/2526141201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93b8147b90 0x7f93b81482f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:36.181 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.179+0000 7f93bd905640 1 -- 172.21.15.104:0/2526141201 >> 172.21.15.104:0/2526141201 conn(0x7f93b80708b0 msgr2=0x7f93b8070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:36.181 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.179+0000 7f93bd905640 1 -- 172.21.15.104:0/2526141201 shutdown_connections 2023-09-13T02:13:36.182 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.179+0000 7f93bd905640 1 -- 172.21.15.104:0/2526141201 wait complete. 2023-09-13T02:13:36.184 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.180+0000 7f93bd905640 1 Processor -- start 2023-09-13T02:13:36.184 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.180+0000 7f93bd905640 1 -- start start 2023-09-13T02:13:36.185 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.180+0000 7f93bd905640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93b80b5ba0 0x7f93b81439f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:36.185 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.180+0000 7f93bd905640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93b8147b90 0x7f93b8137e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:36.185 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f93bd905640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93b813e460 0x7f93b8131110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:36.186 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f93bd905640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b81ddc90 con 0x7f93b8147b90 2023-09-13T02:13:36.186 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f93bd905640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b81dd8f0 con 0x7f93b80b5ba0 2023-09-13T02:13:36.186 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f93bd905640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8142220 con 0x7f93b813e460 2023-09-13T02:13:36.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f93b67fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93b8147b90 0x7f93b8137e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:36.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f93b67fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93b8147b90 0x7f93b8137e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49502/0 (socket says 172.21.15.104:49502) 2023-09-13T02:13:36.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f93b67fc640 1 -- 172.21.15.104:0/1198556280 learned_addr learned my addr 172.21.15.104:0/1198556280 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:36.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f93b77fe640 1 --2- 172.21.15.104:0/1198556280 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93b813e460 0x7f93b8131110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:36.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f93b67fc640 1 -- 172.21.15.104:0/1198556280 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93b813e460 msgr2=0x7f93b8131110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:36.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f93b6ffd640 1 --2- 172.21.15.104:0/1198556280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93b80b5ba0 0x7f93b81439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:36.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f93b67fc640 1 --2- 172.21.15.104:0/1198556280 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93b813e460 0x7f93b8131110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f93b67fc640 1 -- 172.21.15.104:0/1198556280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93b80b5ba0 msgr2=0x7f93b81439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f93b67fc640 1 --2- 172.21.15.104:0/1198556280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93b80b5ba0 0x7f93b81439f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f93b67fc640 1 -- 172.21.15.104:0/1198556280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a8009900 con 0x7f93b8147b90 2023-09-13T02:13:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f93b67fc640 1 --2- 172.21.15.104:0/1198556280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93b8147b90 0x7f93b8137e60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00c400 tx=0x7f93ac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f939ffff640 1 -- 172.21.15.104:0/1198556280 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac011790 con 0x7f93b8147b90 2023-09-13T02:13:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f939ffff640 1 -- 172.21.15.104:0/1198556280 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f93ac011a20 con 0x7f93b8147b90 2023-09-13T02:13:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f939ffff640 1 -- 172.21.15.104:0/1198556280 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac011e30 con 0x7f93b8147b90 2023-09-13T02:13:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f93bd905640 1 -- 172.21.15.104:0/1198556280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b80b1000 con 0x7f93b8147b90 2023-09-13T02:13:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.181+0000 7f93bd905640 1 -- 172.21.15.104:0/1198556280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b81383a0 con 0x7f93b8147b90 2023-09-13T02:13:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.182+0000 7f93bd905640 1 -- 172.21.15.104:0/1198556280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b81dddd0 con 0x7f93b8147b90 2023-09-13T02:13:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.183+0000 7f939ffff640 1 -- 172.21.15.104:0/1198556280 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f93ac01c460 con 0x7f93b8147b90 2023-09-13T02:13:36.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.183+0000 7f939ffff640 1 --2- 172.21.15.104:0/1198556280 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f93a406a4f0 0x7f93a406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:36.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.183+0000 7f939ffff640 1 -- 172.21.15.104:0/1198556280 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f93ac088c70 con 0x7f93b8147b90 2023-09-13T02:13:36.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.183+0000 7f93b6ffd640 1 --2- 172.21.15.104:0/1198556280 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f93a406a4f0 0x7f93a406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:36.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.183+0000 7f93b6ffd640 1 --2- 172.21.15.104:0/1198556280 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f93a406a4f0 0x7f93a406c9b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f93a8036000 tx=0x7f93a8004ab0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.187+0000 7f939ffff640 1 -- 172.21.15.104:0/1198556280 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f93b81dddd0 con 0x7f93b8147b90 2023-09-13T02:13:36.349 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.349+0000 7f93bd905640 1 -- 172.21.15.104:0/1198556280 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93b80b0e80 con 0x7f93a406a4f0 2023-09-13T02:13:36.356 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.357+0000 7f939ffff640 1 -- 172.21.15.104:0/1198556280 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289508 (secure 0 0 0) 0x7f93a80039f0 con 0x7f93a406a4f0 2023-09-13T02:13:36.359 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:13:36.361 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2023-09-13T02:13:36.363 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.359+0000 7f93bd905640 1 -- 172.21.15.104:0/1198556280 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f93a406a4f0 msgr2=0x7f93a406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:36.363 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.360+0000 7f93bd905640 1 --2- 172.21.15.104:0/1198556280 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f93a406a4f0 0x7f93a406c9b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f93a8036000 tx=0x7f93a8004ab0 comp rx=0 tx=0).stop 2023-09-13T02:13:36.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.360+0000 7f93bd905640 1 -- 172.21.15.104:0/1198556280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93b8147b90 msgr2=0x7f93b8137e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:36.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.360+0000 7f93bd905640 1 --2- 172.21.15.104:0/1198556280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93b8147b90 0x7f93b8137e60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00c400 tx=0x7f93ac00c8c0 comp rx=0 tx=0).stop 2023-09-13T02:13:36.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.360+0000 7f93bd905640 1 -- 172.21.15.104:0/1198556280 shutdown_connections 2023-09-13T02:13:36.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.360+0000 7f93bd905640 1 --2- 172.21.15.104:0/1198556280 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f93a406a4f0 0x7f93a406c9b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:36.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.360+0000 7f93bd905640 1 --2- 172.21.15.104:0/1198556280 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93b813e460 0x7f93b8131110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:36.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.360+0000 7f93bd905640 1 --2- 172.21.15.104:0/1198556280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93b8147b90 0x7f93b8137e60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:36.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.360+0000 7f93bd905640 1 --2- 172.21.15.104:0/1198556280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93b80b5ba0 0x7f93b81439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:36.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.360+0000 7f93bd905640 1 -- 172.21.15.104:0/1198556280 >> 172.21.15.104:0/1198556280 conn(0x7f93b80708b0 msgr2=0x7f93b8145720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:36.366 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.360+0000 7f93bd905640 1 -- 172.21.15.104:0/1198556280 shutdown_connections 2023-09-13T02:13:36.366 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:36.360+0000 7f93bd905640 1 -- 172.21.15.104:0/1198556280 wait complete. 2023-09-13T02:13:36.370 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-09-13T02:13:36.045657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1134902,"num_objects":30,"num_object_clones":3,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":2,"num_read":129,"num_read_kb":116,"num_write":429,"num_write_kb":3086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2927,"ondisk_log_size":2927,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220228,"kb_used_data":4100,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754492,"statfs":{"total":773094113280,"available":772868599808,"internally_reserved":0,"allocated":4198400,"data_stored":2934417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":280287,"num_objects":1,"num_object_clones":3,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":2,"num_read":12,"num_read_kb":13,"num_write":127,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002041"},"pg_stats":[{"pgid":"3.3f","version":"22'38","reported_seq":51,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.005526+0000","last_change":"2023-09-13T02:12:24.593673+0000","last_active":"2023-09-13T02:13:30.005526+0000","last_peered":"2023-09-13T02:13:30.005526+0000","last_clean":"2023-09-13T02:13:30.005526+0000","last_became_active":"2023-09-13T02:12:24.592754+0000","last_became_peered":"2023-09-13T02:12:24.592754+0000","last_unstale":"2023-09-13T02:13:30.005526+0000","last_undegraded":"2023-09-13T02:13:30.005526+0000","last_fullsized":"2023-09-13T02:13:30.005526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:43:34.341442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'23","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.993720+0000","last_change":"2023-09-13T02:12:24.580108+0000","last_active":"2023-09-13T02:13:29.993720+0000","last_peered":"2023-09-13T02:13:29.993720+0000","last_clean":"2023-09-13T02:13:29.993720+0000","last_became_active":"2023-09-13T02:12:24.579873+0000","last_became_peered":"2023-09-13T02:12:24.579873+0000","last_unstale":"2023-09-13T02:13:29.993720+0000","last_undegraded":"2023-09-13T02:13:29.993720+0000","last_fullsized":"2023-09-13T02:13:29.993720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'35","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.999241+0000","last_change":"2023-09-13T02:12:24.584533+0000","last_active":"2023-09-13T02:13:29.999241+0000","last_peered":"2023-09-13T02:13:29.999241+0000","last_clean":"2023-09-13T02:13:29.999241+0000","last_became_active":"2023-09-13T02:12:24.584249+0000","last_became_peered":"2023-09-13T02:12:24.584249+0000","last_unstale":"2023-09-13T02:13:29.999241+0000","last_undegraded":"2023-09-13T02:13:29.999241+0000","last_fullsized":"2023-09-13T02:13:29.999241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'37","reported_seq":50,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.004993+0000","last_change":"2023-09-13T02:12:24.596092+0000","last_active":"2023-09-13T02:13:30.004993+0000","last_peered":"2023-09-13T02:13:30.004993+0000","last_clean":"2023-09-13T02:13:30.004993+0000","last_became_active":"2023-09-13T02:12:24.595817+0000","last_became_peered":"2023-09-13T02:12:24.595817+0000","last_unstale":"2023-09-13T02:13:30.004993+0000","last_undegraded":"2023-09-13T02:13:30.004993+0000","last_fullsized":"2023-09-13T02:13:30.004993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:15.246952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'25","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.000523+0000","last_change":"2023-09-13T02:12:24.592410+0000","last_active":"2023-09-13T02:13:30.000523+0000","last_peered":"2023-09-13T02:13:30.000523+0000","last_clean":"2023-09-13T02:13:30.000523+0000","last_became_active":"2023-09-13T02:12:24.591503+0000","last_became_peered":"2023-09-13T02:12:24.591503+0000","last_unstale":"2023-09-13T02:13:30.000523+0000","last_undegraded":"2023-09-13T02:13:30.000523+0000","last_fullsized":"2023-09-13T02:13:30.000523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:43:26.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'30","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.988796+0000","last_change":"2023-09-13T02:13:06.365480+0000","last_active":"2023-09-13T02:13:29.988796+0000","last_peered":"2023-09-13T02:13:29.988796+0000","last_clean":"2023-09-13T02:13:29.988796+0000","last_became_active":"2023-09-13T02:13:06.365133+0000","last_became_peered":"2023-09-13T02:13:06.365133+0000","last_unstale":"2023-09-13T02:13:29.988796+0000","last_undegraded":"2023-09-13T02:13:29.988796+0000","last_fullsized":"2023-09-13T02:13:29.988796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:04:53.013012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"22'26","reported_seq":39,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.002481+0000","last_change":"2023-09-13T02:12:24.591304+0000","last_active":"2023-09-13T02:13:30.002481+0000","last_peered":"2023-09-13T02:13:30.002481+0000","last_clean":"2023-09-13T02:13:30.002481+0000","last_became_active":"2023-09-13T02:12:24.590654+0000","last_became_peered":"2023-09-13T02:12:24.590654+0000","last_unstale":"2023-09-13T02:13:30.002481+0000","last_undegraded":"2023-09-13T02:13:30.002481+0000","last_fullsized":"2023-09-13T02:13:30.002481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:15.246952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'37","reported_seq":50,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.002827+0000","last_change":"2023-09-13T02:12:24.588844+0000","last_active":"2023-09-13T02:13:30.002827+0000","last_peered":"2023-09-13T02:13:30.002827+0000","last_clean":"2023-09-13T02:13:30.002827+0000","last_became_active":"2023-09-13T02:12:24.588438+0000","last_became_peered":"2023-09-13T02:12:24.588438+0000","last_unstale":"2023-09-13T02:13:30.002827+0000","last_undegraded":"2023-09-13T02:13:30.002827+0000","last_fullsized":"2023-09-13T02:13:30.002827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:37.796406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'51","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.009082+0000","last_change":"2023-09-13T02:12:24.589946+0000","last_active":"2023-09-13T02:13:30.009082+0000","last_peered":"2023-09-13T02:13:30.009082+0000","last_clean":"2023-09-13T02:13:30.009082+0000","last_became_active":"2023-09-13T02:12:24.589606+0000","last_became_peered":"2023-09-13T02:12:24.589606+0000","last_unstale":"2023-09-13T02:13:30.009082+0000","last_undegraded":"2023-09-13T02:13:30.009082+0000","last_fullsized":"2023-09-13T02:13:30.009082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:41.609166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'75","reported_seq":88,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.002252+0000","last_change":"2023-09-13T02:12:24.588874+0000","last_active":"2023-09-13T02:13:30.002252+0000","last_peered":"2023-09-13T02:13:30.002252+0000","last_clean":"2023-09-13T02:13:30.002252+0000","last_became_active":"2023-09-13T02:12:24.588522+0000","last_became_peered":"2023-09-13T02:12:24.588522+0000","last_unstale":"2023-09-13T02:13:30.002252+0000","last_undegraded":"2023-09-13T02:13:30.002252+0000","last_fullsized":"2023-09-13T02:13:30.002252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'33","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.998181+0000","last_change":"2023-09-13T02:12:24.589173+0000","last_active":"2023-09-13T02:13:29.998181+0000","last_peered":"2023-09-13T02:13:29.998181+0000","last_clean":"2023-09-13T02:13:29.998181+0000","last_became_active":"2023-09-13T02:12:24.588891+0000","last_became_peered":"2023-09-13T02:12:24.588891+0000","last_unstale":"2023-09-13T02:13:29.998181+0000","last_undegraded":"2023-09-13T02:13:29.998181+0000","last_fullsized":"2023-09-13T02:13:29.998181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'36","reported_seq":49,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.989087+0000","last_change":"2023-09-13T02:12:24.587494+0000","last_active":"2023-09-13T02:13:29.989087+0000","last_peered":"2023-09-13T02:13:29.989087+0000","last_clean":"2023-09-13T02:13:29.989087+0000","last_became_active":"2023-09-13T02:12:24.587023+0000","last_became_peered":"2023-09-13T02:12:24.587023+0000","last_unstale":"2023-09-13T02:13:29.989087+0000","last_undegraded":"2023-09-13T02:13:29.989087+0000","last_fullsized":"2023-09-13T02:13:29.989087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:41.175280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'49","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.000769+0000","last_change":"2023-09-13T02:12:24.588000+0000","last_active":"2023-09-13T02:13:30.000769+0000","last_peered":"2023-09-13T02:13:30.000769+0000","last_clean":"2023-09-13T02:13:30.000769+0000","last_became_active":"2023-09-13T02:12:24.587730+0000","last_became_peered":"2023-09-13T02:12:24.587730+0000","last_unstale":"2023-09-13T02:13:30.000769+0000","last_undegraded":"2023-09-13T02:13:30.000769+0000","last_fullsized":"2023-09-13T02:13:30.000769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'41","reported_seq":54,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.996378+0000","last_change":"2023-09-13T02:12:24.584985+0000","last_active":"2023-09-13T02:13:29.996378+0000","last_peered":"2023-09-13T02:13:29.996378+0000","last_clean":"2023-09-13T02:13:29.996378+0000","last_became_active":"2023-09-13T02:12:24.584734+0000","last_became_peered":"2023-09-13T02:12:24.584734+0000","last_unstale":"2023-09-13T02:13:29.996378+0000","last_undegraded":"2023-09-13T02:13:29.996378+0000","last_fullsized":"2023-09-13T02:13:29.996378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:37.796406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'39","reported_seq":52,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.994633+0000","last_change":"2023-09-13T02:12:24.578832+0000","last_active":"2023-09-13T02:13:29.994633+0000","last_peered":"2023-09-13T02:13:29.994633+0000","last_clean":"2023-09-13T02:13:29.994633+0000","last_became_active":"2023-09-13T02:12:24.578553+0000","last_became_peered":"2023-09-13T02:12:24.578553+0000","last_unstale":"2023-09-13T02:13:29.994633+0000","last_undegraded":"2023-09-13T02:13:29.994633+0000","last_fullsized":"2023-09-13T02:13:29.994633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.001645+0000","last_change":"2023-09-13T02:12:24.591151+0000","last_active":"2023-09-13T02:13:30.001645+0000","last_peered":"2023-09-13T02:13:30.001645+0000","last_clean":"2023-09-13T02:13:30.001645+0000","last_became_active":"2023-09-13T02:12:24.590871+0000","last_became_peered":"2023-09-13T02:12:24.590871+0000","last_unstale":"2023-09-13T02:13:30.001645+0000","last_undegraded":"2023-09-13T02:13:30.001645+0000","last_fullsized":"2023-09-13T02:13:30.001645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'41","reported_seq":54,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.002995+0000","last_change":"2023-09-13T02:12:24.592615+0000","last_active":"2023-09-13T02:13:30.002995+0000","last_peered":"2023-09-13T02:13:30.002995+0000","last_clean":"2023-09-13T02:13:30.002995+0000","last_became_active":"2023-09-13T02:12:24.592325+0000","last_became_peered":"2023-09-13T02:12:24.592325+0000","last_unstale":"2023-09-13T02:13:30.002995+0000","last_undegraded":"2023-09-13T02:13:30.002995+0000","last_fullsized":"2023-09-13T02:13:30.002995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:19:41.872878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'57","reported_seq":70,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.994912+0000","last_change":"2023-09-13T02:12:24.587859+0000","last_active":"2023-09-13T02:13:29.994912+0000","last_peered":"2023-09-13T02:13:29.994912+0000","last_clean":"2023-09-13T02:13:29.994912+0000","last_became_active":"2023-09-13T02:12:24.587552+0000","last_became_peered":"2023-09-13T02:12:24.587552+0000","last_unstale":"2023-09-13T02:13:29.994912+0000","last_undegraded":"2023-09-13T02:13:29.994912+0000","last_fullsized":"2023-09-13T02:13:29.994912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:39.029452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'39","reported_seq":52,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.999158+0000","last_change":"2023-09-13T02:12:24.591593+0000","last_active":"2023-09-13T02:13:29.999158+0000","last_peered":"2023-09-13T02:13:29.999158+0000","last_clean":"2023-09-13T02:13:29.999158+0000","last_became_active":"2023-09-13T02:12:24.590670+0000","last_became_peered":"2023-09-13T02:12:24.590670+0000","last_unstale":"2023-09-13T02:13:29.999158+0000","last_undegraded":"2023-09-13T02:13:29.999158+0000","last_fullsized":"2023-09-13T02:13:29.999158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:19:41.872878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'41","reported_seq":54,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.003926+0000","last_change":"2023-09-13T02:12:24.593278+0000","last_active":"2023-09-13T02:13:30.003926+0000","last_peered":"2023-09-13T02:13:30.003926+0000","last_clean":"2023-09-13T02:13:30.003926+0000","last_became_active":"2023-09-13T02:12:24.591065+0000","last_became_peered":"2023-09-13T02:12:24.591065+0000","last_unstale":"2023-09-13T02:13:30.003926+0000","last_undegraded":"2023-09-13T02:13:30.003926+0000","last_fullsized":"2023-09-13T02:13:30.003926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'56","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.008657+0000","last_change":"2023-09-13T02:12:24.587352+0000","last_active":"2023-09-13T02:13:30.008657+0000","last_peered":"2023-09-13T02:13:30.008657+0000","last_clean":"2023-09-13T02:13:30.008657+0000","last_became_active":"2023-09-13T02:12:24.586981+0000","last_became_peered":"2023-09-13T02:12:24.586981+0000","last_unstale":"2023-09-13T02:13:30.008657+0000","last_undegraded":"2023-09-13T02:13:30.008657+0000","last_fullsized":"2023-09-13T02:13:30.008657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.001739+0000","last_change":"2023-09-13T02:12:24.595423+0000","last_active":"2023-09-13T02:13:30.001739+0000","last_peered":"2023-09-13T02:13:30.001739+0000","last_clean":"2023-09-13T02:13:30.001739+0000","last_became_active":"2023-09-13T02:12:24.594351+0000","last_became_peered":"2023-09-13T02:12:24.594351+0000","last_unstale":"2023-09-13T02:13:30.001739+0000","last_undegraded":"2023-09-13T02:13:30.001739+0000","last_fullsized":"2023-09-13T02:13:30.001739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:18.256464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.000309+0000","last_change":"2023-09-13T02:12:24.590553+0000","last_active":"2023-09-13T02:13:30.000309+0000","last_peered":"2023-09-13T02:13:30.000309+0000","last_clean":"2023-09-13T02:13:30.000309+0000","last_became_active":"2023-09-13T02:12:24.590295+0000","last_became_peered":"2023-09-13T02:12:24.590295+0000","last_unstale":"2023-09-13T02:13:30.000309+0000","last_undegraded":"2023-09-13T02:13:30.000309+0000","last_fullsized":"2023-09-13T02:13:30.000309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'37","reported_seq":50,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.003347+0000","last_change":"2023-09-13T02:12:24.593925+0000","last_active":"2023-09-13T02:13:30.003347+0000","last_peered":"2023-09-13T02:13:30.003347+0000","last_clean":"2023-09-13T02:13:30.003347+0000","last_became_active":"2023-09-13T02:12:24.593673+0000","last_became_peered":"2023-09-13T02:12:24.593673+0000","last_unstale":"2023-09-13T02:13:30.003347+0000","last_undegraded":"2023-09-13T02:13:30.003347+0000","last_fullsized":"2023-09-13T02:13:30.003347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'16","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.992514+0000","last_change":"2023-09-13T02:12:24.590496+0000","last_active":"2023-09-13T02:13:29.992514+0000","last_peered":"2023-09-13T02:13:29.992514+0000","last_clean":"2023-09-13T02:13:29.992514+0000","last_became_active":"2023-09-13T02:12:24.590231+0000","last_became_peered":"2023-09-13T02:12:24.590231+0000","last_unstale":"2023-09-13T02:13:29.992514+0000","last_undegraded":"2023-09-13T02:13:29.992514+0000","last_fullsized":"2023-09-13T02:13:29.992514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'68","reported_seq":88,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.992784+0000","last_change":"2023-09-13T02:13:05.916706+0000","last_active":"2023-09-13T02:13:29.992784+0000","last_peered":"2023-09-13T02:13:29.992784+0000","last_clean":"2023-09-13T02:13:29.992784+0000","last_became_active":"2023-09-13T02:13:05.916435+0000","last_became_peered":"2023-09-13T02:13:05.916435+0000","last_unstale":"2023-09-13T02:13:29.992784+0000","last_undegraded":"2023-09-13T02:13:29.992784+0000","last_fullsized":"2023-09-13T02:13:29.992784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:39:21.058634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'34","reported_seq":47,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.993456+0000","last_change":"2023-09-13T02:12:24.584028+0000","last_active":"2023-09-13T02:13:29.993456+0000","last_peered":"2023-09-13T02:13:29.993456+0000","last_clean":"2023-09-13T02:13:29.993456+0000","last_became_active":"2023-09-13T02:12:24.583782+0000","last_became_peered":"2023-09-13T02:12:24.583782+0000","last_unstale":"2023-09-13T02:13:29.993456+0000","last_undegraded":"2023-09-13T02:13:29.993456+0000","last_fullsized":"2023-09-13T02:13:29.993456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'23","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.001446+0000","last_change":"2023-09-13T02:12:24.590548+0000","last_active":"2023-09-13T02:13:30.001446+0000","last_peered":"2023-09-13T02:13:30.001446+0000","last_clean":"2023-09-13T02:13:30.001446+0000","last_became_active":"2023-09-13T02:12:24.590189+0000","last_became_peered":"2023-09-13T02:12:24.590189+0000","last_unstale":"2023-09-13T02:13:30.001446+0000","last_undegraded":"2023-09-13T02:13:30.001446+0000","last_fullsized":"2023-09-13T02:13:30.001446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'35","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.001954+0000","last_change":"2023-09-13T02:12:24.583749+0000","last_active":"2023-09-13T02:13:30.001954+0000","last_peered":"2023-09-13T02:13:30.001954+0000","last_clean":"2023-09-13T02:13:30.001954+0000","last_became_active":"2023-09-13T02:12:24.583453+0000","last_became_peered":"2023-09-13T02:12:24.583453+0000","last_unstale":"2023-09-13T02:13:30.001954+0000","last_undegraded":"2023-09-13T02:13:30.001954+0000","last_fullsized":"2023-09-13T02:13:30.001954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:42.603570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'42","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.001788+0000","last_change":"2023-09-13T02:12:24.595007+0000","last_active":"2023-09-13T02:13:30.001788+0000","last_peered":"2023-09-13T02:13:30.001788+0000","last_clean":"2023-09-13T02:13:30.001788+0000","last_became_active":"2023-09-13T02:12:24.592875+0000","last_became_peered":"2023-09-13T02:12:24.592875+0000","last_unstale":"2023-09-13T02:13:30.001788+0000","last_undegraded":"2023-09-13T02:13:30.001788+0000","last_fullsized":"2023-09-13T02:13:30.001788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.002252+0000","last_change":"2023-09-13T02:12:24.588586+0000","last_active":"2023-09-13T02:13:30.002252+0000","last_peered":"2023-09-13T02:13:30.002252+0000","last_clean":"2023-09-13T02:13:30.002252+0000","last_became_active":"2023-09-13T02:12:24.588173+0000","last_became_peered":"2023-09-13T02:12:24.588173+0000","last_unstale":"2023-09-13T02:13:30.002252+0000","last_undegraded":"2023-09-13T02:13:30.002252+0000","last_fullsized":"2023-09-13T02:13:30.002252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:50.824236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'45","reported_seq":58,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.992127+0000","last_change":"2023-09-13T02:12:24.590981+0000","last_active":"2023-09-13T02:13:29.992127+0000","last_peered":"2023-09-13T02:13:29.992127+0000","last_clean":"2023-09-13T02:13:29.992127+0000","last_became_active":"2023-09-13T02:12:24.590677+0000","last_became_peered":"2023-09-13T02:12:24.590677+0000","last_unstale":"2023-09-13T02:13:29.992127+0000","last_undegraded":"2023-09-13T02:13:29.992127+0000","last_fullsized":"2023-09-13T02:13:29.992127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'40","reported_seq":53,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.996420+0000","last_change":"2023-09-13T02:12:24.586738+0000","last_active":"2023-09-13T02:13:29.996420+0000","last_peered":"2023-09-13T02:13:29.996420+0000","last_clean":"2023-09-13T02:13:29.996420+0000","last_became_active":"2023-09-13T02:12:24.586251+0000","last_became_peered":"2023-09-13T02:12:24.586251+0000","last_unstale":"2023-09-13T02:13:29.996420+0000","last_undegraded":"2023-09-13T02:13:29.996420+0000","last_fullsized":"2023-09-13T02:13:29.996420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:25.830036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.914084+0000","last_change":"2023-09-13T02:12:23.579164+0000","last_active":"2023-09-13T02:13:05.914084+0000","last_peered":"2023-09-13T02:13:05.914084+0000","last_clean":"2023-09-13T02:13:05.914084+0000","last_became_active":"2023-09-13T02:12:23.578889+0000","last_became_peered":"2023-09-13T02:12:23.578889+0000","last_unstale":"2023-09-13T02:13:05.914084+0000","last_undegraded":"2023-09-13T02:13:05.914084+0000","last_fullsized":"2023-09-13T02:13:05.914084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'41","reported_seq":54,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.003496+0000","last_change":"2023-09-13T02:12:24.579559+0000","last_active":"2023-09-13T02:13:30.003496+0000","last_peered":"2023-09-13T02:13:30.003496+0000","last_clean":"2023-09-13T02:13:30.003496+0000","last_became_active":"2023-09-13T02:12:24.579243+0000","last_became_peered":"2023-09-13T02:12:24.579243+0000","last_unstale":"2023-09-13T02:13:30.003496+0000","last_undegraded":"2023-09-13T02:13:30.003496+0000","last_fullsized":"2023-09-13T02:13:30.003496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:22:23.439569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.364759+0000","last_change":"2023-09-13T02:12:23.577022+0000","last_active":"2023-09-13T02:13:05.364759+0000","last_peered":"2023-09-13T02:13:05.364759+0000","last_clean":"2023-09-13T02:13:05.364759+0000","last_became_active":"2023-09-13T02:12:23.576754+0000","last_became_peered":"2023-09-13T02:12:23.576754+0000","last_unstale":"2023-09-13T02:13:05.364759+0000","last_undegraded":"2023-09-13T02:13:05.364759+0000","last_fullsized":"2023-09-13T02:13:05.364759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:49.820358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:17.908498+0000","last_change":"2023-09-13T02:12:23.579634+0000","last_active":"2023-09-13T02:13:17.908498+0000","last_peered":"2023-09-13T02:13:17.908498+0000","last_clean":"2023-09-13T02:13:17.908498+0000","last_became_active":"2023-09-13T02:12:23.579351+0000","last_became_peered":"2023-09-13T02:12:23.579351+0000","last_unstale":"2023-09-13T02:13:17.908498+0000","last_undegraded":"2023-09-13T02:13:17.908498+0000","last_fullsized":"2023-09-13T02:13:17.908498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:24.826159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'41","reported_seq":54,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.000275+0000","last_change":"2023-09-13T02:12:24.590474+0000","last_active":"2023-09-13T02:13:30.000275+0000","last_peered":"2023-09-13T02:13:30.000275+0000","last_clean":"2023-09-13T02:13:30.000275+0000","last_became_active":"2023-09-13T02:12:24.590126+0000","last_became_peered":"2023-09-13T02:12:24.590126+0000","last_unstale":"2023-09-13T02:13:30.000275+0000","last_undegraded":"2023-09-13T02:13:30.000275+0000","last_fullsized":"2023-09-13T02:13:30.000275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.903735+0000","last_change":"2023-09-13T02:12:23.586264+0000","last_active":"2023-09-13T02:13:04.903735+0000","last_peered":"2023-09-13T02:13:04.903735+0000","last_clean":"2023-09-13T02:13:04.903735+0000","last_became_active":"2023-09-13T02:12:23.585953+0000","last_became_peered":"2023-09-13T02:12:23.585953+0000","last_unstale":"2023-09-13T02:13:04.903735+0000","last_undegraded":"2023-09-13T02:13:04.903735+0000","last_fullsized":"2023-09-13T02:13:04.903735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:27.359818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'47","reported_seq":60,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.002301+0000","last_change":"2023-09-13T02:12:24.585138+0000","last_active":"2023-09-13T02:13:30.002301+0000","last_peered":"2023-09-13T02:13:30.002301+0000","last_clean":"2023-09-13T02:13:30.002301+0000","last_became_active":"2023-09-13T02:12:24.584901+0000","last_became_peered":"2023-09-13T02:12:24.584901+0000","last_unstale":"2023-09-13T02:13:30.002301+0000","last_undegraded":"2023-09-13T02:13:30.002301+0000","last_fullsized":"2023-09-13T02:13:30.002301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.912367+0000","last_change":"2023-09-13T02:12:23.583663+0000","last_active":"2023-09-13T02:13:05.912367+0000","last_peered":"2023-09-13T02:13:05.912367+0000","last_clean":"2023-09-13T02:13:05.912367+0000","last_became_active":"2023-09-13T02:12:23.583305+0000","last_became_peered":"2023-09-13T02:12:23.583305+0000","last_unstale":"2023-09-13T02:13:05.912367+0000","last_undegraded":"2023-09-13T02:13:05.912367+0000","last_fullsized":"2023-09-13T02:13:05.912367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:32.660244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'47","reported_seq":60,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.001160+0000","last_change":"2023-09-13T02:12:24.595264+0000","last_active":"2023-09-13T02:13:30.001160+0000","last_peered":"2023-09-13T02:13:30.001160+0000","last_clean":"2023-09-13T02:13:30.001160+0000","last_became_active":"2023-09-13T02:12:24.594434+0000","last_became_peered":"2023-09-13T02:12:24.594434+0000","last_unstale":"2023-09-13T02:13:30.001160+0000","last_undegraded":"2023-09-13T02:13:30.001160+0000","last_fullsized":"2023-09-13T02:13:30.001160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:17:30.897344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.042686+0000","last_change":"2023-09-13T02:12:23.584935+0000","last_active":"2023-09-13T02:13:06.042686+0000","last_peered":"2023-09-13T02:13:06.042686+0000","last_clean":"2023-09-13T02:13:06.042686+0000","last_became_active":"2023-09-13T02:12:23.584657+0000","last_became_peered":"2023-09-13T02:12:23.584657+0000","last_unstale":"2023-09-13T02:13:06.042686+0000","last_undegraded":"2023-09-13T02:13:06.042686+0000","last_fullsized":"2023-09-13T02:13:06.042686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:36.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'52","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.003904+0000","last_change":"2023-09-13T02:12:24.588694+0000","last_active":"2023-09-13T02:13:30.003904+0000","last_peered":"2023-09-13T02:13:30.003904+0000","last_clean":"2023-09-13T02:13:30.003904+0000","last_became_active":"2023-09-13T02:12:24.588455+0000","last_became_peered":"2023-09-13T02:12:24.588455+0000","last_unstale":"2023-09-13T02:13:30.003904+0000","last_undegraded":"2023-09-13T02:13:30.003904+0000","last_fullsized":"2023-09-13T02:13:30.003904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":3,"num_object_clones":2,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'12","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:28.894150+0000","last_change":"2023-09-13T02:12:23.582781+0000","last_active":"2023-09-13T02:13:28.894150+0000","last_peered":"2023-09-13T02:13:28.894150+0000","last_clean":"2023-09-13T02:13:28.894150+0000","last_became_active":"2023-09-13T02:12:23.582506+0000","last_became_peered":"2023-09-13T02:12:23.582506+0000","last_unstale":"2023-09-13T02:13:28.894150+0000","last_undegraded":"2023-09-13T02:13:28.894150+0000","last_fullsized":"2023-09-13T02:13:28.894150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:03.890491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.006362+0000","last_change":"2023-09-13T02:12:24.594514+0000","last_active":"2023-09-13T02:13:30.006362+0000","last_peered":"2023-09-13T02:13:30.006362+0000","last_clean":"2023-09-13T02:13:30.006362+0000","last_became_active":"2023-09-13T02:12:24.592367+0000","last_became_peered":"2023-09-13T02:12:24.592367+0000","last_unstale":"2023-09-13T02:13:30.006362+0000","last_undegraded":"2023-09-13T02:13:30.006362+0000","last_fullsized":"2023-09-13T02:13:30.006362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:08.045218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'145","reported_seq":159,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.963311+0000","last_change":"2023-09-13T02:12:23.579000+0000","last_active":"2023-09-13T02:13:29.963311+0000","last_peered":"2023-09-13T02:13:29.963311+0000","last_clean":"2023-09-13T02:13:29.963311+0000","last_became_active":"2023-09-13T02:12:23.578748+0000","last_became_peered":"2023-09-13T02:12:23.578748+0000","last_unstale":"2023-09-13T02:13:29.963311+0000","last_undegraded":"2023-09-13T02:13:29.963311+0000","last_fullsized":"2023-09-13T02:13:29.963311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:38.025574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537943,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'32","reported_seq":45,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.003518+0000","last_change":"2023-09-13T02:12:24.593514+0000","last_active":"2023-09-13T02:13:30.003518+0000","last_peered":"2023-09-13T02:13:30.003518+0000","last_clean":"2023-09-13T02:13:30.003518+0000","last_became_active":"2023-09-13T02:12:24.593092+0000","last_became_peered":"2023-09-13T02:12:24.593092+0000","last_unstale":"2023-09-13T02:13:30.003518+0000","last_undegraded":"2023-09-13T02:13:30.003518+0000","last_fullsized":"2023-09-13T02:13:30.003518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:18:08.378805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364390+0000","last_change":"2023-09-13T02:12:23.579348+0000","last_active":"2023-09-13T02:13:06.364390+0000","last_peered":"2023-09-13T02:13:06.364390+0000","last_clean":"2023-09-13T02:13:06.364390+0000","last_became_active":"2023-09-13T02:12:23.579079+0000","last_became_peered":"2023-09-13T02:12:23.579079+0000","last_unstale":"2023-09-13T02:13:06.364390+0000","last_undegraded":"2023-09-13T02:13:06.364390+0000","last_fullsized":"2023-09-13T02:13:06.364390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:07.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'52","reported_seq":65,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.004922+0000","last_change":"2023-09-13T02:12:24.587235+0000","last_active":"2023-09-13T02:13:30.004922+0000","last_peered":"2023-09-13T02:13:30.004922+0000","last_clean":"2023-09-13T02:13:30.004922+0000","last_became_active":"2023-09-13T02:12:24.586930+0000","last_became_peered":"2023-09-13T02:12:24.586930+0000","last_unstale":"2023-09-13T02:13:30.004922+0000","last_undegraded":"2023-09-13T02:13:30.004922+0000","last_fullsized":"2023-09-13T02:13:30.004922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:12.227954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.904408+0000","last_change":"2023-09-13T02:12:23.585680+0000","last_active":"2023-09-13T02:13:04.904408+0000","last_peered":"2023-09-13T02:13:04.904408+0000","last_clean":"2023-09-13T02:13:04.904408+0000","last_became_active":"2023-09-13T02:12:23.585417+0000","last_became_peered":"2023-09-13T02:12:23.585417+0000","last_unstale":"2023-09-13T02:13:04.904408+0000","last_undegraded":"2023-09-13T02:13:04.904408+0000","last_fullsized":"2023-09-13T02:13:04.904408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:03.890491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'73","reported_seq":86,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.008568+0000","last_change":"2023-09-13T02:12:24.592703+0000","last_active":"2023-09-13T02:13:30.008568+0000","last_peered":"2023-09-13T02:13:30.008568+0000","last_clean":"2023-09-13T02:13:30.008568+0000","last_became_active":"2023-09-13T02:12:24.591849+0000","last_became_peered":"2023-09-13T02:12:24.591849+0000","last_unstale":"2023-09-13T02:13:30.008568+0000","last_undegraded":"2023-09-13T02:13:30.008568+0000","last_fullsized":"2023-09-13T02:13:30.008568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:17:30.897344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.363813+0000","last_change":"2023-09-13T02:12:23.576659+0000","last_active":"2023-09-13T02:13:05.363813+0000","last_peered":"2023-09-13T02:13:05.363813+0000","last_clean":"2023-09-13T02:13:05.363813+0000","last_became_active":"2023-09-13T02:12:23.576022+0000","last_became_peered":"2023-09-13T02:12:23.576022+0000","last_unstale":"2023-09-13T02:13:05.363813+0000","last_undegraded":"2023-09-13T02:13:05.363813+0000","last_fullsized":"2023-09-13T02:13:05.363813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:51.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'33","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.989845+0000","last_change":"2023-09-13T02:12:24.591552+0000","last_active":"2023-09-13T02:13:29.989845+0000","last_peered":"2023-09-13T02:13:29.989845+0000","last_clean":"2023-09-13T02:13:29.989845+0000","last_became_active":"2023-09-13T02:12:24.591247+0000","last_became_peered":"2023-09-13T02:12:24.591247+0000","last_unstale":"2023-09-13T02:13:29.989845+0000","last_undegraded":"2023-09-13T02:13:29.989845+0000","last_fullsized":"2023-09-13T02:13:29.989845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:28.363696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'9","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.910464+0000","last_change":"2023-09-13T02:12:23.570753+0000","last_active":"2023-09-13T02:13:05.910464+0000","last_peered":"2023-09-13T02:13:05.910464+0000","last_clean":"2023-09-13T02:13:05.910464+0000","last_became_active":"2023-09-13T02:12:23.570461+0000","last_became_peered":"2023-09-13T02:12:23.570461+0000","last_unstale":"2023-09-13T02:13:05.910464+0000","last_undegraded":"2023-09-13T02:13:05.910464+0000","last_fullsized":"2023-09-13T02:13:05.910464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'34","reported_seq":47,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.005182+0000","last_change":"2023-09-13T02:12:24.591474+0000","last_active":"2023-09-13T02:13:30.005182+0000","last_peered":"2023-09-13T02:13:30.005182+0000","last_clean":"2023-09-13T02:13:30.005182+0000","last_became_active":"2023-09-13T02:12:24.591036+0000","last_became_peered":"2023-09-13T02:12:24.591036+0000","last_unstale":"2023-09-13T02:13:30.005182+0000","last_undegraded":"2023-09-13T02:13:30.005182+0000","last_fullsized":"2023-09-13T02:13:30.005182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.273406+0000","last_change":"2023-09-13T02:12:23.584508+0000","last_active":"2023-09-13T02:13:05.273406+0000","last_peered":"2023-09-13T02:13:05.273406+0000","last_clean":"2023-09-13T02:13:05.273406+0000","last_became_active":"2023-09-13T02:12:23.584235+0000","last_became_peered":"2023-09-13T02:12:23.584235+0000","last_unstale":"2023-09-13T02:13:05.273406+0000","last_undegraded":"2023-09-13T02:13:05.273406+0000","last_fullsized":"2023-09-13T02:13:05.273406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'30","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.005174+0000","last_change":"2023-09-13T02:12:24.593312+0000","last_active":"2023-09-13T02:13:30.005174+0000","last_peered":"2023-09-13T02:13:30.005174+0000","last_clean":"2023-09-13T02:13:30.005174+0000","last_became_active":"2023-09-13T02:12:24.592242+0000","last_became_peered":"2023-09-13T02:12:24.592242+0000","last_unstale":"2023-09-13T02:13:30.005174+0000","last_undegraded":"2023-09-13T02:13:30.005174+0000","last_fullsized":"2023-09-13T02:13:30.005174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:03:12.365120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.908624+0000","last_change":"2023-09-13T02:12:23.578204+0000","last_active":"2023-09-13T02:13:04.908624+0000","last_peered":"2023-09-13T02:13:04.908624+0000","last_clean":"2023-09-13T02:13:04.908624+0000","last_became_active":"2023-09-13T02:12:23.577918+0000","last_became_peered":"2023-09-13T02:12:23.577918+0000","last_unstale":"2023-09-13T02:13:04.908624+0000","last_undegraded":"2023-09-13T02:13:04.908624+0000","last_fullsized":"2023-09-13T02:13:04.908624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:24.826159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'45","reported_seq":58,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.006661+0000","last_change":"2023-09-13T02:12:24.595748+0000","last_active":"2023-09-13T02:13:30.006661+0000","last_peered":"2023-09-13T02:13:30.006661+0000","last_clean":"2023-09-13T02:13:30.006661+0000","last_became_active":"2023-09-13T02:12:24.595462+0000","last_became_peered":"2023-09-13T02:12:24.595462+0000","last_unstale":"2023-09-13T02:13:30.006661+0000","last_undegraded":"2023-09-13T02:13:30.006661+0000","last_fullsized":"2023-09-13T02:13:30.006661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:52:10.210519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.905766+0000","last_change":"2023-09-13T02:12:23.570346+0000","last_active":"2023-09-13T02:13:04.905766+0000","last_peered":"2023-09-13T02:13:04.905766+0000","last_clean":"2023-09-13T02:13:04.905766+0000","last_became_active":"2023-09-13T02:12:23.570066+0000","last_became_peered":"2023-09-13T02:12:23.570066+0000","last_unstale":"2023-09-13T02:13:04.905766+0000","last_undegraded":"2023-09-13T02:13:04.905766+0000","last_fullsized":"2023-09-13T02:13:04.905766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:20:36.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'35","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.004674+0000","last_change":"2023-09-13T02:12:24.595650+0000","last_active":"2023-09-13T02:13:30.004674+0000","last_peered":"2023-09-13T02:13:30.004674+0000","last_clean":"2023-09-13T02:13:30.004674+0000","last_became_active":"2023-09-13T02:12:24.595327+0000","last_became_peered":"2023-09-13T02:12:24.595327+0000","last_unstale":"2023-09-13T02:13:30.004674+0000","last_undegraded":"2023-09-13T02:13:30.004674+0000","last_fullsized":"2023-09-13T02:13:30.004674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:43:26.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:17.907966+0000","last_change":"2023-09-13T02:12:23.583113+0000","last_active":"2023-09-13T02:13:17.907966+0000","last_peered":"2023-09-13T02:13:17.907966+0000","last_clean":"2023-09-13T02:13:17.907966+0000","last_became_active":"2023-09-13T02:12:23.582841+0000","last_became_peered":"2023-09-13T02:12:23.582841+0000","last_unstale":"2023-09-13T02:13:17.907966+0000","last_undegraded":"2023-09-13T02:13:17.907966+0000","last_fullsized":"2023-09-13T02:13:17.907966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'38","reported_seq":51,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.006782+0000","last_change":"2023-09-13T02:12:24.590616+0000","last_active":"2023-09-13T02:13:30.006782+0000","last_peered":"2023-09-13T02:13:30.006782+0000","last_clean":"2023-09-13T02:13:30.006782+0000","last_became_active":"2023-09-13T02:12:24.590343+0000","last_became_peered":"2023-09-13T02:12:24.590343+0000","last_unstale":"2023-09-13T02:13:30.006782+0000","last_undegraded":"2023-09-13T02:13:30.006782+0000","last_fullsized":"2023-09-13T02:13:30.006782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:15.126313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.363945+0000","last_change":"2023-09-13T02:12:13.261542+0000","last_active":"2023-09-13T02:13:05.363945+0000","last_peered":"2023-09-13T02:13:05.363945+0000","last_clean":"2023-09-13T02:13:05.363945+0000","last_became_active":"2023-09-13T02:12:13.260630+0000","last_became_peered":"2023-09-13T02:12:13.260630+0000","last_unstale":"2023-09-13T02:13:05.363945+0000","last_undegraded":"2023-09-13T02:13:05.363945+0000","last_fullsized":"2023-09-13T02:13:05.363945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:12.209844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:12.209844+0000","last_clean_scrub_stamp":"2023-09-13T02:12:12.209844+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:07:47.139624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.903886+0000","last_change":"2023-09-13T02:12:23.584227+0000","last_active":"2023-09-13T02:13:04.903886+0000","last_peered":"2023-09-13T02:13:04.903886+0000","last_clean":"2023-09-13T02:13:04.903886+0000","last_became_active":"2023-09-13T02:12:23.583874+0000","last_became_peered":"2023-09-13T02:12:23.583874+0000","last_unstale":"2023-09-13T02:13:04.903886+0000","last_undegraded":"2023-09-13T02:13:04.903886+0000","last_fullsized":"2023-09-13T02:13:04.903886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:44:50.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'35","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.000044+0000","last_change":"2023-09-13T02:13:05.919047+0000","last_active":"2023-09-13T02:13:30.000044+0000","last_peered":"2023-09-13T02:13:30.000044+0000","last_clean":"2023-09-13T02:13:30.000044+0000","last_became_active":"2023-09-13T02:13:05.918736+0000","last_became_peered":"2023-09-13T02:13:05.918736+0000","last_unstale":"2023-09-13T02:13:30.000044+0000","last_undegraded":"2023-09-13T02:13:30.000044+0000","last_fullsized":"2023-09-13T02:13:30.000044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:13:36.591729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364003+0000","last_change":"2023-09-13T02:12:23.580928+0000","last_active":"2023-09-13T02:13:06.364003+0000","last_peered":"2023-09-13T02:13:06.364003+0000","last_clean":"2023-09-13T02:13:06.364003+0000","last_became_active":"2023-09-13T02:12:23.580670+0000","last_became_peered":"2023-09-13T02:12:23.580670+0000","last_unstale":"2023-09-13T02:13:06.364003+0000","last_undegraded":"2023-09-13T02:13:06.364003+0000","last_fullsized":"2023-09-13T02:13:06.364003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'24","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.000247+0000","last_change":"2023-09-13T02:12:24.579008+0000","last_active":"2023-09-13T02:13:30.000247+0000","last_peered":"2023-09-13T02:13:30.000247+0000","last_clean":"2023-09-13T02:13:30.000247+0000","last_became_active":"2023-09-13T02:12:24.578715+0000","last_became_peered":"2023-09-13T02:12:24.578715+0000","last_unstale":"2023-09-13T02:13:30.000247+0000","last_undegraded":"2023-09-13T02:13:30.000247+0000","last_fullsized":"2023-09-13T02:13:30.000247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:04.894368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'15","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.888456+0000","last_change":"2023-09-13T02:12:23.578080+0000","last_active":"2023-09-13T02:13:29.888456+0000","last_peered":"2023-09-13T02:13:29.888456+0000","last_clean":"2023-09-13T02:13:29.888456+0000","last_became_active":"2023-09-13T02:12:23.577786+0000","last_became_peered":"2023-09-13T02:12:23.577786+0000","last_unstale":"2023-09-13T02:13:29.888456+0000","last_undegraded":"2023-09-13T02:13:29.888456+0000","last_fullsized":"2023-09-13T02:13:29.888456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:51.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5781,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":13,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'46","reported_seq":59,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.994258+0000","last_change":"2023-09-13T02:12:24.582717+0000","last_active":"2023-09-13T02:13:29.994258+0000","last_peered":"2023-09-13T02:13:29.994258+0000","last_clean":"2023-09-13T02:13:29.994258+0000","last_became_active":"2023-09-13T02:12:24.582439+0000","last_became_peered":"2023-09-13T02:12:24.582439+0000","last_unstale":"2023-09-13T02:13:29.994258+0000","last_undegraded":"2023-09-13T02:13:29.994258+0000","last_fullsized":"2023-09-13T02:13:29.994258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:41.289928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.904406+0000","last_change":"2023-09-13T02:12:23.585601+0000","last_active":"2023-09-13T02:13:04.904406+0000","last_peered":"2023-09-13T02:13:04.904406+0000","last_clean":"2023-09-13T02:13:04.904406+0000","last_became_active":"2023-09-13T02:12:23.585349+0000","last_became_peered":"2023-09-13T02:12:23.585349+0000","last_unstale":"2023-09-13T02:13:04.904406+0000","last_undegraded":"2023-09-13T02:13:04.904406+0000","last_fullsized":"2023-09-13T02:13:04.904406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:38.820251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'33","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.992591+0000","last_change":"2023-09-13T02:12:24.586175+0000","last_active":"2023-09-13T02:13:29.992591+0000","last_peered":"2023-09-13T02:13:29.992591+0000","last_clean":"2023-09-13T02:13:29.992591+0000","last_became_active":"2023-09-13T02:12:24.585054+0000","last_became_peered":"2023-09-13T02:12:24.585054+0000","last_unstale":"2023-09-13T02:13:29.992591+0000","last_undegraded":"2023-09-13T02:13:29.992591+0000","last_fullsized":"2023-09-13T02:13:29.992591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:18:39.029452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.905876+0000","last_change":"2023-09-13T02:12:23.580143+0000","last_active":"2023-09-13T02:13:04.905876+0000","last_peered":"2023-09-13T02:13:04.905876+0000","last_clean":"2023-09-13T02:13:04.905876+0000","last_became_active":"2023-09-13T02:12:23.579844+0000","last_became_peered":"2023-09-13T02:12:23.579844+0000","last_unstale":"2023-09-13T02:13:04.905876+0000","last_undegraded":"2023-09-13T02:13:04.905876+0000","last_fullsized":"2023-09-13T02:13:04.905876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:21:49.468231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'32","reported_seq":45,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.003743+0000","last_change":"2023-09-13T02:12:24.592756+0000","last_active":"2023-09-13T02:13:30.003743+0000","last_peered":"2023-09-13T02:13:30.003743+0000","last_clean":"2023-09-13T02:13:30.003743+0000","last_became_active":"2023-09-13T02:12:24.592436+0000","last_became_peered":"2023-09-13T02:12:24.592436+0000","last_unstale":"2023-09-13T02:13:30.003743+0000","last_undegraded":"2023-09-13T02:13:30.003743+0000","last_fullsized":"2023-09-13T02:13:30.003743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:03:12.365120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.364613+0000","last_change":"2023-09-13T02:12:23.585605+0000","last_active":"2023-09-13T02:13:05.364613+0000","last_peered":"2023-09-13T02:13:05.364613+0000","last_clean":"2023-09-13T02:13:05.364613+0000","last_became_active":"2023-09-13T02:12:23.585411+0000","last_became_peered":"2023-09-13T02:12:23.585411+0000","last_unstale":"2023-09-13T02:13:05.364613+0000","last_undegraded":"2023-09-13T02:13:05.364613+0000","last_fullsized":"2023-09-13T02:13:05.364613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:54:40.286050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'45","reported_seq":58,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.993223+0000","last_change":"2023-09-13T02:12:24.582796+0000","last_active":"2023-09-13T02:13:29.993223+0000","last_peered":"2023-09-13T02:13:29.993223+0000","last_clean":"2023-09-13T02:13:29.993223+0000","last_became_active":"2023-09-13T02:12:24.582517+0000","last_became_peered":"2023-09-13T02:12:24.582517+0000","last_unstale":"2023-09-13T02:13:29.993223+0000","last_undegraded":"2023-09-13T02:13:29.993223+0000","last_fullsized":"2023-09-13T02:13:29.993223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:22.771990+0000","last_change":"2023-09-13T02:12:23.576140+0000","last_active":"2023-09-13T02:13:22.771990+0000","last_peered":"2023-09-13T02:13:22.771990+0000","last_clean":"2023-09-13T02:13:22.771990+0000","last_became_active":"2023-09-13T02:12:23.575875+0000","last_became_peered":"2023-09-13T02:12:23.575875+0000","last_unstale":"2023-09-13T02:13:22.771990+0000","last_undegraded":"2023-09-13T02:13:22.771990+0000","last_fullsized":"2023-09-13T02:13:22.771990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:07.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'31","reported_seq":44,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.000691+0000","last_change":"2023-09-13T02:12:24.592556+0000","last_active":"2023-09-13T02:13:30.000691+0000","last_peered":"2023-09-13T02:13:30.000691+0000","last_clean":"2023-09-13T02:13:30.000691+0000","last_became_active":"2023-09-13T02:12:24.592247+0000","last_became_peered":"2023-09-13T02:12:24.592247+0000","last_unstale":"2023-09-13T02:13:30.000691+0000","last_undegraded":"2023-09-13T02:13:30.000691+0000","last_fullsized":"2023-09-13T02:13:30.000691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:17:05.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:17.903307+0000","last_change":"2023-09-13T02:12:23.579687+0000","last_active":"2023-09-13T02:13:17.903307+0000","last_peered":"2023-09-13T02:13:17.903307+0000","last_clean":"2023-09-13T02:13:17.903307+0000","last_became_active":"2023-09-13T02:12:23.579389+0000","last_became_peered":"2023-09-13T02:12:23.579389+0000","last_unstale":"2023-09-13T02:13:17.903307+0000","last_undegraded":"2023-09-13T02:13:17.903307+0000","last_fullsized":"2023-09-13T02:13:17.903307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'42","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.001144+0000","last_change":"2023-09-13T02:12:24.585029+0000","last_active":"2023-09-13T02:13:30.001144+0000","last_peered":"2023-09-13T02:13:30.001144+0000","last_clean":"2023-09-13T02:13:30.001144+0000","last_became_active":"2023-09-13T02:12:24.584791+0000","last_became_peered":"2023-09-13T02:12:24.584791+0000","last_unstale":"2023-09-13T02:13:30.001144+0000","last_undegraded":"2023-09-13T02:13:30.001144+0000","last_fullsized":"2023-09-13T02:13:30.001144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.363984+0000","last_change":"2023-09-13T02:12:23.585601+0000","last_active":"2023-09-13T02:13:06.363984+0000","last_peered":"2023-09-13T02:13:06.363984+0000","last_clean":"2023-09-13T02:13:06.363984+0000","last_became_active":"2023-09-13T02:12:23.585321+0000","last_became_peered":"2023-09-13T02:12:23.585321+0000","last_unstale":"2023-09-13T02:13:06.363984+0000","last_undegraded":"2023-09-13T02:13:06.363984+0000","last_fullsized":"2023-09-13T02:13:06.363984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:47:40.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'13","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:28.942220+0000","last_change":"2023-09-13T02:12:24.586947+0000","last_active":"2023-09-13T02:13:28.942220+0000","last_peered":"2023-09-13T02:13:28.942220+0000","last_clean":"2023-09-13T02:13:28.942220+0000","last_became_active":"2023-09-13T02:12:24.586072+0000","last_became_peered":"2023-09-13T02:12:24.586072+0000","last_unstale":"2023-09-13T02:13:28.942220+0000","last_undegraded":"2023-09-13T02:13:28.942220+0000","last_fullsized":"2023-09-13T02:13:28.942220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:50.824236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:04.905358+0000","last_change":"2023-09-13T02:12:23.578914+0000","last_active":"2023-09-13T02:13:04.905358+0000","last_peered":"2023-09-13T02:13:04.905358+0000","last_clean":"2023-09-13T02:13:04.905358+0000","last_became_active":"2023-09-13T02:12:23.578649+0000","last_became_peered":"2023-09-13T02:12:23.578649+0000","last_unstale":"2023-09-13T02:13:04.905358+0000","last_undegraded":"2023-09-13T02:13:04.905358+0000","last_fullsized":"2023-09-13T02:13:04.905358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'43","reported_seq":53,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.996009+0000","last_change":"2023-09-13T02:13:05.914293+0000","last_active":"2023-09-13T02:13:29.996009+0000","last_peered":"2023-09-13T02:13:29.996009+0000","last_clean":"2023-09-13T02:13:29.996009+0000","last_became_active":"2023-09-13T02:13:05.914007+0000","last_became_peered":"2023-09-13T02:13:05.914007+0000","last_unstale":"2023-09-13T02:13:29.996009+0000","last_undegraded":"2023-09-13T02:13:29.996009+0000","last_fullsized":"2023-09-13T02:13:29.996009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:25:19.651146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.909740+0000","last_change":"2023-09-13T02:12:23.578387+0000","last_active":"2023-09-13T02:13:05.909740+0000","last_peered":"2023-09-13T02:13:05.909740+0000","last_clean":"2023-09-13T02:13:05.909740+0000","last_became_active":"2023-09-13T02:12:23.578121+0000","last_became_peered":"2023-09-13T02:12:23.578121+0000","last_unstale":"2023-09-13T02:13:05.909740+0000","last_undegraded":"2023-09-13T02:13:05.909740+0000","last_fullsized":"2023-09-13T02:13:05.909740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:32.660244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'42","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.999250+0000","last_change":"2023-09-13T02:12:24.587304+0000","last_active":"2023-09-13T02:13:29.999250+0000","last_peered":"2023-09-13T02:13:29.999250+0000","last_clean":"2023-09-13T02:13:29.999250+0000","last_became_active":"2023-09-13T02:12:24.587040+0000","last_became_peered":"2023-09-13T02:12:24.587040+0000","last_unstale":"2023-09-13T02:13:29.999250+0000","last_undegraded":"2023-09-13T02:13:29.999250+0000","last_fullsized":"2023-09-13T02:13:29.999250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:18.256464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:17.899674+0000","last_change":"2023-09-13T02:12:23.578623+0000","last_active":"2023-09-13T02:13:17.899674+0000","last_peered":"2023-09-13T02:13:17.899674+0000","last_clean":"2023-09-13T02:13:17.899674+0000","last_became_active":"2023-09-13T02:12:23.578258+0000","last_became_peered":"2023-09-13T02:12:23.578258+0000","last_unstale":"2023-09-13T02:13:17.899674+0000","last_undegraded":"2023-09-13T02:13:17.899674+0000","last_fullsized":"2023-09-13T02:13:17.899674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:18:54.951761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'29","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.992882+0000","last_change":"2023-09-13T02:12:24.590763+0000","last_active":"2023-09-13T02:13:29.992882+0000","last_peered":"2023-09-13T02:13:29.992882+0000","last_clean":"2023-09-13T02:13:29.992882+0000","last_became_active":"2023-09-13T02:12:24.590494+0000","last_became_peered":"2023-09-13T02:12:24.590494+0000","last_unstale":"2023-09-13T02:13:29.992882+0000","last_undegraded":"2023-09-13T02:13:29.992882+0000","last_fullsized":"2023-09-13T02:13:29.992882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:59:39.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'70","reported_seq":83,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.003324+0000","last_change":"2023-09-13T02:12:24.597290+0000","last_active":"2023-09-13T02:13:30.003324+0000","last_peered":"2023-09-13T02:13:30.003324+0000","last_clean":"2023-09-13T02:13:30.003324+0000","last_became_active":"2023-09-13T02:12:24.597024+0000","last_became_peered":"2023-09-13T02:12:24.597024+0000","last_unstale":"2023-09-13T02:13:30.003324+0000","last_undegraded":"2023-09-13T02:13:30.003324+0000","last_fullsized":"2023-09-13T02:13:30.003324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:15.126313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.364323+0000","last_change":"2023-09-13T02:12:23.584941+0000","last_active":"2023-09-13T02:13:05.364323+0000","last_peered":"2023-09-13T02:13:05.364323+0000","last_clean":"2023-09-13T02:13:05.364323+0000","last_became_active":"2023-09-13T02:12:23.584671+0000","last_became_peered":"2023-09-13T02:12:23.584671+0000","last_unstale":"2023-09-13T02:13:05.364323+0000","last_undegraded":"2023-09-13T02:13:05.364323+0000","last_fullsized":"2023-09-13T02:13:05.364323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:38.089400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'41","reported_seq":54,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.002278+0000","last_change":"2023-09-13T02:12:24.596615+0000","last_active":"2023-09-13T02:13:30.002278+0000","last_peered":"2023-09-13T02:13:30.002278+0000","last_clean":"2023-09-13T02:13:30.002278+0000","last_became_active":"2023-09-13T02:12:24.595918+0000","last_became_peered":"2023-09-13T02:12:24.595918+0000","last_unstale":"2023-09-13T02:13:30.002278+0000","last_undegraded":"2023-09-13T02:13:30.002278+0000","last_fullsized":"2023-09-13T02:13:30.002278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:18:08.378805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364450+0000","last_change":"2023-09-13T02:12:23.579507+0000","last_active":"2023-09-13T02:13:06.364450+0000","last_peered":"2023-09-13T02:13:06.364450+0000","last_clean":"2023-09-13T02:13:06.364450+0000","last_became_active":"2023-09-13T02:12:23.579239+0000","last_became_peered":"2023-09-13T02:12:23.579239+0000","last_unstale":"2023-09-13T02:13:06.364450+0000","last_undegraded":"2023-09-13T02:13:06.364450+0000","last_fullsized":"2023-09-13T02:13:06.364450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:11.224076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'35","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:30.006504+0000","last_change":"2023-09-13T02:12:24.589292+0000","last_active":"2023-09-13T02:13:30.006504+0000","last_peered":"2023-09-13T02:13:30.006504+0000","last_clean":"2023-09-13T02:13:30.006504+0000","last_became_active":"2023-09-13T02:12:24.589039+0000","last_became_peered":"2023-09-13T02:12:24.589039+0000","last_unstale":"2023-09-13T02:13:30.006504+0000","last_undegraded":"2023-09-13T02:13:30.006504+0000","last_fullsized":"2023-09-13T02:13:30.006504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:08:04.254265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:05.914584+0000","last_change":"2023-09-13T02:12:23.584177+0000","last_active":"2023-09-13T02:13:05.914584+0000","last_peered":"2023-09-13T02:13:05.914584+0000","last_clean":"2023-09-13T02:13:05.914584+0000","last_became_active":"2023-09-13T02:12:23.583920+0000","last_became_peered":"2023-09-13T02:12:23.583920+0000","last_unstale":"2023-09-13T02:13:05.914584+0000","last_undegraded":"2023-09-13T02:13:05.914584+0000","last_fullsized":"2023-09-13T02:13:05.914584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T05:21:49.468231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'26","reported_seq":39,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:29.997761+0000","last_change":"2023-09-13T02:12:24.588205+0000","last_active":"2023-09-13T02:13:29.997761+0000","last_peered":"2023-09-13T02:13:29.997761+0000","last_clean":"2023-09-13T02:13:29.997761+0000","last_became_active":"2023-09-13T02:12:24.587697+0000","last_became_peered":"2023-09-13T02:12:24.587697+0000","last_unstale":"2023-09-13T02:13:29.997761+0000","last_undegraded":"2023-09-13T02:13:29.997761+0000","last_fullsized":"2023-09-13T02:13:29.997761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:47:39.093277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-13T02:13:06.364646+0000","last_change":"2023-09-13T02:12:23.583748+0000","last_active":"2023-09-13T02:13:06.364646+0000","last_peered":"2023-09-13T02:13:06.364646+0000","last_clean":"2023-09-13T02:13:06.364646+0000","last_became_active":"2023-09-13T02:12:23.583443+0000","last_became_peered":"2023-09-13T02:12:23.583443+0000","last_unstale":"2023-09-13T02:13:06.364646+0000","last_undegraded":"2023-09-13T02:13:06.364646+0000","last_fullsized":"2023-09-13T02:13:06.364646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:14:14.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":12,"num_objects":5,"num_object_clones":3,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":24,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2585,"ondisk_log_size":2585,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":544522,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":213,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1155072,"data_stored":1089044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":831488,"data_stored":674158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.48599999999999999}]},{"osd":1,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.52300000000000002}]},{"osd":2,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.503},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.42599999999999999}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.54800000000000004}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.58299999999999996}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.46300000000000002}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.61399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":778240,"data_stored":621147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.502}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.443},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.55100000000000005}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.65400000000000003}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.63}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.57499999999999996}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.71799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":83302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.50900000000000001}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.443},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.40500000000000003}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.499},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.56999999999999995}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.39400000000000002}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.41799999999999998}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.36799999999999999}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.48599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":83334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.52300000000000002}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.64100000000000001}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.76300000000000001}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.66400000000000003}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.504}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.60099999999999998}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":786432,"data_stored":626928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.32000000000000001}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.34100000000000003}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.377}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.499},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.53600000000000003}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.55200000000000005}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.436},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.48699999999999999}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.46500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":88985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.41899999999999998}]},{"osd":1,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.38600000000000001}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.32900000000000001}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.498}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.54200000000000004}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.55900000000000005}]},{"osd":7,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.63},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":83364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.31},{"interface":"front","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.32100000000000001}]},{"osd":2,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.33500000000000002}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.36599999999999999}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.61599999999999999}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.626},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.82499999999999996}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.71699999999999997}]},{"osd":7,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.70599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":839680,"data_stored":673199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.33100000000000002}]},{"osd":2,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.377},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.41499999999999998}]},{"osd":3,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.35299999999999998}]},{"osd":4,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.73799999999999999}]},{"osd":5,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72699999999999998}]},{"osd":6,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.54900000000000004}]},{"osd":7,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.748},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":5781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":543724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":537943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T02:13:36.378 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.379 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.379 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.380 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.380 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.380 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.381 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.381 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.381 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.382 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.382 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.383 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.383 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.383 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.384 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.384 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.385 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.385 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.385 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.386 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.386 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.386 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.387 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.387 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.388 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.388 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.388 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.389 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.389 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.389 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.390 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.390 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.390 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.391 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.391 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.392 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.392 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.392 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.393 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.393 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.393 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.394 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.394 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.395 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.395 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.395 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.396 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.396 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.396 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.397 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.397 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.397 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.398 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.398 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.399 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.399 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.399 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.400 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.400 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.400 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.401 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.401 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.402 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.402 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.402 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-13T02:12:12.209844+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=12, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.403 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.403 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.403 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.404 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.404 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.404 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.405 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.405 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.406 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.406 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.406 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.407 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.407 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.407 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.408 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.408 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.408 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.409 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.409 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.410 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.410 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.410 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.411 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.411 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.411 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.412 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.412 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.413 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.413 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.413 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.414 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.414 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:36.414 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-13T02:13:54.168 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:13:54.171 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:13:56.416 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T02:13:56.530 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.528+0000 7fdec3608640 1 -- 172.21.15.104:0/51787367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdebc143dc0 msgr2=0x7fdebc144250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:56.530 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.528+0000 7fdec3608640 1 --2- 172.21.15.104:0/51787367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdebc143dc0 0x7fdebc144250 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0afd10 tx=0x7fdeb402d0c0 comp rx=0 tx=0).stop 2023-09-13T02:13:56.531 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.528+0000 7fdec3608640 1 -- 172.21.15.104:0/51787367 shutdown_connections 2023-09-13T02:13:56.531 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.528+0000 7fdec3608640 1 --2- 172.21.15.104:0/51787367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdebc143dc0 0x7fdebc144250 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:56.531 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.528+0000 7fdec3608640 1 --2- 172.21.15.104:0/51787367 >> v2:172.21.15.119:3300/0 conn(0x7fdebc13a500 0x7fdebc13a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:56.531 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.528+0000 7fdec3608640 1 -- 172.21.15.104:0/51787367 >> 172.21.15.104:0/51787367 conn(0x7fdebc0b56f0 msgr2=0x7fdebc0b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:56.532 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.528+0000 7fdec3608640 1 -- 172.21.15.104:0/51787367 shutdown_connections 2023-09-13T02:13:56.532 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.528+0000 7fdec3608640 1 -- 172.21.15.104:0/51787367 wait complete. 2023-09-13T02:13:56.535 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.529+0000 7fdec3608640 1 Processor -- start 2023-09-13T02:13:56.535 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.529+0000 7fdec3608640 1 -- start start 2023-09-13T02:13:56.535 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec3608640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdebc0b0ae0 0x7fdebc1dd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:56.536 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec3608640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdebc13a500 0x7fdebc0ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:56.536 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec3608640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdebc143dc0 0x7fdebc1420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:56.536 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec3608640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc142620 con 0x7fdebc143dc0 2023-09-13T02:13:56.536 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec3608640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc1de0a0 con 0x7fdebc0b0ae0 2023-09-13T02:13:56.537 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec3608640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc0aa920 con 0x7fdebc13a500 2023-09-13T02:13:56.537 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec1ba5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdebc143dc0 0x7fdebc1420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:56.537 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec1ba5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdebc143dc0 0x7fdebc1420e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42918/0 (socket says 172.21.15.104:42918) 2023-09-13T02:13:56.537 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec1ba5640 1 -- 172.21.15.104:0/2802032891 learned_addr learned my addr 172.21.15.104:0/2802032891 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:13:56.538 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec1ba5640 1 -- 172.21.15.104:0/2802032891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdebc13a500 msgr2=0x7fdebc0ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:56.538 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec0ba3640 1 --2- 172.21.15.104:0/2802032891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdebc13a500 0x7fdebc0ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:56.538 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec13a4640 1 --2- 172.21.15.104:0/2802032891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdebc0b0ae0 0x7fdebc1dd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:56.539 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec1ba5640 1 --2- 172.21.15.104:0/2802032891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdebc13a500 0x7fdebc0ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:56.539 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec1ba5640 1 -- 172.21.15.104:0/2802032891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdebc0b0ae0 msgr2=0x7fdebc1dd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:56.539 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec1ba5640 1 --2- 172.21.15.104:0/2802032891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdebc0b0ae0 0x7fdebc1dd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:56.539 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec1ba5640 1 -- 172.21.15.104:0/2802032891 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb400aa10 con 0x7fdebc143dc0 2023-09-13T02:13:56.540 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec0ba3640 1 --2- 172.21.15.104:0/2802032891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdebc13a500 0x7fdebc0ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:13:56.540 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec13a4640 1 --2- 172.21.15.104:0/2802032891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdebc0b0ae0 0x7fdebc1dd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:13:56.540 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdec1ba5640 1 --2- 172.21.15.104:0/2802032891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdebc143dc0 0x7fdebc1420e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400ae70 tx=0x7fdeb40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:56.541 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.530+0000 7fdeadffb640 1 -- 172.21.15.104:0/2802032891 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb40357b0 con 0x7fdebc143dc0 2023-09-13T02:13:56.541 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.531+0000 7fdeadffb640 1 -- 172.21.15.104:0/2802032891 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdeb4035a00 con 0x7fdebc143dc0 2023-09-13T02:13:56.541 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.531+0000 7fdec3608640 1 -- 172.21.15.104:0/2802032891 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdebc0aabc0 con 0x7fdebc143dc0 2023-09-13T02:13:56.541 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.531+0000 7fdeadffb640 1 -- 172.21.15.104:0/2802032891 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4035dd0 con 0x7fdebc143dc0 2023-09-13T02:13:56.542 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.531+0000 7fdec3608640 1 -- 172.21.15.104:0/2802032891 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdebc070160 con 0x7fdebc143dc0 2023-09-13T02:13:56.542 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.532+0000 7fdec3608640 1 -- 172.21.15.104:0/2802032891 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdebc0aae00 con 0x7fdebc143dc0 2023-09-13T02:13:56.542 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.532+0000 7fdeadffb640 1 -- 172.21.15.104:0/2802032891 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fdeb403c070 con 0x7fdebc143dc0 2023-09-13T02:13:56.543 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.533+0000 7fdeadffb640 1 --2- 172.21.15.104:0/2802032891 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdea006a4f0 0x7fdea006c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:13:56.543 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.533+0000 7fdeadffb640 1 -- 172.21.15.104:0/2802032891 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fdeb40ab8d0 con 0x7fdebc143dc0 2023-09-13T02:13:56.543 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.533+0000 7fdec13a4640 1 --2- 172.21.15.104:0/2802032891 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdea006a4f0 0x7fdea006c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:13:56.543 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.533+0000 7fdec13a4640 1 --2- 172.21.15.104:0/2802032891 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdea006a4f0 0x7fdea006c9b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0b5650 tx=0x7fdeb0009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:13:56.544 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.537+0000 7fdeadffb640 1 -- 172.21.15.104:0/2802032891 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdebc0aae00 con 0x7fdebc143dc0 2023-09-13T02:13:56.702 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.701+0000 7fdec3608640 1 -- 172.21.15.104:0/2802032891 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdebc0aae00 con 0x7fdea006a4f0 2023-09-13T02:13:56.709 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.708+0000 7fdeadffb640 1 -- 172.21.15.104:0/2802032891 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288969 (secure 0 0 0) 0x7fdebc0aae00 con 0x7fdea006a4f0 2023-09-13T02:13:56.712 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:13:56.714 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2023-09-13T02:13:56.715 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.711+0000 7fdec3608640 1 -- 172.21.15.104:0/2802032891 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdea006a4f0 msgr2=0x7fdea006c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:56.716 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.711+0000 7fdec3608640 1 --2- 172.21.15.104:0/2802032891 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdea006a4f0 0x7fdea006c9b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0b5650 tx=0x7fdeb0009040 comp rx=0 tx=0).stop 2023-09-13T02:13:56.716 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.711+0000 7fdec3608640 1 -- 172.21.15.104:0/2802032891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdebc143dc0 msgr2=0x7fdebc1420e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:13:56.716 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.711+0000 7fdec3608640 1 --2- 172.21.15.104:0/2802032891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdebc143dc0 0x7fdebc1420e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400ae70 tx=0x7fdeb40045e0 comp rx=0 tx=0).stop 2023-09-13T02:13:56.716 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.711+0000 7fdec3608640 1 -- 172.21.15.104:0/2802032891 shutdown_connections 2023-09-13T02:13:56.717 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.711+0000 7fdec3608640 1 --2- 172.21.15.104:0/2802032891 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fdea006a4f0 0x7fdea006c9b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:56.717 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.711+0000 7fdec3608640 1 --2- 172.21.15.104:0/2802032891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdebc143dc0 0x7fdebc1420e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:56.717 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.711+0000 7fdec3608640 1 --2- 172.21.15.104:0/2802032891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdebc13a500 0x7fdebc0ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:56.718 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.711+0000 7fdec3608640 1 --2- 172.21.15.104:0/2802032891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdebc0b0ae0 0x7fdebc1dd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:13:56.718 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.711+0000 7fdec3608640 1 -- 172.21.15.104:0/2802032891 >> 172.21.15.104:0/2802032891 conn(0x7fdebc0b56f0 msgr2=0x7fdebc0b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:13:56.718 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.711+0000 7fdec3608640 1 -- 172.21.15.104:0/2802032891 shutdown_connections 2023-09-13T02:13:56.718 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:13:56.711+0000 7fdec3608640 1 -- 172.21.15.104:0/2802032891 wait complete. 2023-09-13T02:13:56.723 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-09-13T02:13:56.050545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1140753,"num_objects":30,"num_object_clones":3,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":2,"num_read":129,"num_read_kb":116,"num_write":435,"num_write_kb":3094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2945,"ondisk_log_size":2945,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220428,"kb_used_data":4300,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754292,"statfs":{"total":773094113280,"available":772868395008,"internally_reserved":0,"allocated":4403200,"data_stored":3048623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003028"},"pg_stats":[{"pgid":"3.3f","version":"22'38","reported_seq":72,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.035348+0000","last_change":"2023-09-13T02:13:33.085104+0000","last_active":"2023-09-13T02:13:44.035348+0000","last_peered":"2023-09-13T02:13:44.035348+0000","last_clean":"2023-09-13T02:13:44.035348+0000","last_became_active":"2023-09-13T02:12:24.592754+0000","last_became_peered":"2023-09-13T02:12:24.592754+0000","last_unstale":"2023-09-13T02:13:44.035348+0000","last_undegraded":"2023-09-13T02:13:44.035348+0000","last_fullsized":"2023-09-13T02:13:44.035348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013309302,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'23","reported_seq":57,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.864254+0000","last_change":"2023-09-13T02:13:32.968430+0000","last_active":"2023-09-13T02:13:43.864254+0000","last_peered":"2023-09-13T02:13:43.864254+0000","last_clean":"2023-09-13T02:13:43.864254+0000","last_became_active":"2023-09-13T02:12:24.579873+0000","last_became_peered":"2023-09-13T02:12:24.579873+0000","last_unstale":"2023-09-13T02:13:43.864254+0000","last_undegraded":"2023-09-13T02:13:43.864254+0000","last_fullsized":"2023-09-13T02:13:43.864254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039927269999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'35","reported_seq":69,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.126259+0000","last_change":"2023-09-13T02:13:33.078368+0000","last_active":"2023-09-13T02:13:44.126259+0000","last_peered":"2023-09-13T02:13:44.126259+0000","last_clean":"2023-09-13T02:13:44.126259+0000","last_became_active":"2023-09-13T02:12:24.584249+0000","last_became_peered":"2023-09-13T02:12:24.584249+0000","last_unstale":"2023-09-13T02:13:44.126259+0000","last_undegraded":"2023-09-13T02:13:44.126259+0000","last_fullsized":"2023-09-13T02:13:44.126259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065359670000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'37","reported_seq":71,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.243537+0000","last_change":"2023-09-13T02:13:33.083495+0000","last_active":"2023-09-13T02:13:44.243537+0000","last_peered":"2023-09-13T02:13:44.243537+0000","last_clean":"2023-09-13T02:13:44.243537+0000","last_became_active":"2023-09-13T02:12:24.595817+0000","last_became_peered":"2023-09-13T02:12:24.595817+0000","last_unstale":"2023-09-13T02:13:44.243537+0000","last_undegraded":"2023-09-13T02:13:44.243537+0000","last_fullsized":"2023-09-13T02:13:44.243537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010630479,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'25","reported_seq":67,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.034575+0000","last_change":"2023-09-13T02:13:36.092892+0000","last_active":"2023-09-13T02:13:44.034575+0000","last_peered":"2023-09-13T02:13:44.034575+0000","last_clean":"2023-09-13T02:13:44.034575+0000","last_became_active":"2023-09-13T02:12:24.591503+0000","last_became_peered":"2023-09-13T02:12:24.591503+0000","last_unstale":"2023-09-13T02:13:44.034575+0000","last_undegraded":"2023-09-13T02:13:44.034575+0000","last_fullsized":"2023-09-13T02:13:44.034575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'25","last_scrub_stamp":"2023-09-13T02:13:36.092761+0000","last_deep_scrub":"22'25","last_deep_scrub_stamp":"2023-09-13T02:13:36.092761+0000","last_clean_scrub_stamp":"2023-09-13T02:13:36.092761+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:40:10.458930+0000","scrub_duration":0.001560248,"objects_trimmed":0,"snaptrim_duration":0.013411609999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'30","reported_seq":61,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.862948+0000","last_change":"2023-09-13T02:13:33.071573+0000","last_active":"2023-09-13T02:13:43.862948+0000","last_peered":"2023-09-13T02:13:43.862948+0000","last_clean":"2023-09-13T02:13:43.862948+0000","last_became_active":"2023-09-13T02:13:06.365133+0000","last_became_peered":"2023-09-13T02:13:06.365133+0000","last_unstale":"2023-09-13T02:13:43.862948+0000","last_undegraded":"2023-09-13T02:13:43.862948+0000","last_fullsized":"2023-09-13T02:13:43.862948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014597519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"22'26","reported_seq":60,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.034341+0000","last_change":"2023-09-13T02:13:33.084472+0000","last_active":"2023-09-13T02:13:44.034341+0000","last_peered":"2023-09-13T02:13:44.034341+0000","last_clean":"2023-09-13T02:13:44.034341+0000","last_became_active":"2023-09-13T02:12:24.590654+0000","last_became_peered":"2023-09-13T02:12:24.590654+0000","last_unstale":"2023-09-13T02:13:44.034341+0000","last_undegraded":"2023-09-13T02:13:44.034341+0000","last_fullsized":"2023-09-13T02:13:44.034341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013463309,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'37","reported_seq":71,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.539299+0000","last_change":"2023-09-13T02:13:32.969433+0000","last_active":"2023-09-13T02:13:44.539299+0000","last_peered":"2023-09-13T02:13:44.539299+0000","last_clean":"2023-09-13T02:13:44.539299+0000","last_became_active":"2023-09-13T02:12:24.588438+0000","last_became_peered":"2023-09-13T02:12:24.588438+0000","last_unstale":"2023-09-13T02:13:44.539299+0000","last_undegraded":"2023-09-13T02:13:44.539299+0000","last_fullsized":"2023-09-13T02:13:44.539299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00578898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'51","reported_seq":85,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.035320+0000","last_change":"2023-09-13T02:13:33.085446+0000","last_active":"2023-09-13T02:13:44.035320+0000","last_peered":"2023-09-13T02:13:44.035320+0000","last_clean":"2023-09-13T02:13:44.035320+0000","last_became_active":"2023-09-13T02:12:24.589606+0000","last_became_peered":"2023-09-13T02:12:24.589606+0000","last_unstale":"2023-09-13T02:13:44.035320+0000","last_undegraded":"2023-09-13T02:13:44.035320+0000","last_fullsized":"2023-09-13T02:13:44.035320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013475894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'75","reported_seq":109,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.533873+0000","last_change":"2023-09-13T02:13:33.080079+0000","last_active":"2023-09-13T02:13:44.533873+0000","last_peered":"2023-09-13T02:13:44.533873+0000","last_clean":"2023-09-13T02:13:44.533873+0000","last_became_active":"2023-09-13T02:12:24.588522+0000","last_became_peered":"2023-09-13T02:12:24.588522+0000","last_unstale":"2023-09-13T02:13:44.533873+0000","last_undegraded":"2023-09-13T02:13:44.533873+0000","last_fullsized":"2023-09-13T02:13:44.533873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069747890000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'33","reported_seq":67,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.533669+0000","last_change":"2023-09-13T02:13:33.077784+0000","last_active":"2023-09-13T02:13:44.533669+0000","last_peered":"2023-09-13T02:13:44.533669+0000","last_clean":"2023-09-13T02:13:44.533669+0000","last_became_active":"2023-09-13T02:12:24.588891+0000","last_became_peered":"2023-09-13T02:12:24.588891+0000","last_unstale":"2023-09-13T02:13:44.533669+0000","last_undegraded":"2023-09-13T02:13:44.533669+0000","last_fullsized":"2023-09-13T02:13:44.533669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069801409999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'36","reported_seq":78,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:50.510598+0000","last_change":"2023-09-13T02:13:50.510664+0000","last_active":"2023-09-13T02:13:50.510598+0000","last_peered":"2023-09-13T02:13:50.510598+0000","last_clean":"2023-09-13T02:13:50.510598+0000","last_became_active":"2023-09-13T02:12:24.587023+0000","last_became_peered":"2023-09-13T02:12:24.587023+0000","last_unstale":"2023-09-13T02:13:50.510598+0000","last_undegraded":"2023-09-13T02:13:50.510598+0000","last_fullsized":"2023-09-13T02:13:50.510598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'36","last_scrub_stamp":"2023-09-13T02:13:50.510498+0000","last_deep_scrub":"22'36","last_deep_scrub_stamp":"2023-09-13T02:13:50.510498+0000","last_clean_scrub_stamp":"2023-09-13T02:13:50.510498+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:15:32.718542+0000","scrub_duration":0.0014528880000000001,"objects_trimmed":0,"snaptrim_duration":0.002856936,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'49","reported_seq":83,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.539834+0000","last_change":"2023-09-13T02:13:32.969927+0000","last_active":"2023-09-13T02:13:44.539834+0000","last_peered":"2023-09-13T02:13:44.539834+0000","last_clean":"2023-09-13T02:13:44.539834+0000","last_became_active":"2023-09-13T02:12:24.587730+0000","last_became_peered":"2023-09-13T02:12:24.587730+0000","last_unstale":"2023-09-13T02:13:44.539834+0000","last_undegraded":"2023-09-13T02:13:44.539834+0000","last_fullsized":"2023-09-13T02:13:44.539834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057195980000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'41","reported_seq":83,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:49.389442+0000","last_change":"2023-09-13T02:13:49.389523+0000","last_active":"2023-09-13T02:13:49.389442+0000","last_peered":"2023-09-13T02:13:49.389442+0000","last_clean":"2023-09-13T02:13:49.389442+0000","last_became_active":"2023-09-13T02:12:24.584734+0000","last_became_peered":"2023-09-13T02:12:24.584734+0000","last_unstale":"2023-09-13T02:13:49.389442+0000","last_undegraded":"2023-09-13T02:13:49.389442+0000","last_fullsized":"2023-09-13T02:13:49.389442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'41","last_scrub_stamp":"2023-09-13T02:13:49.389330+0000","last_deep_scrub":"22'41","last_deep_scrub_stamp":"2023-09-13T02:13:49.389330+0000","last_clean_scrub_stamp":"2023-09-13T02:13:49.389330+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:13:42.099948+0000","scrub_duration":0.00133534,"objects_trimmed":0,"snaptrim_duration":0.006295564,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'39","reported_seq":73,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.863795+0000","last_change":"2023-09-13T02:13:32.967980+0000","last_active":"2023-09-13T02:13:43.863795+0000","last_peered":"2023-09-13T02:13:43.863795+0000","last_clean":"2023-09-13T02:13:43.863795+0000","last_became_active":"2023-09-13T02:12:24.578553+0000","last_became_peered":"2023-09-13T02:12:24.578553+0000","last_unstale":"2023-09-13T02:13:43.863795+0000","last_undegraded":"2023-09-13T02:13:43.863795+0000","last_fullsized":"2023-09-13T02:13:43.863795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041892860000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'48","reported_seq":82,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.243273+0000","last_change":"2023-09-13T02:13:33.080487+0000","last_active":"2023-09-13T02:13:44.243273+0000","last_peered":"2023-09-13T02:13:44.243273+0000","last_clean":"2023-09-13T02:13:44.243273+0000","last_became_active":"2023-09-13T02:12:24.590871+0000","last_became_peered":"2023-09-13T02:12:24.590871+0000","last_unstale":"2023-09-13T02:13:44.243273+0000","last_undegraded":"2023-09-13T02:13:44.243273+0000","last_fullsized":"2023-09-13T02:13:44.243273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089611650000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'41","reported_seq":75,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.243803+0000","last_change":"2023-09-13T02:13:33.083752+0000","last_active":"2023-09-13T02:13:44.243803+0000","last_peered":"2023-09-13T02:13:44.243803+0000","last_clean":"2023-09-13T02:13:44.243803+0000","last_became_active":"2023-09-13T02:12:24.592325+0000","last_became_peered":"2023-09-13T02:12:24.592325+0000","last_unstale":"2023-09-13T02:13:44.243803+0000","last_undegraded":"2023-09-13T02:13:44.243803+0000","last_fullsized":"2023-09-13T02:13:44.243803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010777484,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'57","reported_seq":91,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.863319+0000","last_change":"2023-09-13T02:13:33.073622+0000","last_active":"2023-09-13T02:13:43.863319+0000","last_peered":"2023-09-13T02:13:43.863319+0000","last_clean":"2023-09-13T02:13:43.863319+0000","last_became_active":"2023-09-13T02:12:24.587552+0000","last_became_peered":"2023-09-13T02:12:24.587552+0000","last_unstale":"2023-09-13T02:13:43.863319+0000","last_undegraded":"2023-09-13T02:13:43.863319+0000","last_fullsized":"2023-09-13T02:13:43.863319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001551586,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'39","reported_seq":73,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.035041+0000","last_change":"2023-09-13T02:13:33.085083+0000","last_active":"2023-09-13T02:13:44.035041+0000","last_peered":"2023-09-13T02:13:44.035041+0000","last_clean":"2023-09-13T02:13:44.035041+0000","last_became_active":"2023-09-13T02:12:24.590670+0000","last_became_peered":"2023-09-13T02:12:24.590670+0000","last_unstale":"2023-09-13T02:13:44.035041+0000","last_undegraded":"2023-09-13T02:13:44.035041+0000","last_fullsized":"2023-09-13T02:13:44.035041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013177124,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'41","reported_seq":75,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.533739+0000","last_change":"2023-09-13T02:13:33.079555+0000","last_active":"2023-09-13T02:13:44.533739+0000","last_peered":"2023-09-13T02:13:44.533739+0000","last_clean":"2023-09-13T02:13:44.533739+0000","last_became_active":"2023-09-13T02:12:24.591065+0000","last_became_peered":"2023-09-13T02:12:24.591065+0000","last_unstale":"2023-09-13T02:13:44.533739+0000","last_undegraded":"2023-09-13T02:13:44.533739+0000","last_fullsized":"2023-09-13T02:13:44.533739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0072721169999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'56","reported_seq":90,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.126091+0000","last_change":"2023-09-13T02:13:33.077805+0000","last_active":"2023-09-13T02:13:44.126091+0000","last_peered":"2023-09-13T02:13:44.126091+0000","last_clean":"2023-09-13T02:13:44.126091+0000","last_became_active":"2023-09-13T02:12:24.586981+0000","last_became_peered":"2023-09-13T02:12:24.586981+0000","last_unstale":"2023-09-13T02:13:44.126091+0000","last_undegraded":"2023-09-13T02:13:44.126091+0000","last_fullsized":"2023-09-13T02:13:44.126091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0064443770000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'48","reported_seq":82,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.243330+0000","last_change":"2023-09-13T02:13:33.081324+0000","last_active":"2023-09-13T02:13:44.243330+0000","last_peered":"2023-09-13T02:13:44.243330+0000","last_clean":"2023-09-13T02:13:44.243330+0000","last_became_active":"2023-09-13T02:12:24.594351+0000","last_became_peered":"2023-09-13T02:12:24.594351+0000","last_unstale":"2023-09-13T02:13:44.243330+0000","last_undegraded":"2023-09-13T02:13:44.243330+0000","last_fullsized":"2023-09-13T02:13:44.243330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010224219999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'43","reported_seq":77,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.539372+0000","last_change":"2023-09-13T02:13:32.969380+0000","last_active":"2023-09-13T02:13:44.539372+0000","last_peered":"2023-09-13T02:13:44.539372+0000","last_clean":"2023-09-13T02:13:44.539372+0000","last_became_active":"2023-09-13T02:12:24.590295+0000","last_became_peered":"2023-09-13T02:12:24.590295+0000","last_unstale":"2023-09-13T02:13:44.539372+0000","last_undegraded":"2023-09-13T02:13:44.539372+0000","last_fullsized":"2023-09-13T02:13:44.539372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059803399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'37","reported_seq":71,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.243339+0000","last_change":"2023-09-13T02:13:33.082519+0000","last_active":"2023-09-13T02:13:44.243339+0000","last_peered":"2023-09-13T02:13:44.243339+0000","last_clean":"2023-09-13T02:13:44.243339+0000","last_became_active":"2023-09-13T02:12:24.593673+0000","last_became_peered":"2023-09-13T02:12:24.593673+0000","last_unstale":"2023-09-13T02:13:44.243339+0000","last_undegraded":"2023-09-13T02:13:44.243339+0000","last_fullsized":"2023-09-13T02:13:44.243339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010617236,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'16","reported_seq":50,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.540147+0000","last_change":"2023-09-13T02:13:32.969563+0000","last_active":"2023-09-13T02:13:44.540147+0000","last_peered":"2023-09-13T02:13:44.540147+0000","last_clean":"2023-09-13T02:13:44.540147+0000","last_became_active":"2023-09-13T02:12:24.590231+0000","last_became_peered":"2023-09-13T02:12:24.590231+0000","last_unstale":"2023-09-13T02:13:44.540147+0000","last_undegraded":"2023-09-13T02:13:44.540147+0000","last_fullsized":"2023-09-13T02:13:44.540147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055340570000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'68","reported_seq":109,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.534004+0000","last_change":"2023-09-13T02:13:33.079840+0000","last_active":"2023-09-13T02:13:44.534004+0000","last_peered":"2023-09-13T02:13:44.534004+0000","last_clean":"2023-09-13T02:13:44.534004+0000","last_became_active":"2023-09-13T02:13:05.916435+0000","last_became_peered":"2023-09-13T02:13:05.916435+0000","last_unstale":"2023-09-13T02:13:44.534004+0000","last_undegraded":"2023-09-13T02:13:44.534004+0000","last_fullsized":"2023-09-13T02:13:44.534004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065577700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'34","reported_seq":68,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.864655+0000","last_change":"2023-09-13T02:13:32.967761+0000","last_active":"2023-09-13T02:13:43.864655+0000","last_peered":"2023-09-13T02:13:43.864655+0000","last_clean":"2023-09-13T02:13:43.864655+0000","last_became_active":"2023-09-13T02:12:24.583782+0000","last_became_peered":"2023-09-13T02:12:24.583782+0000","last_unstale":"2023-09-13T02:13:43.864655+0000","last_undegraded":"2023-09-13T02:13:43.864655+0000","last_fullsized":"2023-09-13T02:13:43.864655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041099719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'23","reported_seq":57,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.539986+0000","last_change":"2023-09-13T02:13:32.970106+0000","last_active":"2023-09-13T02:13:44.539986+0000","last_peered":"2023-09-13T02:13:44.539986+0000","last_clean":"2023-09-13T02:13:44.539986+0000","last_became_active":"2023-09-13T02:12:24.590189+0000","last_became_peered":"2023-09-13T02:12:24.590189+0000","last_unstale":"2023-09-13T02:13:44.539986+0000","last_undegraded":"2023-09-13T02:13:44.539986+0000","last_fullsized":"2023-09-13T02:13:44.539986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005267819,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'35","reported_seq":69,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.126440+0000","last_change":"2023-09-13T02:13:33.078334+0000","last_active":"2023-09-13T02:13:44.126440+0000","last_peered":"2023-09-13T02:13:44.126440+0000","last_clean":"2023-09-13T02:13:44.126440+0000","last_became_active":"2023-09-13T02:12:24.583453+0000","last_became_peered":"2023-09-13T02:12:24.583453+0000","last_unstale":"2023-09-13T02:13:44.126440+0000","last_undegraded":"2023-09-13T02:13:44.126440+0000","last_fullsized":"2023-09-13T02:13:44.126440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067806159999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'42","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:51.369820+0000","last_change":"2023-09-13T02:13:51.369880+0000","last_active":"2023-09-13T02:13:51.369820+0000","last_peered":"2023-09-13T02:13:51.369820+0000","last_clean":"2023-09-13T02:13:51.369820+0000","last_became_active":"2023-09-13T02:12:24.592875+0000","last_became_peered":"2023-09-13T02:12:24.592875+0000","last_unstale":"2023-09-13T02:13:51.369820+0000","last_undegraded":"2023-09-13T02:13:51.369820+0000","last_fullsized":"2023-09-13T02:13:51.369820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'42","last_scrub_stamp":"2023-09-13T02:13:51.369721+0000","last_deep_scrub":"22'42","last_deep_scrub_stamp":"2023-09-13T02:13:51.369721+0000","last_clean_scrub_stamp":"2023-09-13T02:13:51.369721+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:03:49.390369+0000","scrub_duration":0.0021232569999999999,"objects_trimmed":0,"snaptrim_duration":0.0084478739999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'55","reported_seq":97,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:51.284207+0000","last_change":"2023-09-13T02:13:51.284253+0000","last_active":"2023-09-13T02:13:51.284207+0000","last_peered":"2023-09-13T02:13:51.284207+0000","last_clean":"2023-09-13T02:13:51.284207+0000","last_became_active":"2023-09-13T02:12:24.588173+0000","last_became_peered":"2023-09-13T02:12:24.588173+0000","last_unstale":"2023-09-13T02:13:51.284207+0000","last_undegraded":"2023-09-13T02:13:51.284207+0000","last_fullsized":"2023-09-13T02:13:51.284207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2023-09-13T02:13:51.284112+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2023-09-13T02:13:51.284112+0000","last_clean_scrub_stamp":"2023-09-13T02:13:51.284112+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:27:21.238044+0000","scrub_duration":0.0016218739999999999,"objects_trimmed":0,"snaptrim_duration":0.0018416579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'45","reported_seq":79,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.533375+0000","last_change":"2023-09-13T02:13:33.079217+0000","last_active":"2023-09-13T02:13:44.533375+0000","last_peered":"2023-09-13T02:13:44.533375+0000","last_clean":"2023-09-13T02:13:44.533375+0000","last_became_active":"2023-09-13T02:12:24.590677+0000","last_became_peered":"2023-09-13T02:12:24.590677+0000","last_unstale":"2023-09-13T02:13:44.533375+0000","last_undegraded":"2023-09-13T02:13:44.533375+0000","last_fullsized":"2023-09-13T02:13:44.533375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0077055279999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'40","reported_seq":82,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.863153+0000","last_change":"2023-09-13T02:13:41.540019+0000","last_active":"2023-09-13T02:13:43.863153+0000","last_peered":"2023-09-13T02:13:43.863153+0000","last_clean":"2023-09-13T02:13:43.863153+0000","last_became_active":"2023-09-13T02:12:24.586251+0000","last_became_peered":"2023-09-13T02:12:24.586251+0000","last_unstale":"2023-09-13T02:13:43.863153+0000","last_undegraded":"2023-09-13T02:13:43.863153+0000","last_fullsized":"2023-09-13T02:13:43.863153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'40","last_scrub_stamp":"2023-09-13T02:13:41.539885+0000","last_deep_scrub":"22'40","last_deep_scrub_stamp":"2023-09-13T02:13:41.539885+0000","last_clean_scrub_stamp":"2023-09-13T02:13:41.539885+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:09:20.900257+0000","scrub_duration":0.0017396600000000001,"objects_trimmed":0,"snaptrim_duration":0.0032713870000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'2","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:39.513824+0000","last_change":"2023-09-13T02:13:39.513824+0000","last_active":"2023-09-13T02:13:39.513824+0000","last_peered":"2023-09-13T02:13:39.513824+0000","last_clean":"2023-09-13T02:13:39.513824+0000","last_became_active":"2023-09-13T02:12:23.578889+0000","last_became_peered":"2023-09-13T02:12:23.578889+0000","last_unstale":"2023-09-13T02:13:39.513824+0000","last_undegraded":"2023-09-13T02:13:39.513824+0000","last_fullsized":"2023-09-13T02:13:39.513824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2023-09-13T02:13:39.513697+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2023-09-13T02:13:39.513697+0000","last_clean_scrub_stamp":"2023-09-13T02:13:39.513697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:15:21.721741+0000","scrub_duration":0.0019969480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'41","reported_seq":75,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.126825+0000","last_change":"2023-09-13T02:13:33.078141+0000","last_active":"2023-09-13T02:13:44.126825+0000","last_peered":"2023-09-13T02:13:44.126825+0000","last_clean":"2023-09-13T02:13:44.126825+0000","last_became_active":"2023-09-13T02:12:24.579243+0000","last_became_peered":"2023-09-13T02:12:24.579243+0000","last_unstale":"2023-09-13T02:13:44.126825+0000","last_undegraded":"2023-09-13T02:13:44.126825+0000","last_fullsized":"2023-09-13T02:13:44.126825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0064049659999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:46.487455+0000","last_change":"2023-09-13T02:13:46.487501+0000","last_active":"2023-09-13T02:13:46.487455+0000","last_peered":"2023-09-13T02:13:46.487455+0000","last_clean":"2023-09-13T02:13:46.487455+0000","last_became_active":"2023-09-13T02:12:23.576754+0000","last_became_peered":"2023-09-13T02:12:23.576754+0000","last_unstale":"2023-09-13T02:13:46.487455+0000","last_undegraded":"2023-09-13T02:13:46.487455+0000","last_fullsized":"2023-09-13T02:13:46.487455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2023-09-13T02:13:46.487370+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2023-09-13T02:13:46.487370+0000","last_clean_scrub_stamp":"2023-09-13T02:13:46.487370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:28:26.543492+0000","scrub_duration":0.0014463200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:47.532140+0000","last_change":"2023-09-13T02:13:47.532221+0000","last_active":"2023-09-13T02:13:47.532140+0000","last_peered":"2023-09-13T02:13:47.532140+0000","last_clean":"2023-09-13T02:13:47.532140+0000","last_became_active":"2023-09-13T02:12:23.579351+0000","last_became_peered":"2023-09-13T02:12:23.579351+0000","last_unstale":"2023-09-13T02:13:47.532140+0000","last_undegraded":"2023-09-13T02:13:47.532140+0000","last_fullsized":"2023-09-13T02:13:47.532140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2023-09-13T02:13:47.532036+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2023-09-13T02:13:47.532036+0000","last_clean_scrub_stamp":"2023-09-13T02:13:47.532036+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:13:40.242654+0000","scrub_duration":0.002094168,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'41","reported_seq":75,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.539325+0000","last_change":"2023-09-13T02:13:32.969576+0000","last_active":"2023-09-13T02:13:44.539325+0000","last_peered":"2023-09-13T02:13:44.539325+0000","last_clean":"2023-09-13T02:13:44.539325+0000","last_became_active":"2023-09-13T02:12:24.590126+0000","last_became_peered":"2023-09-13T02:12:24.590126+0000","last_unstale":"2023-09-13T02:13:44.539325+0000","last_undegraded":"2023-09-13T02:13:44.539325+0000","last_fullsized":"2023-09-13T02:13:44.539325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057346009999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:36.231609+0000","last_change":"2023-09-13T02:13:36.231609+0000","last_active":"2023-09-13T02:13:36.231609+0000","last_peered":"2023-09-13T02:13:36.231609+0000","last_clean":"2023-09-13T02:13:36.231609+0000","last_became_active":"2023-09-13T02:12:23.585953+0000","last_became_peered":"2023-09-13T02:12:23.585953+0000","last_unstale":"2023-09-13T02:13:36.231609+0000","last_undegraded":"2023-09-13T02:13:36.231609+0000","last_fullsized":"2023-09-13T02:13:36.231609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:36.231480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:36.231480+0000","last_clean_scrub_stamp":"2023-09-13T02:13:36.231480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:28:16.287602+0000","scrub_duration":0.00143738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'47","reported_seq":81,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.863700+0000","last_change":"2023-09-13T02:13:32.968312+0000","last_active":"2023-09-13T02:13:43.863700+0000","last_peered":"2023-09-13T02:13:43.863700+0000","last_clean":"2023-09-13T02:13:43.863700+0000","last_became_active":"2023-09-13T02:12:24.584901+0000","last_became_peered":"2023-09-13T02:12:24.584901+0000","last_unstale":"2023-09-13T02:13:43.863700+0000","last_undegraded":"2023-09-13T02:13:43.863700+0000","last_fullsized":"2023-09-13T02:13:43.863700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047693290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:35.639117+0000","last_change":"2023-09-13T02:12:23.583663+0000","last_active":"2023-09-13T02:13:35.639117+0000","last_peered":"2023-09-13T02:13:35.639117+0000","last_clean":"2023-09-13T02:13:35.639117+0000","last_became_active":"2023-09-13T02:12:23.583305+0000","last_became_peered":"2023-09-13T02:12:23.583305+0000","last_unstale":"2023-09-13T02:13:35.639117+0000","last_undegraded":"2023-09-13T02:13:35.639117+0000","last_fullsized":"2023-09-13T02:13:35.639117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'47","reported_seq":81,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.243726+0000","last_change":"2023-09-13T02:13:33.082870+0000","last_active":"2023-09-13T02:13:44.243726+0000","last_peered":"2023-09-13T02:13:44.243726+0000","last_clean":"2023-09-13T02:13:44.243726+0000","last_became_active":"2023-09-13T02:12:24.594434+0000","last_became_peered":"2023-09-13T02:12:24.594434+0000","last_unstale":"2023-09-13T02:13:44.243726+0000","last_undegraded":"2023-09-13T02:13:44.243726+0000","last_fullsized":"2023-09-13T02:13:44.243726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010662779000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'1","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:40.327213+0000","last_change":"2023-09-13T02:13:40.327213+0000","last_active":"2023-09-13T02:13:40.327213+0000","last_peered":"2023-09-13T02:13:40.327213+0000","last_clean":"2023-09-13T02:13:40.327213+0000","last_became_active":"2023-09-13T02:12:23.584657+0000","last_became_peered":"2023-09-13T02:12:23.584657+0000","last_unstale":"2023-09-13T02:13:40.327213+0000","last_undegraded":"2023-09-13T02:13:40.327213+0000","last_fullsized":"2023-09-13T02:13:40.327213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-09-13T02:13:40.327064+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-09-13T02:13:40.327064+0000","last_clean_scrub_stamp":"2023-09-13T02:13:40.327064+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:13:33.037682+0000","scrub_duration":0.0014937660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'52","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.126142+0000","last_change":"2023-09-13T02:13:33.077629+0000","last_active":"2023-09-13T02:13:44.126142+0000","last_peered":"2023-09-13T02:13:44.126142+0000","last_clean":"2023-09-13T02:13:44.126142+0000","last_became_active":"2023-09-13T02:12:24.588455+0000","last_became_peered":"2023-09-13T02:12:24.588455+0000","last_unstale":"2023-09-13T02:13:44.126142+0000","last_undegraded":"2023-09-13T02:13:44.126142+0000","last_fullsized":"2023-09-13T02:13:44.126142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065331499999999997,"stat_sum":{"num_bytes":8,"num_objects":3,"num_object_clones":2,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'12","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:33.517273+0000","last_change":"2023-09-13T02:12:23.582781+0000","last_active":"2023-09-13T02:13:33.517273+0000","last_peered":"2023-09-13T02:13:33.517273+0000","last_clean":"2023-09-13T02:13:33.517273+0000","last_became_active":"2023-09-13T02:12:23.582506+0000","last_became_peered":"2023-09-13T02:12:23.582506+0000","last_unstale":"2023-09-13T02:13:33.517273+0000","last_undegraded":"2023-09-13T02:13:33.517273+0000","last_fullsized":"2023-09-13T02:13:33.517273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'55","reported_seq":97,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.863695+0000","last_change":"2023-09-13T02:13:42.538129+0000","last_active":"2023-09-13T02:13:43.863695+0000","last_peered":"2023-09-13T02:13:43.863695+0000","last_clean":"2023-09-13T02:13:43.863695+0000","last_became_active":"2023-09-13T02:12:24.592367+0000","last_became_peered":"2023-09-13T02:12:24.592367+0000","last_unstale":"2023-09-13T02:13:43.863695+0000","last_undegraded":"2023-09-13T02:13:43.863695+0000","last_fullsized":"2023-09-13T02:13:43.863695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2023-09-13T02:13:42.537998+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2023-09-13T02:13:42.537998+0000","last_clean_scrub_stamp":"2023-09-13T02:13:42.537998+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:58:10.391746+0000","scrub_duration":0.001467238,"objects_trimmed":0,"snaptrim_duration":0.0029315080000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'149","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:37.772938+0000","last_change":"2023-09-13T02:12:23.579000+0000","last_active":"2023-09-13T02:13:37.772938+0000","last_peered":"2023-09-13T02:13:37.772938+0000","last_clean":"2023-09-13T02:13:37.772938+0000","last_became_active":"2023-09-13T02:12:23.578748+0000","last_became_peered":"2023-09-13T02:12:23.578748+0000","last_unstale":"2023-09-13T02:13:37.772938+0000","last_undegraded":"2023-09-13T02:13:37.772938+0000","last_fullsized":"2023-09-13T02:13:37.772938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":543794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'32","reported_seq":66,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.034770+0000","last_change":"2023-09-13T02:13:33.086094+0000","last_active":"2023-09-13T02:13:44.034770+0000","last_peered":"2023-09-13T02:13:44.034770+0000","last_clean":"2023-09-13T02:13:44.034770+0000","last_became_active":"2023-09-13T02:12:24.593092+0000","last_became_peered":"2023-09-13T02:12:24.593092+0000","last_unstale":"2023-09-13T02:13:44.034770+0000","last_undegraded":"2023-09-13T02:13:44.034770+0000","last_fullsized":"2023-09-13T02:13:44.034770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011018085,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'5","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:34.538371+0000","last_change":"2023-09-13T02:13:34.538371+0000","last_active":"2023-09-13T02:13:34.538371+0000","last_peered":"2023-09-13T02:13:34.538371+0000","last_clean":"2023-09-13T02:13:34.538371+0000","last_became_active":"2023-09-13T02:12:23.579079+0000","last_became_peered":"2023-09-13T02:12:23.579079+0000","last_unstale":"2023-09-13T02:13:34.538371+0000","last_undegraded":"2023-09-13T02:13:34.538371+0000","last_fullsized":"2023-09-13T02:13:34.538371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2023-09-13T02:13:34.538222+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2023-09-13T02:13:34.538222+0000","last_clean_scrub_stamp":"2023-09-13T02:13:34.538222+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:28:36.195030+0000","scrub_duration":0.003901832,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'52","reported_seq":94,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:50.439759+0000","last_change":"2023-09-13T02:13:50.439804+0000","last_active":"2023-09-13T02:13:50.439759+0000","last_peered":"2023-09-13T02:13:50.439759+0000","last_clean":"2023-09-13T02:13:50.439759+0000","last_became_active":"2023-09-13T02:12:24.586930+0000","last_became_peered":"2023-09-13T02:12:24.586930+0000","last_unstale":"2023-09-13T02:13:50.439759+0000","last_undegraded":"2023-09-13T02:13:50.439759+0000","last_fullsized":"2023-09-13T02:13:50.439759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'52","last_scrub_stamp":"2023-09-13T02:13:50.439661+0000","last_deep_scrub":"22'52","last_deep_scrub_stamp":"2023-09-13T02:13:50.439661+0000","last_clean_scrub_stamp":"2023-09-13T02:13:50.439661+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:11.004026+0000","scrub_duration":0.002002565,"objects_trimmed":0,"snaptrim_duration":0.0063243029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:42.241297+0000","last_change":"2023-09-13T02:13:42.241297+0000","last_active":"2023-09-13T02:13:42.241297+0000","last_peered":"2023-09-13T02:13:42.241297+0000","last_clean":"2023-09-13T02:13:42.241297+0000","last_became_active":"2023-09-13T02:12:23.585417+0000","last_became_peered":"2023-09-13T02:12:23.585417+0000","last_unstale":"2023-09-13T02:13:42.241297+0000","last_undegraded":"2023-09-13T02:13:42.241297+0000","last_fullsized":"2023-09-13T02:13:42.241297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:42.241173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:42.241173+0000","last_clean_scrub_stamp":"2023-09-13T02:13:42.241173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:39:55.326320+0000","scrub_duration":0.001782151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'73","reported_seq":107,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.034596+0000","last_change":"2023-09-13T02:13:33.085927+0000","last_active":"2023-09-13T02:13:44.034596+0000","last_peered":"2023-09-13T02:13:44.034596+0000","last_clean":"2023-09-13T02:13:44.034596+0000","last_became_active":"2023-09-13T02:12:24.591849+0000","last_became_peered":"2023-09-13T02:12:24.591849+0000","last_unstale":"2023-09-13T02:13:44.034596+0000","last_undegraded":"2023-09-13T02:13:44.034596+0000","last_fullsized":"2023-09-13T02:13:44.034596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013591097999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:45.531946+0000","last_change":"2023-09-13T02:13:45.532009+0000","last_active":"2023-09-13T02:13:45.531946+0000","last_peered":"2023-09-13T02:13:45.531946+0000","last_clean":"2023-09-13T02:13:45.531946+0000","last_became_active":"2023-09-13T02:12:23.576022+0000","last_became_peered":"2023-09-13T02:12:23.576022+0000","last_unstale":"2023-09-13T02:13:45.531946+0000","last_undegraded":"2023-09-13T02:13:45.531946+0000","last_fullsized":"2023-09-13T02:13:45.531946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:45.531836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:45.531836+0000","last_clean_scrub_stamp":"2023-09-13T02:13:45.531836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:07.611999+0000","scrub_duration":0.001749312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'33","reported_seq":67,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.533342+0000","last_change":"2023-09-13T02:13:33.079219+0000","last_active":"2023-09-13T02:13:44.533342+0000","last_peered":"2023-09-13T02:13:44.533342+0000","last_clean":"2023-09-13T02:13:44.533342+0000","last_became_active":"2023-09-13T02:12:24.591247+0000","last_became_peered":"2023-09-13T02:12:24.591247+0000","last_unstale":"2023-09-13T02:13:44.533342+0000","last_undegraded":"2023-09-13T02:13:44.533342+0000","last_fullsized":"2023-09-13T02:13:44.533342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0077636559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'13","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:40.296099+0000","last_change":"2023-09-13T02:13:40.296099+0000","last_active":"2023-09-13T02:13:40.296099+0000","last_peered":"2023-09-13T02:13:40.296099+0000","last_clean":"2023-09-13T02:13:40.296099+0000","last_became_active":"2023-09-13T02:12:23.570461+0000","last_became_peered":"2023-09-13T02:12:23.570461+0000","last_unstale":"2023-09-13T02:13:40.296099+0000","last_undegraded":"2023-09-13T02:13:40.296099+0000","last_fullsized":"2023-09-13T02:13:40.296099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'13","last_scrub_stamp":"2023-09-13T02:13:40.295924+0000","last_deep_scrub":"23'13","last_deep_scrub_stamp":"2023-09-13T02:13:40.295924+0000","last_clean_scrub_stamp":"2023-09-13T02:13:40.295924+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:09:19.656296+0000","scrub_duration":0.0091344400000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'34","reported_seq":76,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.034368+0000","last_change":"2023-09-13T02:13:43.118040+0000","last_active":"2023-09-13T02:13:44.034368+0000","last_peered":"2023-09-13T02:13:44.034368+0000","last_clean":"2023-09-13T02:13:44.034368+0000","last_became_active":"2023-09-13T02:12:24.591036+0000","last_became_peered":"2023-09-13T02:12:24.591036+0000","last_unstale":"2023-09-13T02:13:44.034368+0000","last_undegraded":"2023-09-13T02:13:44.034368+0000","last_fullsized":"2023-09-13T02:13:44.034368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'34","last_scrub_stamp":"2023-09-13T02:13:43.117902+0000","last_deep_scrub":"22'34","last_deep_scrub_stamp":"2023-09-13T02:13:43.117902+0000","last_clean_scrub_stamp":"2023-09-13T02:13:43.117902+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:03.682267+0000","scrub_duration":0.001555741,"objects_trimmed":0,"snaptrim_duration":0.013568350999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:38.593910+0000","last_change":"2023-09-13T02:13:38.593910+0000","last_active":"2023-09-13T02:13:38.593910+0000","last_peered":"2023-09-13T02:13:38.593910+0000","last_clean":"2023-09-13T02:13:38.593910+0000","last_became_active":"2023-09-13T02:12:23.584235+0000","last_became_peered":"2023-09-13T02:12:23.584235+0000","last_unstale":"2023-09-13T02:13:38.593910+0000","last_undegraded":"2023-09-13T02:13:38.593910+0000","last_fullsized":"2023-09-13T02:13:38.593910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-09-13T02:13:38.593770+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-09-13T02:13:38.593770+0000","last_clean_scrub_stamp":"2023-09-13T02:13:38.593770+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:56.569749+0000","scrub_duration":0.0037909710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'30","reported_seq":63,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.034992+0000","last_change":"2023-09-13T02:13:33.084092+0000","last_active":"2023-09-13T02:13:44.034992+0000","last_peered":"2023-09-13T02:13:44.034992+0000","last_clean":"2023-09-13T02:13:44.034992+0000","last_became_active":"2023-09-13T02:12:24.592242+0000","last_became_peered":"2023-09-13T02:12:24.592242+0000","last_unstale":"2023-09-13T02:13:44.034992+0000","last_undegraded":"2023-09-13T02:13:44.034992+0000","last_fullsized":"2023-09-13T02:13:44.034992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013102625,"stat_sum":{"num_bytes":4,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'3","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:41.313970+0000","last_change":"2023-09-13T02:13:41.313970+0000","last_active":"2023-09-13T02:13:41.313970+0000","last_peered":"2023-09-13T02:13:41.313970+0000","last_clean":"2023-09-13T02:13:41.313970+0000","last_became_active":"2023-09-13T02:12:23.577918+0000","last_became_peered":"2023-09-13T02:12:23.577918+0000","last_unstale":"2023-09-13T02:13:41.313970+0000","last_undegraded":"2023-09-13T02:13:41.313970+0000","last_fullsized":"2023-09-13T02:13:41.313970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2023-09-13T02:13:41.313825+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2023-09-13T02:13:41.313825+0000","last_clean_scrub_stamp":"2023-09-13T02:13:41.313825+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:58:09.167573+0000","scrub_duration":0.0027577909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'45","reported_seq":79,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.035529+0000","last_change":"2023-09-13T02:13:33.085600+0000","last_active":"2023-09-13T02:13:44.035529+0000","last_peered":"2023-09-13T02:13:44.035529+0000","last_clean":"2023-09-13T02:13:44.035529+0000","last_became_active":"2023-09-13T02:12:24.595462+0000","last_became_peered":"2023-09-13T02:12:24.595462+0000","last_unstale":"2023-09-13T02:13:44.035529+0000","last_undegraded":"2023-09-13T02:13:44.035529+0000","last_fullsized":"2023-09-13T02:13:44.035529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013458447,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:33.517258+0000","last_change":"2023-09-13T02:12:23.570346+0000","last_active":"2023-09-13T02:13:33.517258+0000","last_peered":"2023-09-13T02:13:33.517258+0000","last_clean":"2023-09-13T02:13:33.517258+0000","last_became_active":"2023-09-13T02:12:23.570066+0000","last_became_peered":"2023-09-13T02:12:23.570066+0000","last_unstale":"2023-09-13T02:13:33.517258+0000","last_undegraded":"2023-09-13T02:13:33.517258+0000","last_fullsized":"2023-09-13T02:13:33.517258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'35","reported_seq":69,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.244128+0000","last_change":"2023-09-13T02:13:33.083608+0000","last_active":"2023-09-13T02:13:44.244128+0000","last_peered":"2023-09-13T02:13:44.244128+0000","last_clean":"2023-09-13T02:13:44.244128+0000","last_became_active":"2023-09-13T02:12:24.595327+0000","last_became_peered":"2023-09-13T02:12:24.595327+0000","last_unstale":"2023-09-13T02:13:44.244128+0000","last_undegraded":"2023-09-13T02:13:44.244128+0000","last_fullsized":"2023-09-13T02:13:44.244128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010369821,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'2","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:49.342539+0000","last_change":"2023-09-13T02:13:49.342605+0000","last_active":"2023-09-13T02:13:49.342539+0000","last_peered":"2023-09-13T02:13:49.342539+0000","last_clean":"2023-09-13T02:13:49.342539+0000","last_became_active":"2023-09-13T02:12:23.582841+0000","last_became_peered":"2023-09-13T02:12:23.582841+0000","last_unstale":"2023-09-13T02:13:49.342539+0000","last_undegraded":"2023-09-13T02:13:49.342539+0000","last_fullsized":"2023-09-13T02:13:49.342539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2023-09-13T02:13:49.342427+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2023-09-13T02:13:49.342427+0000","last_clean_scrub_stamp":"2023-09-13T02:13:49.342427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:15:31.550471+0000","scrub_duration":0.002249348,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'38","reported_seq":72,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.034800+0000","last_change":"2023-09-13T02:13:33.084806+0000","last_active":"2023-09-13T02:13:44.034800+0000","last_peered":"2023-09-13T02:13:44.034800+0000","last_clean":"2023-09-13T02:13:44.034800+0000","last_became_active":"2023-09-13T02:12:24.590343+0000","last_became_peered":"2023-09-13T02:12:24.590343+0000","last_unstale":"2023-09-13T02:13:44.034800+0000","last_undegraded":"2023-09-13T02:13:44.034800+0000","last_fullsized":"2023-09-13T02:13:44.034800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013157841999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"24'119","reported_seq":180,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.132025+0000","last_change":"2023-09-13T02:13:44.132100+0000","last_active":"2023-09-13T02:13:44.132025+0000","last_peered":"2023-09-13T02:13:44.132025+0000","last_clean":"2023-09-13T02:13:44.132025+0000","last_became_active":"2023-09-13T02:12:13.260630+0000","last_became_peered":"2023-09-13T02:12:13.260630+0000","last_unstale":"2023-09-13T02:13:44.132025+0000","last_undegraded":"2023-09-13T02:13:44.132025+0000","last_fullsized":"2023-09-13T02:13:44.132025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'119","last_scrub_stamp":"2023-09-13T02:13:44.131943+0000","last_deep_scrub":"24'119","last_deep_scrub_stamp":"2023-09-13T02:13:44.131943+0000","last_clean_scrub_stamp":"2023-09-13T02:13:44.131943+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:39:57.217089+0000","scrub_duration":0.0082749480000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:35.245588+0000","last_change":"2023-09-13T02:13:35.245588+0000","last_active":"2023-09-13T02:13:35.245588+0000","last_peered":"2023-09-13T02:13:35.245588+0000","last_clean":"2023-09-13T02:13:35.245588+0000","last_became_active":"2023-09-13T02:12:23.583874+0000","last_became_peered":"2023-09-13T02:12:23.583874+0000","last_unstale":"2023-09-13T02:13:35.245588+0000","last_undegraded":"2023-09-13T02:13:35.245588+0000","last_fullsized":"2023-09-13T02:13:35.245588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:35.245450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:35.245450+0000","last_clean_scrub_stamp":"2023-09-13T02:13:35.245450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:18:57.325613+0000","scrub_duration":0.0016768289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'35","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:48.551086+0000","last_change":"2023-09-13T02:13:48.551133+0000","last_active":"2023-09-13T02:13:48.551086+0000","last_peered":"2023-09-13T02:13:48.551086+0000","last_clean":"2023-09-13T02:13:48.551086+0000","last_became_active":"2023-09-13T02:13:05.918736+0000","last_became_peered":"2023-09-13T02:13:05.918736+0000","last_unstale":"2023-09-13T02:13:48.551086+0000","last_undegraded":"2023-09-13T02:13:48.551086+0000","last_fullsized":"2023-09-13T02:13:48.551086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'35","last_scrub_stamp":"2023-09-13T02:13:48.550991+0000","last_deep_scrub":"22'35","last_deep_scrub_stamp":"2023-09-13T02:13:48.550991+0000","last_clean_scrub_stamp":"2023-09-13T02:13:48.550991+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:09.115357+0000","scrub_duration":0.001473416,"objects_trimmed":0,"snaptrim_duration":0.0055331570000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"22'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:36.065131+0000","last_change":"2023-09-13T02:12:23.580928+0000","last_active":"2023-09-13T02:13:36.065131+0000","last_peered":"2023-09-13T02:13:36.065131+0000","last_clean":"2023-09-13T02:13:36.065131+0000","last_became_active":"2023-09-13T02:12:23.580670+0000","last_became_peered":"2023-09-13T02:12:23.580670+0000","last_unstale":"2023-09-13T02:13:36.065131+0000","last_undegraded":"2023-09-13T02:13:36.065131+0000","last_fullsized":"2023-09-13T02:13:36.065131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'24","reported_seq":66,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.125745+0000","last_change":"2023-09-13T02:13:43.492872+0000","last_active":"2023-09-13T02:13:44.125745+0000","last_peered":"2023-09-13T02:13:44.125745+0000","last_clean":"2023-09-13T02:13:44.125745+0000","last_became_active":"2023-09-13T02:12:24.578715+0000","last_became_peered":"2023-09-13T02:12:24.578715+0000","last_unstale":"2023-09-13T02:13:44.125745+0000","last_undegraded":"2023-09-13T02:13:44.125745+0000","last_fullsized":"2023-09-13T02:13:44.125745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2023-09-13T02:13:43.492725+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2023-09-13T02:13:43.492725+0000","last_clean_scrub_stamp":"2023-09-13T02:13:43.492725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:05.572888+0000","scrub_duration":0.001908161,"objects_trimmed":0,"snaptrim_duration":0.0043944989999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'15","reported_seq":53,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:37.258923+0000","last_change":"2023-09-13T02:13:37.258923+0000","last_active":"2023-09-13T02:13:37.258923+0000","last_peered":"2023-09-13T02:13:37.258923+0000","last_clean":"2023-09-13T02:13:37.258923+0000","last_became_active":"2023-09-13T02:12:23.577786+0000","last_became_peered":"2023-09-13T02:12:23.577786+0000","last_unstale":"2023-09-13T02:13:37.258923+0000","last_undegraded":"2023-09-13T02:13:37.258923+0000","last_fullsized":"2023-09-13T02:13:37.258923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'15","last_scrub_stamp":"2023-09-13T02:13:37.258768+0000","last_deep_scrub":"22'15","last_deep_scrub_stamp":"2023-09-13T02:13:37.258768+0000","last_clean_scrub_stamp":"2023-09-13T02:13:37.258768+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:55.234747+0000","scrub_duration":0.001911905,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5781,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":13,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'46","reported_seq":80,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.864727+0000","last_change":"2023-09-13T02:13:32.967014+0000","last_active":"2023-09-13T02:13:43.864727+0000","last_peered":"2023-09-13T02:13:43.864727+0000","last_clean":"2023-09-13T02:13:43.864727+0000","last_became_active":"2023-09-13T02:12:24.582439+0000","last_became_peered":"2023-09-13T02:12:24.582439+0000","last_unstale":"2023-09-13T02:13:43.864727+0000","last_undegraded":"2023-09-13T02:13:43.864727+0000","last_fullsized":"2023-09-13T02:13:43.864727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003781501,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:41.290553+0000","last_change":"2023-09-13T02:13:41.290553+0000","last_active":"2023-09-13T02:13:41.290553+0000","last_peered":"2023-09-13T02:13:41.290553+0000","last_clean":"2023-09-13T02:13:41.290553+0000","last_became_active":"2023-09-13T02:12:23.585349+0000","last_became_peered":"2023-09-13T02:12:23.585349+0000","last_unstale":"2023-09-13T02:13:41.290553+0000","last_undegraded":"2023-09-13T02:13:41.290553+0000","last_fullsized":"2023-09-13T02:13:41.290553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:41.290413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:41.290413+0000","last_clean_scrub_stamp":"2023-09-13T02:13:41.290413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:01.854778+0000","scrub_duration":0.0021446849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'33","reported_seq":75,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.863868+0000","last_change":"2023-09-13T02:13:43.543289+0000","last_active":"2023-09-13T02:13:43.863868+0000","last_peered":"2023-09-13T02:13:43.863868+0000","last_clean":"2023-09-13T02:13:43.863868+0000","last_became_active":"2023-09-13T02:12:24.585054+0000","last_became_peered":"2023-09-13T02:12:24.585054+0000","last_unstale":"2023-09-13T02:13:43.863868+0000","last_undegraded":"2023-09-13T02:13:43.863868+0000","last_fullsized":"2023-09-13T02:13:43.863868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'33","last_scrub_stamp":"2023-09-13T02:13:43.543086+0000","last_deep_scrub":"22'33","last_deep_scrub_stamp":"2023-09-13T02:13:43.543086+0000","last_clean_scrub_stamp":"2023-09-13T02:13:43.543086+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:28:45.199893+0000","scrub_duration":0.001743007,"objects_trimmed":0,"snaptrim_duration":0.0030300140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:46.777555+0000","last_change":"2023-09-13T02:13:46.777621+0000","last_active":"2023-09-13T02:13:46.777555+0000","last_peered":"2023-09-13T02:13:46.777555+0000","last_clean":"2023-09-13T02:13:46.777555+0000","last_became_active":"2023-09-13T02:12:23.579844+0000","last_became_peered":"2023-09-13T02:12:23.579844+0000","last_unstale":"2023-09-13T02:13:46.777555+0000","last_undegraded":"2023-09-13T02:13:46.777555+0000","last_fullsized":"2023-09-13T02:13:46.777555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:46.777446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:46.777446+0000","last_clean_scrub_stamp":"2023-09-13T02:13:46.777446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:15:28.985490+0000","scrub_duration":0.001613361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'32","reported_seq":66,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.244065+0000","last_change":"2023-09-13T02:13:33.084212+0000","last_active":"2023-09-13T02:13:44.244065+0000","last_peered":"2023-09-13T02:13:44.244065+0000","last_clean":"2023-09-13T02:13:44.244065+0000","last_became_active":"2023-09-13T02:12:24.592436+0000","last_became_peered":"2023-09-13T02:12:24.592436+0000","last_unstale":"2023-09-13T02:13:44.244065+0000","last_undegraded":"2023-09-13T02:13:44.244065+0000","last_fullsized":"2023-09-13T02:13:44.244065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010782369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:36.065140+0000","last_change":"2023-09-13T02:12:23.585605+0000","last_active":"2023-09-13T02:13:36.065140+0000","last_peered":"2023-09-13T02:13:36.065140+0000","last_clean":"2023-09-13T02:13:36.065140+0000","last_became_active":"2023-09-13T02:12:23.585411+0000","last_became_peered":"2023-09-13T02:12:23.585411+0000","last_unstale":"2023-09-13T02:13:36.065140+0000","last_undegraded":"2023-09-13T02:13:36.065140+0000","last_fullsized":"2023-09-13T02:13:36.065140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'45","reported_seq":79,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.864235+0000","last_change":"2023-09-13T02:13:32.968005+0000","last_active":"2023-09-13T02:13:43.864235+0000","last_peered":"2023-09-13T02:13:43.864235+0000","last_clean":"2023-09-13T02:13:43.864235+0000","last_became_active":"2023-09-13T02:12:24.582517+0000","last_became_peered":"2023-09-13T02:12:24.582517+0000","last_unstale":"2023-09-13T02:13:43.864235+0000","last_undegraded":"2023-09-13T02:13:43.864235+0000","last_fullsized":"2023-09-13T02:13:43.864235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039709990000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'6","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:48.787190+0000","last_change":"2023-09-13T02:13:48.787277+0000","last_active":"2023-09-13T02:13:48.787190+0000","last_peered":"2023-09-13T02:13:48.787190+0000","last_clean":"2023-09-13T02:13:48.787190+0000","last_became_active":"2023-09-13T02:12:23.575875+0000","last_became_peered":"2023-09-13T02:12:23.575875+0000","last_unstale":"2023-09-13T02:13:48.787190+0000","last_undegraded":"2023-09-13T02:13:48.787190+0000","last_fullsized":"2023-09-13T02:13:48.787190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2023-09-13T02:13:48.787080+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2023-09-13T02:13:48.787080+0000","last_clean_scrub_stamp":"2023-09-13T02:13:48.787080+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:10.867244+0000","scrub_duration":0.0022005359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'31","reported_seq":65,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.540186+0000","last_change":"2023-09-13T02:13:32.969761+0000","last_active":"2023-09-13T02:13:44.540186+0000","last_peered":"2023-09-13T02:13:44.540186+0000","last_clean":"2023-09-13T02:13:44.540186+0000","last_became_active":"2023-09-13T02:12:24.592247+0000","last_became_peered":"2023-09-13T02:12:24.592247+0000","last_unstale":"2023-09-13T02:13:44.540186+0000","last_undegraded":"2023-09-13T02:13:44.540186+0000","last_fullsized":"2023-09-13T02:13:44.540186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005600257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:35.639099+0000","last_change":"2023-09-13T02:12:23.579687+0000","last_active":"2023-09-13T02:13:35.639099+0000","last_peered":"2023-09-13T02:13:35.639099+0000","last_clean":"2023-09-13T02:13:35.639099+0000","last_became_active":"2023-09-13T02:12:23.579389+0000","last_became_peered":"2023-09-13T02:12:23.579389+0000","last_unstale":"2023-09-13T02:13:35.639099+0000","last_undegraded":"2023-09-13T02:13:35.639099+0000","last_fullsized":"2023-09-13T02:13:35.639099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'42","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:51.458114+0000","last_change":"2023-09-13T02:13:51.458182+0000","last_active":"2023-09-13T02:13:51.458114+0000","last_peered":"2023-09-13T02:13:51.458114+0000","last_clean":"2023-09-13T02:13:51.458114+0000","last_became_active":"2023-09-13T02:12:24.584791+0000","last_became_peered":"2023-09-13T02:12:24.584791+0000","last_unstale":"2023-09-13T02:13:51.458114+0000","last_undegraded":"2023-09-13T02:13:51.458114+0000","last_fullsized":"2023-09-13T02:13:51.458114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'42","last_scrub_stamp":"2023-09-13T02:13:51.458031+0000","last_deep_scrub":"22'42","last_deep_scrub_stamp":"2023-09-13T02:13:51.458031+0000","last_clean_scrub_stamp":"2023-09-13T02:13:51.458031+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:40:04.543178+0000","scrub_duration":0.001389373,"objects_trimmed":0,"snaptrim_duration":0.0066515319999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'1","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:49.025031+0000","last_change":"2023-09-13T02:13:49.025087+0000","last_active":"2023-09-13T02:13:49.025031+0000","last_peered":"2023-09-13T02:13:49.025031+0000","last_clean":"2023-09-13T02:13:49.025031+0000","last_became_active":"2023-09-13T02:12:23.585321+0000","last_became_peered":"2023-09-13T02:12:23.585321+0000","last_unstale":"2023-09-13T02:13:49.025031+0000","last_undegraded":"2023-09-13T02:13:49.025031+0000","last_fullsized":"2023-09-13T02:13:49.025031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-09-13T02:13:49.024944+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-09-13T02:13:49.024944+0000","last_clean_scrub_stamp":"2023-09-13T02:13:49.024944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:09:28.855756+0000","scrub_duration":0.001872844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'13","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.863210+0000","last_change":"2023-09-13T02:13:32.966530+0000","last_active":"2023-09-13T02:13:43.863210+0000","last_peered":"2023-09-13T02:13:43.863210+0000","last_clean":"2023-09-13T02:13:43.863210+0000","last_became_active":"2023-09-13T02:12:24.586072+0000","last_became_peered":"2023-09-13T02:12:24.586072+0000","last_unstale":"2023-09-13T02:13:43.863210+0000","last_undegraded":"2023-09-13T02:13:43.863210+0000","last_fullsized":"2023-09-13T02:13:43.863210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002920593,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:35.678606+0000","last_change":"2023-09-13T02:13:35.678606+0000","last_active":"2023-09-13T02:13:35.678606+0000","last_peered":"2023-09-13T02:13:35.678606+0000","last_clean":"2023-09-13T02:13:35.678606+0000","last_became_active":"2023-09-13T02:12:23.578649+0000","last_became_peered":"2023-09-13T02:12:23.578649+0000","last_unstale":"2023-09-13T02:13:35.678606+0000","last_undegraded":"2023-09-13T02:13:35.678606+0000","last_fullsized":"2023-09-13T02:13:35.678606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:35.678498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:35.678498+0000","last_clean_scrub_stamp":"2023-09-13T02:13:35.678498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:09:15.038871+0000","scrub_duration":0.0013642319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'43","reported_seq":74,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.862907+0000","last_change":"2023-09-13T02:13:33.071502+0000","last_active":"2023-09-13T02:13:43.862907+0000","last_peered":"2023-09-13T02:13:43.862907+0000","last_clean":"2023-09-13T02:13:43.862907+0000","last_became_active":"2023-09-13T02:13:05.914007+0000","last_became_peered":"2023-09-13T02:13:05.914007+0000","last_unstale":"2023-09-13T02:13:43.862907+0000","last_undegraded":"2023-09-13T02:13:43.862907+0000","last_fullsized":"2023-09-13T02:13:43.862907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012388329999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:33.517216+0000","last_change":"2023-09-13T02:12:23.578387+0000","last_active":"2023-09-13T02:13:33.517216+0000","last_peered":"2023-09-13T02:13:33.517216+0000","last_clean":"2023-09-13T02:13:33.517216+0000","last_became_active":"2023-09-13T02:12:23.578121+0000","last_became_peered":"2023-09-13T02:12:23.578121+0000","last_unstale":"2023-09-13T02:13:33.517216+0000","last_undegraded":"2023-09-13T02:13:33.517216+0000","last_fullsized":"2023-09-13T02:13:33.517216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'42","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:50.542763+0000","last_change":"2023-09-13T02:13:50.542813+0000","last_active":"2023-09-13T02:13:50.542763+0000","last_peered":"2023-09-13T02:13:50.542763+0000","last_clean":"2023-09-13T02:13:50.542763+0000","last_became_active":"2023-09-13T02:12:24.587040+0000","last_became_peered":"2023-09-13T02:12:24.587040+0000","last_unstale":"2023-09-13T02:13:50.542763+0000","last_undegraded":"2023-09-13T02:13:50.542763+0000","last_fullsized":"2023-09-13T02:13:50.542763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'42","last_scrub_stamp":"2023-09-13T02:13:50.542679+0000","last_deep_scrub":"22'42","last_deep_scrub_stamp":"2023-09-13T02:13:50.542679+0000","last_clean_scrub_stamp":"2023-09-13T02:13:50.542679+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:41:30.966582+0000","scrub_duration":0.0013316300000000001,"objects_trimmed":0,"snaptrim_duration":0.0055712349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'5","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:52.003358+0000","last_change":"2023-09-13T02:13:52.003423+0000","last_active":"2023-09-13T02:13:52.003358+0000","last_peered":"2023-09-13T02:13:52.003358+0000","last_clean":"2023-09-13T02:13:52.003358+0000","last_became_active":"2023-09-13T02:12:23.578258+0000","last_became_peered":"2023-09-13T02:12:23.578258+0000","last_unstale":"2023-09-13T02:13:52.003358+0000","last_undegraded":"2023-09-13T02:13:52.003358+0000","last_fullsized":"2023-09-13T02:13:52.003358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5","last_scrub_stamp":"2023-09-13T02:13:52.003272+0000","last_deep_scrub":"24'5","last_deep_scrub_stamp":"2023-09-13T02:13:52.003272+0000","last_clean_scrub_stamp":"2023-09-13T02:13:52.003272+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:03:50.023919+0000","scrub_duration":0.0027335189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'29","reported_seq":63,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.533487+0000","last_change":"2023-09-13T02:13:33.075939+0000","last_active":"2023-09-13T02:13:44.533487+0000","last_peered":"2023-09-13T02:13:44.533487+0000","last_clean":"2023-09-13T02:13:44.533487+0000","last_became_active":"2023-09-13T02:12:24.590494+0000","last_became_peered":"2023-09-13T02:12:24.590494+0000","last_unstale":"2023-09-13T02:13:44.533487+0000","last_undegraded":"2023-09-13T02:13:44.533487+0000","last_fullsized":"2023-09-13T02:13:44.533487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050570779999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'70","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.244009+0000","last_change":"2023-09-13T02:13:33.083960+0000","last_active":"2023-09-13T02:13:44.244009+0000","last_peered":"2023-09-13T02:13:44.244009+0000","last_clean":"2023-09-13T02:13:44.244009+0000","last_became_active":"2023-09-13T02:12:24.597024+0000","last_became_peered":"2023-09-13T02:12:24.597024+0000","last_unstale":"2023-09-13T02:13:44.244009+0000","last_undegraded":"2023-09-13T02:13:44.244009+0000","last_fullsized":"2023-09-13T02:13:44.244009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010975594999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:36.065160+0000","last_change":"2023-09-13T02:12:23.584941+0000","last_active":"2023-09-13T02:13:36.065160+0000","last_peered":"2023-09-13T02:13:36.065160+0000","last_clean":"2023-09-13T02:13:36.065160+0000","last_became_active":"2023-09-13T02:12:23.584671+0000","last_became_peered":"2023-09-13T02:12:23.584671+0000","last_unstale":"2023-09-13T02:13:36.065160+0000","last_undegraded":"2023-09-13T02:13:36.065160+0000","last_fullsized":"2023-09-13T02:13:36.065160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'41","reported_seq":75,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.243776+0000","last_change":"2023-09-13T02:13:33.082898+0000","last_active":"2023-09-13T02:13:44.243776+0000","last_peered":"2023-09-13T02:13:44.243776+0000","last_clean":"2023-09-13T02:13:44.243776+0000","last_became_active":"2023-09-13T02:12:24.595918+0000","last_became_peered":"2023-09-13T02:12:24.595918+0000","last_unstale":"2023-09-13T02:13:44.243776+0000","last_undegraded":"2023-09-13T02:13:44.243776+0000","last_fullsized":"2023-09-13T02:13:44.243776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010091243999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:36.065283+0000","last_change":"2023-09-13T02:12:23.579507+0000","last_active":"2023-09-13T02:13:36.065283+0000","last_peered":"2023-09-13T02:13:36.065283+0000","last_clean":"2023-09-13T02:13:36.065283+0000","last_became_active":"2023-09-13T02:12:23.579239+0000","last_became_peered":"2023-09-13T02:12:23.579239+0000","last_unstale":"2023-09-13T02:13:36.065283+0000","last_undegraded":"2023-09-13T02:13:36.065283+0000","last_fullsized":"2023-09-13T02:13:36.065283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:22.556293+0000","last_clean_scrub_stamp":"2023-09-13T02:12:22.556293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'35","reported_seq":69,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.126224+0000","last_change":"2023-09-13T02:13:33.077531+0000","last_active":"2023-09-13T02:13:44.126224+0000","last_peered":"2023-09-13T02:13:44.126224+0000","last_clean":"2023-09-13T02:13:44.126224+0000","last_became_active":"2023-09-13T02:12:24.589039+0000","last_became_peered":"2023-09-13T02:12:24.589039+0000","last_unstale":"2023-09-13T02:13:44.126224+0000","last_undegraded":"2023-09-13T02:13:44.126224+0000","last_fullsized":"2023-09-13T02:13:44.126224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066201710000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:41.502547+0000","last_change":"2023-09-13T02:13:41.502547+0000","last_active":"2023-09-13T02:13:41.502547+0000","last_peered":"2023-09-13T02:13:41.502547+0000","last_clean":"2023-09-13T02:13:41.502547+0000","last_became_active":"2023-09-13T02:12:23.583920+0000","last_became_peered":"2023-09-13T02:12:23.583920+0000","last_unstale":"2023-09-13T02:13:41.502547+0000","last_undegraded":"2023-09-13T02:13:41.502547+0000","last_fullsized":"2023-09-13T02:13:41.502547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2023-09-13T02:13:41.502420+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2023-09-13T02:13:41.502420+0000","last_clean_scrub_stamp":"2023-09-13T02:13:41.502420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:27:11.456352+0000","scrub_duration":0.001286082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'26","reported_seq":60,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.539953+0000","last_change":"2023-09-13T02:13:32.969716+0000","last_active":"2023-09-13T02:13:44.539953+0000","last_peered":"2023-09-13T02:13:44.539953+0000","last_clean":"2023-09-13T02:13:44.539953+0000","last_became_active":"2023-09-13T02:12:24.587697+0000","last_became_peered":"2023-09-13T02:12:24.587697+0000","last_unstale":"2023-09-13T02:13:44.539953+0000","last_undegraded":"2023-09-13T02:13:44.539953+0000","last_fullsized":"2023-09-13T02:13:44.539953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056801320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'7","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:41.484295+0000","last_change":"2023-09-13T02:13:41.484295+0000","last_active":"2023-09-13T02:13:41.484295+0000","last_peered":"2023-09-13T02:13:41.484295+0000","last_clean":"2023-09-13T02:13:41.484295+0000","last_became_active":"2023-09-13T02:12:23.583443+0000","last_became_peered":"2023-09-13T02:12:23.583443+0000","last_unstale":"2023-09-13T02:13:41.484295+0000","last_undegraded":"2023-09-13T02:13:41.484295+0000","last_fullsized":"2023-09-13T02:13:41.484295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2023-09-13T02:13:41.484120+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2023-09-13T02:13:41.484120+0000","last_clean_scrub_stamp":"2023-09-13T02:13:41.484120+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:15:23.692164+0000","scrub_duration":0.0038019579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":12,"num_objects":5,"num_object_clones":3,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":24,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2585,"ondisk_log_size":2585,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":550373,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":219,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1163264,"data_stored":1100746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":241,"ondisk_log_size":241,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":856064,"data_stored":686971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.68500000000000005}]},{"osd":1,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.76800000000000002}]},{"osd":2,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.56100000000000005}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.63800000000000001}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.42899999999999999}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.54300000000000004}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.499}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":806912,"data_stored":639811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.59399999999999997}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.503},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56399999999999995}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.64000000000000001}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.624}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.44600000000000001}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40400000000000003}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.57599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":96115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.52100000000000002}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.34699999999999998}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.434}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.45200000000000001}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.56399999999999995}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.49199999999999999}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":96147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.56299999999999994}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.65000000000000002}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.66300000000000003}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59799999999999998}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.48999999999999999}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.71299999999999997}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":815104,"data_stored":645592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.32900000000000001}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.42799999999999999}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.36399999999999999}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.504},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.63300000000000001}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.623}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.57099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":101798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.33400000000000002}]},{"osd":1,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.38700000000000001}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.374},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.51000000000000001}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.75700000000000001}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.78100000000000003}]},{"osd":7,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.90100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":96177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.38600000000000001}]},{"osd":2,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.442}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.30299999999999999}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.503}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.48399999999999999}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.52700000000000002}]},{"osd":7,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.45700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":864256,"data_stored":686012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.245},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.28499999999999998}]},{"osd":2,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.314},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.38300000000000001}]},{"osd":3,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.36899999999999999}]},{"osd":4,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.71299999999999997}]},{"osd":5,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58499999999999996}]},{"osd":6,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.626}]},{"osd":7,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.55900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":5781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":549575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":543794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T02:13:56.730 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.730 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.731 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.731 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.732 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.732 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.732 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.733 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.733 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.733 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.734 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.734 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.735 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.735 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.735 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.736 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.736 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.737 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.737 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.737 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.738 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.738 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.738 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.739 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.739 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.740 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.740 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.740 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.741 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.741 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.742 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.742 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.742 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.743 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.743 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.744 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.744 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.744 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.745 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.745 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.745 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.746 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.746 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.747 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.747 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.748 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.748 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.748 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.749 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.749 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.750 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.750 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.750 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.751 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.751 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.752 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.752 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.752 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-09-13T02:12:22.556293+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=22, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.753 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.753 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:13:56.754 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-13T02:14:16.755 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T02:14:16.869 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.867+0000 7f5917be2640 1 -- 172.21.15.104:0/743271773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58fc0047c0 msgr2=0x7f58fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:16.869 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.867+0000 7f5917be2640 1 --2- 172.21.15.104:0/743271773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58fc0047c0 0x7f58fc004c40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5900006fd0 tx=0x7f58fc0057f0 comp rx=0 tx=0).stop 2023-09-13T02:14:16.869 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.867+0000 7f5917be2640 1 -- 172.21.15.104:0/743271773 shutdown_connections 2023-09-13T02:14:16.870 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.867+0000 7f5917be2640 1 --2- 172.21.15.104:0/743271773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58fc0047c0 0x7f58fc004c40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:16.870 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.867+0000 7f5917be2640 1 -- 172.21.15.104:0/743271773 >> 172.21.15.104:0/743271773 conn(0x7f5910069360 msgr2=0x7f5910069740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:16.870 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.867+0000 7f5917be2640 1 -- 172.21.15.104:0/743271773 shutdown_connections 2023-09-13T02:14:16.871 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.868+0000 7f5917be2640 1 -- 172.21.15.104:0/743271773 wait complete. 2023-09-13T02:14:16.873 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.868+0000 7f5917be2640 1 Processor -- start 2023-09-13T02:14:16.873 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.869+0000 7f5917be2640 1 -- start start 2023-09-13T02:14:16.874 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.869+0000 7f5917be2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58fc0047c0 0x7f5910143c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:16.874 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.869+0000 7f5917be2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59101dd9c0 0x7f59101dde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:16.874 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.869+0000 7f5917be2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59100ae5f0 0x7f59100aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:16.875 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.869+0000 7f5917be2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59101de380 con 0x7f59100ae5f0 2023-09-13T02:14:16.875 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.869+0000 7f5917be2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591006e4f0 con 0x7f58fc0047c0 2023-09-13T02:14:16.875 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.869+0000 7f5917be2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59100af960 con 0x7f59101dd9c0 2023-09-13T02:14:16.875 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.869+0000 7f591617f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59100ae5f0 0x7f59100aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:16.876 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.869+0000 7f591617f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59100ae5f0 0x7f59100aea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57508/0 (socket says 172.21.15.104:57508) 2023-09-13T02:14:16.876 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.869+0000 7f591617f640 1 -- 172.21.15.104:0/3732567081 learned_addr learned my addr 172.21.15.104:0/3732567081 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:14:16.876 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.869+0000 7f591597e640 1 --2- 172.21.15.104:0/3732567081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58fc0047c0 0x7f5910143c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:16.876 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.869+0000 7f591517d640 1 --2- 172.21.15.104:0/3732567081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59101dd9c0 0x7f59101dde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:16.877 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.869+0000 7f591617f640 1 -- 172.21.15.104:0/3732567081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59101dd9c0 msgr2=0x7f59101dde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:16.877 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.869+0000 7f591617f640 1 --2- 172.21.15.104:0/3732567081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59101dd9c0 0x7f59101dde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:16.877 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.869+0000 7f591617f640 1 -- 172.21.15.104:0/3732567081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58fc0047c0 msgr2=0x7f5910143c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:16.877 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.869+0000 7f591617f640 1 --2- 172.21.15.104:0/3732567081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58fc0047c0 0x7f5910143c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:16.878 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.869+0000 7f591617f640 1 -- 172.21.15.104:0/3732567081 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59100afc40 con 0x7f59100ae5f0 2023-09-13T02:14:16.878 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.870+0000 7f591617f640 1 --2- 172.21.15.104:0/3732567081 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59100ae5f0 0x7f59100aea70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5910071810 tx=0x7f5908001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:16.878 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.870+0000 7f59067fc640 1 -- 172.21.15.104:0/3732567081 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5908011660 con 0x7f59100ae5f0 2023-09-13T02:14:16.879 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.870+0000 7f59067fc640 1 -- 172.21.15.104:0/3732567081 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f59080118b0 con 0x7f59100ae5f0 2023-09-13T02:14:16.879 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.870+0000 7f5917be2640 1 -- 172.21.15.104:0/3732567081 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59100aff20 con 0x7f59100ae5f0 2023-09-13T02:14:16.879 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.870+0000 7f59067fc640 1 -- 172.21.15.104:0/3732567081 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5908011cc0 con 0x7f59100ae5f0 2023-09-13T02:14:16.879 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.870+0000 7f5917be2640 1 -- 172.21.15.104:0/3732567081 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5910144950 con 0x7f59100ae5f0 2023-09-13T02:14:16.880 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.871+0000 7f5917be2640 1 -- 172.21.15.104:0/3732567081 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59100b0110 con 0x7f59100ae5f0 2023-09-13T02:14:16.880 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.871+0000 7f59067fc640 1 -- 172.21.15.104:0/3732567081 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f590801a400 con 0x7f59100ae5f0 2023-09-13T02:14:16.880 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.872+0000 7f59067fc640 1 --2- 172.21.15.104:0/3732567081 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f58f406a520 0x7f58f406c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:16.880 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.872+0000 7f591597e640 1 --2- 172.21.15.104:0/3732567081 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f58f406a520 0x7f58f406c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:16.881 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.872+0000 7f59067fc640 1 -- 172.21.15.104:0/3732567081 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f5908089260 con 0x7f59100ae5f0 2023-09-13T02:14:16.881 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.872+0000 7f591597e640 1 --2- 172.21.15.104:0/3732567081 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f58f406a520 0x7f58f406c9e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f590c005fd0 tx=0x7f590c009500 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:16.882 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:16.876+0000 7f59067fc640 1 -- 172.21.15.104:0/3732567081 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5908054890 con 0x7f59100ae5f0 2023-09-13T02:14:17.041 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:17.040+0000 7f5917be2640 1 -- 172.21.15.104:0/3732567081 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f591004e100 con 0x7f58f406a520 2023-09-13T02:14:17.048 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:17.047+0000 7f59067fc640 1 -- 172.21.15.104:0/3732567081 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+291462 (secure 0 0 0) 0x7f591004e100 con 0x7f58f406a520 2023-09-13T02:14:17.051 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:14:17.053 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2023-09-13T02:14:17.055 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:17.051+0000 7f5917be2640 1 -- 172.21.15.104:0/3732567081 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f58f406a520 msgr2=0x7f58f406c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:17.055 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:17.051+0000 7f5917be2640 1 --2- 172.21.15.104:0/3732567081 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f58f406a520 0x7f58f406c9e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f590c005fd0 tx=0x7f590c009500 comp rx=0 tx=0).stop 2023-09-13T02:14:17.055 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:17.051+0000 7f5917be2640 1 -- 172.21.15.104:0/3732567081 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59100ae5f0 msgr2=0x7f59100aea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:17.056 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:17.051+0000 7f5917be2640 1 --2- 172.21.15.104:0/3732567081 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59100ae5f0 0x7f59100aea70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5910071810 tx=0x7f5908001630 comp rx=0 tx=0).stop 2023-09-13T02:14:17.056 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:17.051+0000 7f5917be2640 1 -- 172.21.15.104:0/3732567081 shutdown_connections 2023-09-13T02:14:17.056 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:17.051+0000 7f5917be2640 1 --2- 172.21.15.104:0/3732567081 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f58f406a520 0x7f58f406c9e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:17.056 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:17.051+0000 7f5917be2640 1 --2- 172.21.15.104:0/3732567081 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59100ae5f0 0x7f59100aea70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:17.057 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:17.051+0000 7f5917be2640 1 --2- 172.21.15.104:0/3732567081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59101dd9c0 0x7f59101dde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:17.057 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:17.051+0000 7f5917be2640 1 --2- 172.21.15.104:0/3732567081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58fc0047c0 0x7f5910143c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:17.057 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:17.051+0000 7f5917be2640 1 -- 172.21.15.104:0/3732567081 >> 172.21.15.104:0/3732567081 conn(0x7f5910069360 msgr2=0x7f59100b4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:17.057 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:17.051+0000 7f5917be2640 1 -- 172.21.15.104:0/3732567081 shutdown_connections 2023-09-13T02:14:17.058 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:17.051+0000 7f5917be2640 1 -- 172.21.15.104:0/3732567081 wait complete. 2023-09-13T02:14:17.062 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-09-13T02:14:16.055354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1140753,"num_objects":30,"num_object_clones":3,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":2,"num_read":129,"num_read_kb":116,"num_write":435,"num_write_kb":3094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2955,"ondisk_log_size":2955,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220428,"kb_used_data":4300,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754292,"statfs":{"total":773094113280,"available":772868395008,"internally_reserved":0,"allocated":4403200,"data_stored":3048623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003232"},"pg_stats":[{"pgid":"3.3f","version":"22'38","reported_seq":72,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.035348+0000","last_change":"2023-09-13T02:13:33.085104+0000","last_active":"2023-09-13T02:13:44.035348+0000","last_peered":"2023-09-13T02:13:44.035348+0000","last_clean":"2023-09-13T02:13:44.035348+0000","last_became_active":"2023-09-13T02:12:24.592754+0000","last_became_peered":"2023-09-13T02:12:24.592754+0000","last_unstale":"2023-09-13T02:13:44.035348+0000","last_undegraded":"2023-09-13T02:13:44.035348+0000","last_fullsized":"2023-09-13T02:13:44.035348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013309302,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'23","reported_seq":65,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:06.724972+0000","last_change":"2023-09-13T02:14:06.725056+0000","last_active":"2023-09-13T02:14:06.724972+0000","last_peered":"2023-09-13T02:14:06.724972+0000","last_clean":"2023-09-13T02:14:06.724972+0000","last_became_active":"2023-09-13T02:12:24.579873+0000","last_became_peered":"2023-09-13T02:12:24.579873+0000","last_unstale":"2023-09-13T02:14:06.724972+0000","last_undegraded":"2023-09-13T02:14:06.724972+0000","last_fullsized":"2023-09-13T02:14:06.724972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'23","last_scrub_stamp":"2023-09-13T02:14:06.724875+0000","last_deep_scrub":"22'23","last_deep_scrub_stamp":"2023-09-13T02:14:06.724875+0000","last_clean_scrub_stamp":"2023-09-13T02:14:06.724875+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:00:34.348358+0000","scrub_duration":0.001382526,"objects_trimmed":0,"snaptrim_duration":0.0039927269999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'35","reported_seq":77,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:59.482894+0000","last_change":"2023-09-13T02:13:59.482941+0000","last_active":"2023-09-13T02:13:59.482894+0000","last_peered":"2023-09-13T02:13:59.482894+0000","last_clean":"2023-09-13T02:13:59.482894+0000","last_became_active":"2023-09-13T02:12:24.584249+0000","last_became_peered":"2023-09-13T02:12:24.584249+0000","last_unstale":"2023-09-13T02:13:59.482894+0000","last_undegraded":"2023-09-13T02:13:59.482894+0000","last_fullsized":"2023-09-13T02:13:59.482894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'35","last_scrub_stamp":"2023-09-13T02:13:59.482806+0000","last_deep_scrub":"22'35","last_deep_scrub_stamp":"2023-09-13T02:13:59.482806+0000","last_clean_scrub_stamp":"2023-09-13T02:13:59.482806+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:03:57.503453+0000","scrub_duration":0.0016009030000000001,"objects_trimmed":0,"snaptrim_duration":0.0065359670000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'37","reported_seq":71,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.243537+0000","last_change":"2023-09-13T02:13:33.083495+0000","last_active":"2023-09-13T02:13:44.243537+0000","last_peered":"2023-09-13T02:13:44.243537+0000","last_clean":"2023-09-13T02:13:44.243537+0000","last_became_active":"2023-09-13T02:12:24.595817+0000","last_became_peered":"2023-09-13T02:12:24.595817+0000","last_unstale":"2023-09-13T02:13:44.243537+0000","last_undegraded":"2023-09-13T02:13:44.243537+0000","last_fullsized":"2023-09-13T02:13:44.243537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010630479,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'25","reported_seq":67,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.034575+0000","last_change":"2023-09-13T02:13:36.092892+0000","last_active":"2023-09-13T02:13:44.034575+0000","last_peered":"2023-09-13T02:13:44.034575+0000","last_clean":"2023-09-13T02:13:44.034575+0000","last_became_active":"2023-09-13T02:12:24.591503+0000","last_became_peered":"2023-09-13T02:12:24.591503+0000","last_unstale":"2023-09-13T02:13:44.034575+0000","last_undegraded":"2023-09-13T02:13:44.034575+0000","last_fullsized":"2023-09-13T02:13:44.034575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'25","last_scrub_stamp":"2023-09-13T02:13:36.092761+0000","last_deep_scrub":"22'25","last_deep_scrub_stamp":"2023-09-13T02:13:36.092761+0000","last_clean_scrub_stamp":"2023-09-13T02:13:36.092761+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:40:10.458930+0000","scrub_duration":0.001560248,"objects_trimmed":0,"snaptrim_duration":0.013411609999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'30","reported_seq":69,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:58.305766+0000","last_change":"2023-09-13T02:13:58.305817+0000","last_active":"2023-09-13T02:13:58.305766+0000","last_peered":"2023-09-13T02:13:58.305766+0000","last_clean":"2023-09-13T02:13:58.305766+0000","last_became_active":"2023-09-13T02:13:06.365133+0000","last_became_peered":"2023-09-13T02:13:06.365133+0000","last_unstale":"2023-09-13T02:13:58.305766+0000","last_undegraded":"2023-09-13T02:13:58.305766+0000","last_fullsized":"2023-09-13T02:13:58.305766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'30","last_scrub_stamp":"2023-09-13T02:13:58.305663+0000","last_deep_scrub":"22'30","last_deep_scrub_stamp":"2023-09-13T02:13:58.305663+0000","last_clean_scrub_stamp":"2023-09-13T02:13:58.305663+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:18.870029+0000","scrub_duration":0.0015825749999999999,"objects_trimmed":0,"snaptrim_duration":0.0014597519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"22'26","reported_seq":68,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:03.892979+0000","last_change":"2023-09-13T02:14:03.893035+0000","last_active":"2023-09-13T02:14:03.892979+0000","last_peered":"2023-09-13T02:14:03.892979+0000","last_clean":"2023-09-13T02:14:03.892979+0000","last_became_active":"2023-09-13T02:12:24.590654+0000","last_became_peered":"2023-09-13T02:12:24.590654+0000","last_unstale":"2023-09-13T02:14:03.892979+0000","last_undegraded":"2023-09-13T02:14:03.892979+0000","last_fullsized":"2023-09-13T02:14:03.892979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'26","last_scrub_stamp":"2023-09-13T02:14:03.892892+0000","last_deep_scrub":"22'26","last_deep_scrub_stamp":"2023-09-13T02:14:03.892892+0000","last_clean_scrub_stamp":"2023-09-13T02:14:03.892892+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:49.431524+0000","scrub_duration":0.002047363,"objects_trimmed":0,"snaptrim_duration":0.013463309,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'37","reported_seq":71,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.539299+0000","last_change":"2023-09-13T02:13:32.969433+0000","last_active":"2023-09-13T02:13:44.539299+0000","last_peered":"2023-09-13T02:13:44.539299+0000","last_clean":"2023-09-13T02:13:44.539299+0000","last_became_active":"2023-09-13T02:12:24.588438+0000","last_became_peered":"2023-09-13T02:12:24.588438+0000","last_unstale":"2023-09-13T02:13:44.539299+0000","last_undegraded":"2023-09-13T02:13:44.539299+0000","last_fullsized":"2023-09-13T02:13:44.539299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00578898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'51","reported_seq":85,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.035320+0000","last_change":"2023-09-13T02:13:33.085446+0000","last_active":"2023-09-13T02:13:44.035320+0000","last_peered":"2023-09-13T02:13:44.035320+0000","last_clean":"2023-09-13T02:13:44.035320+0000","last_became_active":"2023-09-13T02:12:24.589606+0000","last_became_peered":"2023-09-13T02:12:24.589606+0000","last_unstale":"2023-09-13T02:13:44.035320+0000","last_undegraded":"2023-09-13T02:13:44.035320+0000","last_fullsized":"2023-09-13T02:13:44.035320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013475894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'75","reported_seq":109,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.533873+0000","last_change":"2023-09-13T02:13:33.080079+0000","last_active":"2023-09-13T02:13:44.533873+0000","last_peered":"2023-09-13T02:13:44.533873+0000","last_clean":"2023-09-13T02:13:44.533873+0000","last_became_active":"2023-09-13T02:12:24.588522+0000","last_became_peered":"2023-09-13T02:12:24.588522+0000","last_unstale":"2023-09-13T02:13:44.533873+0000","last_undegraded":"2023-09-13T02:13:44.533873+0000","last_fullsized":"2023-09-13T02:13:44.533873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069747890000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'33","reported_seq":67,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.533669+0000","last_change":"2023-09-13T02:13:33.077784+0000","last_active":"2023-09-13T02:13:44.533669+0000","last_peered":"2023-09-13T02:13:44.533669+0000","last_clean":"2023-09-13T02:13:44.533669+0000","last_became_active":"2023-09-13T02:12:24.588891+0000","last_became_peered":"2023-09-13T02:12:24.588891+0000","last_unstale":"2023-09-13T02:13:44.533669+0000","last_undegraded":"2023-09-13T02:13:44.533669+0000","last_fullsized":"2023-09-13T02:13:44.533669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069801409999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'36","reported_seq":78,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:50.510598+0000","last_change":"2023-09-13T02:13:50.510664+0000","last_active":"2023-09-13T02:13:50.510598+0000","last_peered":"2023-09-13T02:13:50.510598+0000","last_clean":"2023-09-13T02:13:50.510598+0000","last_became_active":"2023-09-13T02:12:24.587023+0000","last_became_peered":"2023-09-13T02:12:24.587023+0000","last_unstale":"2023-09-13T02:13:50.510598+0000","last_undegraded":"2023-09-13T02:13:50.510598+0000","last_fullsized":"2023-09-13T02:13:50.510598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'36","last_scrub_stamp":"2023-09-13T02:13:50.510498+0000","last_deep_scrub":"22'36","last_deep_scrub_stamp":"2023-09-13T02:13:50.510498+0000","last_clean_scrub_stamp":"2023-09-13T02:13:50.510498+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:15:32.718542+0000","scrub_duration":0.0014528880000000001,"objects_trimmed":0,"snaptrim_duration":0.002856936,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'49","reported_seq":91,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:07.560027+0000","last_change":"2023-09-13T02:14:07.560094+0000","last_active":"2023-09-13T02:14:07.560027+0000","last_peered":"2023-09-13T02:14:07.560027+0000","last_clean":"2023-09-13T02:14:07.560027+0000","last_became_active":"2023-09-13T02:12:24.587730+0000","last_became_peered":"2023-09-13T02:12:24.587730+0000","last_unstale":"2023-09-13T02:14:07.560027+0000","last_undegraded":"2023-09-13T02:14:07.560027+0000","last_fullsized":"2023-09-13T02:14:07.560027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'49","last_scrub_stamp":"2023-09-13T02:14:07.559925+0000","last_deep_scrub":"22'49","last_deep_scrub_stamp":"2023-09-13T02:14:07.559925+0000","last_clean_scrub_stamp":"2023-09-13T02:14:07.559925+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:14.725524+0000","scrub_duration":0.0018154899999999999,"objects_trimmed":0,"snaptrim_duration":0.0057195980000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'41","reported_seq":83,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:49.389442+0000","last_change":"2023-09-13T02:13:49.389523+0000","last_active":"2023-09-13T02:13:49.389442+0000","last_peered":"2023-09-13T02:13:49.389442+0000","last_clean":"2023-09-13T02:13:49.389442+0000","last_became_active":"2023-09-13T02:12:24.584734+0000","last_became_peered":"2023-09-13T02:12:24.584734+0000","last_unstale":"2023-09-13T02:13:49.389442+0000","last_undegraded":"2023-09-13T02:13:49.389442+0000","last_fullsized":"2023-09-13T02:13:49.389442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'41","last_scrub_stamp":"2023-09-13T02:13:49.389330+0000","last_deep_scrub":"22'41","last_deep_scrub_stamp":"2023-09-13T02:13:49.389330+0000","last_clean_scrub_stamp":"2023-09-13T02:13:49.389330+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:13:42.099948+0000","scrub_duration":0.00133534,"objects_trimmed":0,"snaptrim_duration":0.006295564,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'39","reported_seq":81,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:00.625131+0000","last_change":"2023-09-13T02:14:00.625195+0000","last_active":"2023-09-13T02:14:00.625131+0000","last_peered":"2023-09-13T02:14:00.625131+0000","last_clean":"2023-09-13T02:14:00.625131+0000","last_became_active":"2023-09-13T02:12:24.578553+0000","last_became_peered":"2023-09-13T02:12:24.578553+0000","last_unstale":"2023-09-13T02:14:00.625131+0000","last_undegraded":"2023-09-13T02:14:00.625131+0000","last_fullsized":"2023-09-13T02:14:00.625131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'39","last_scrub_stamp":"2023-09-13T02:14:00.625028+0000","last_deep_scrub":"22'39","last_deep_scrub_stamp":"2023-09-13T02:14:00.625028+0000","last_clean_scrub_stamp":"2023-09-13T02:14:00.625028+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:09:40.455839+0000","scrub_duration":0.0019467169999999999,"objects_trimmed":0,"snaptrim_duration":0.0041892860000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'48","reported_seq":90,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:04.216237+0000","last_change":"2023-09-13T02:14:04.216315+0000","last_active":"2023-09-13T02:14:04.216237+0000","last_peered":"2023-09-13T02:14:04.216237+0000","last_clean":"2023-09-13T02:14:04.216237+0000","last_became_active":"2023-09-13T02:12:24.590871+0000","last_became_peered":"2023-09-13T02:12:24.590871+0000","last_unstale":"2023-09-13T02:14:04.216237+0000","last_undegraded":"2023-09-13T02:14:04.216237+0000","last_fullsized":"2023-09-13T02:14:04.216237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'48","last_scrub_stamp":"2023-09-13T02:14:04.216132+0000","last_deep_scrub":"22'48","last_deep_scrub_stamp":"2023-09-13T02:14:04.216132+0000","last_clean_scrub_stamp":"2023-09-13T02:14:04.216132+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:30:25.695248+0000","scrub_duration":0.001919149,"objects_trimmed":0,"snaptrim_duration":0.0089611650000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'41","reported_seq":83,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:54.277826+0000","last_change":"2023-09-13T02:13:54.277876+0000","last_active":"2023-09-13T02:13:54.277826+0000","last_peered":"2023-09-13T02:13:54.277826+0000","last_clean":"2023-09-13T02:13:54.277826+0000","last_became_active":"2023-09-13T02:12:24.592325+0000","last_became_peered":"2023-09-13T02:12:24.592325+0000","last_unstale":"2023-09-13T02:13:54.277826+0000","last_undegraded":"2023-09-13T02:13:54.277826+0000","last_fullsized":"2023-09-13T02:13:54.277826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'41","last_scrub_stamp":"2023-09-13T02:13:54.277729+0000","last_deep_scrub":"22'41","last_deep_scrub_stamp":"2023-09-13T02:13:54.277729+0000","last_clean_scrub_stamp":"2023-09-13T02:13:54.277729+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:00:21.901212+0000","scrub_duration":0.0015243769999999999,"objects_trimmed":0,"snaptrim_duration":0.010777484,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'57","reported_seq":99,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:57.284755+0000","last_change":"2023-09-13T02:13:57.284824+0000","last_active":"2023-09-13T02:13:57.284755+0000","last_peered":"2023-09-13T02:13:57.284755+0000","last_clean":"2023-09-13T02:13:57.284755+0000","last_became_active":"2023-09-13T02:12:24.587552+0000","last_became_peered":"2023-09-13T02:12:24.587552+0000","last_unstale":"2023-09-13T02:13:57.284755+0000","last_undegraded":"2023-09-13T02:13:57.284755+0000","last_fullsized":"2023-09-13T02:13:57.284755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'57","last_scrub_stamp":"2023-09-13T02:13:57.284678+0000","last_deep_scrub":"22'57","last_deep_scrub_stamp":"2023-09-13T02:13:57.284678+0000","last_clean_scrub_stamp":"2023-09-13T02:13:57.284678+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:13:49.995296+0000","scrub_duration":0.0019501150000000001,"objects_trimmed":0,"snaptrim_duration":0.001551586,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'39","reported_seq":81,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:11.816481+0000","last_change":"2023-09-13T02:14:11.816530+0000","last_active":"2023-09-13T02:14:11.816481+0000","last_peered":"2023-09-13T02:14:11.816481+0000","last_clean":"2023-09-13T02:14:11.816481+0000","last_became_active":"2023-09-13T02:12:24.590670+0000","last_became_peered":"2023-09-13T02:12:24.590670+0000","last_unstale":"2023-09-13T02:14:11.816481+0000","last_undegraded":"2023-09-13T02:14:11.816481+0000","last_fullsized":"2023-09-13T02:14:11.816481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'39","last_scrub_stamp":"2023-09-13T02:14:11.816401+0000","last_deep_scrub":"22'39","last_deep_scrub_stamp":"2023-09-13T02:14:11.816401+0000","last_clean_scrub_stamp":"2023-09-13T02:14:11.816401+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:51:17.517058+0000","scrub_duration":0.001855329,"objects_trimmed":0,"snaptrim_duration":0.013177124,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'41","reported_seq":83,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:05.516798+0000","last_change":"2023-09-13T02:14:05.516848+0000","last_active":"2023-09-13T02:14:05.516798+0000","last_peered":"2023-09-13T02:14:05.516798+0000","last_clean":"2023-09-13T02:14:05.516798+0000","last_became_active":"2023-09-13T02:12:24.591065+0000","last_became_peered":"2023-09-13T02:12:24.591065+0000","last_unstale":"2023-09-13T02:14:05.516798+0000","last_undegraded":"2023-09-13T02:14:05.516798+0000","last_fullsized":"2023-09-13T02:14:05.516798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'41","last_scrub_stamp":"2023-09-13T02:14:05.516706+0000","last_deep_scrub":"22'41","last_deep_scrub_stamp":"2023-09-13T02:14:05.516706+0000","last_clean_scrub_stamp":"2023-09-13T02:14:05.516706+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:00:33.140189+0000","scrub_duration":0.0014842919999999999,"objects_trimmed":0,"snaptrim_duration":0.0072721169999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'56","reported_seq":98,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:56.453179+0000","last_change":"2023-09-13T02:13:56.453221+0000","last_active":"2023-09-13T02:13:56.453179+0000","last_peered":"2023-09-13T02:13:56.453179+0000","last_clean":"2023-09-13T02:13:56.453179+0000","last_became_active":"2023-09-13T02:12:24.586981+0000","last_became_peered":"2023-09-13T02:12:24.586981+0000","last_unstale":"2023-09-13T02:13:56.453179+0000","last_undegraded":"2023-09-13T02:13:56.453179+0000","last_fullsized":"2023-09-13T02:13:56.453179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'56","last_scrub_stamp":"2023-09-13T02:13:56.453097+0000","last_deep_scrub":"22'56","last_deep_scrub_stamp":"2023-09-13T02:13:56.453097+0000","last_clean_scrub_stamp":"2023-09-13T02:13:56.453097+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:09:36.283909+0000","scrub_duration":0.0021104549999999998,"objects_trimmed":0,"snaptrim_duration":0.0064443770000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'48","reported_seq":90,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:59.277707+0000","last_change":"2023-09-13T02:13:59.277760+0000","last_active":"2023-09-13T02:13:59.277707+0000","last_peered":"2023-09-13T02:13:59.277707+0000","last_clean":"2023-09-13T02:13:59.277707+0000","last_became_active":"2023-09-13T02:12:24.594351+0000","last_became_peered":"2023-09-13T02:12:24.594351+0000","last_unstale":"2023-09-13T02:13:59.277707+0000","last_undegraded":"2023-09-13T02:13:59.277707+0000","last_fullsized":"2023-09-13T02:13:59.277707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'48","last_scrub_stamp":"2023-09-13T02:13:59.277609+0000","last_deep_scrub":"22'48","last_deep_scrub_stamp":"2023-09-13T02:13:59.277609+0000","last_clean_scrub_stamp":"2023-09-13T02:13:59.277609+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:52:53.358062+0000","scrub_duration":0.0015780340000000001,"objects_trimmed":0,"snaptrim_duration":0.010224219999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'43","reported_seq":85,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:06.600873+0000","last_change":"2023-09-13T02:14:06.600922+0000","last_active":"2023-09-13T02:14:06.600873+0000","last_peered":"2023-09-13T02:14:06.600873+0000","last_clean":"2023-09-13T02:14:06.600873+0000","last_became_active":"2023-09-13T02:12:24.590295+0000","last_became_peered":"2023-09-13T02:12:24.590295+0000","last_unstale":"2023-09-13T02:14:06.600873+0000","last_undegraded":"2023-09-13T02:14:06.600873+0000","last_fullsized":"2023-09-13T02:14:06.600873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2023-09-13T02:14:06.600781+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2023-09-13T02:14:06.600781+0000","last_clean_scrub_stamp":"2023-09-13T02:14:06.600781+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:00.681233+0000","scrub_duration":0.002113799,"objects_trimmed":0,"snaptrim_duration":0.0059803399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'37","reported_seq":79,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:02.226799+0000","last_change":"2023-09-13T02:14:02.226851+0000","last_active":"2023-09-13T02:14:02.226799+0000","last_peered":"2023-09-13T02:14:02.226799+0000","last_clean":"2023-09-13T02:14:02.226799+0000","last_became_active":"2023-09-13T02:12:24.593673+0000","last_became_peered":"2023-09-13T02:12:24.593673+0000","last_unstale":"2023-09-13T02:14:02.226799+0000","last_undegraded":"2023-09-13T02:14:02.226799+0000","last_fullsized":"2023-09-13T02:14:02.226799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'37","last_scrub_stamp":"2023-09-13T02:14:02.226704+0000","last_deep_scrub":"22'37","last_deep_scrub_stamp":"2023-09-13T02:14:02.226704+0000","last_clean_scrub_stamp":"2023-09-13T02:14:02.226704+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:50:07.934525+0000","scrub_duration":0.0019959930000000002,"objects_trimmed":0,"snaptrim_duration":0.010617236,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'16","reported_seq":58,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:03.521449+0000","last_change":"2023-09-13T02:14:03.521537+0000","last_active":"2023-09-13T02:14:03.521449+0000","last_peered":"2023-09-13T02:14:03.521449+0000","last_clean":"2023-09-13T02:14:03.521449+0000","last_became_active":"2023-09-13T02:12:24.590231+0000","last_became_peered":"2023-09-13T02:12:24.590231+0000","last_unstale":"2023-09-13T02:14:03.521449+0000","last_undegraded":"2023-09-13T02:14:03.521449+0000","last_fullsized":"2023-09-13T02:14:03.521449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'16","last_scrub_stamp":"2023-09-13T02:14:03.521351+0000","last_deep_scrub":"22'16","last_deep_scrub_stamp":"2023-09-13T02:14:03.521351+0000","last_clean_scrub_stamp":"2023-09-13T02:14:03.521351+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:03:54.163016+0000","scrub_duration":0.001747406,"objects_trimmed":0,"snaptrim_duration":0.0055340570000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'68","reported_seq":109,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.534004+0000","last_change":"2023-09-13T02:13:33.079840+0000","last_active":"2023-09-13T02:13:44.534004+0000","last_peered":"2023-09-13T02:13:44.534004+0000","last_clean":"2023-09-13T02:13:44.534004+0000","last_became_active":"2023-09-13T02:13:05.916435+0000","last_became_peered":"2023-09-13T02:13:05.916435+0000","last_unstale":"2023-09-13T02:13:44.534004+0000","last_undegraded":"2023-09-13T02:13:44.534004+0000","last_fullsized":"2023-09-13T02:13:44.534004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065577700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'34","reported_seq":68,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.864655+0000","last_change":"2023-09-13T02:13:32.967761+0000","last_active":"2023-09-13T02:13:43.864655+0000","last_peered":"2023-09-13T02:13:43.864655+0000","last_clean":"2023-09-13T02:13:43.864655+0000","last_became_active":"2023-09-13T02:12:24.583782+0000","last_became_peered":"2023-09-13T02:12:24.583782+0000","last_unstale":"2023-09-13T02:13:43.864655+0000","last_undegraded":"2023-09-13T02:13:43.864655+0000","last_fullsized":"2023-09-13T02:13:43.864655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041099719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'23","reported_seq":65,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:58.492856+0000","last_change":"2023-09-13T02:13:58.492902+0000","last_active":"2023-09-13T02:13:58.492856+0000","last_peered":"2023-09-13T02:13:58.492856+0000","last_clean":"2023-09-13T02:13:58.492856+0000","last_became_active":"2023-09-13T02:12:24.590189+0000","last_became_peered":"2023-09-13T02:12:24.590189+0000","last_unstale":"2023-09-13T02:13:58.492856+0000","last_undegraded":"2023-09-13T02:13:58.492856+0000","last_fullsized":"2023-09-13T02:13:58.492856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'23","last_scrub_stamp":"2023-09-13T02:13:58.492771+0000","last_deep_scrub":"22'23","last_deep_scrub_stamp":"2023-09-13T02:13:58.492771+0000","last_clean_scrub_stamp":"2023-09-13T02:13:58.492771+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:03:56.513419+0000","scrub_duration":0.002203521,"objects_trimmed":0,"snaptrim_duration":0.005267819,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'35","reported_seq":77,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:02.502873+0000","last_change":"2023-09-13T02:14:02.502921+0000","last_active":"2023-09-13T02:14:02.502873+0000","last_peered":"2023-09-13T02:14:02.502873+0000","last_clean":"2023-09-13T02:14:02.502873+0000","last_became_active":"2023-09-13T02:12:24.583453+0000","last_became_peered":"2023-09-13T02:12:24.583453+0000","last_unstale":"2023-09-13T02:14:02.502873+0000","last_undegraded":"2023-09-13T02:14:02.502873+0000","last_fullsized":"2023-09-13T02:14:02.502873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'35","last_scrub_stamp":"2023-09-13T02:14:02.502772+0000","last_deep_scrub":"22'35","last_deep_scrub_stamp":"2023-09-13T02:14:02.502772+0000","last_clean_scrub_stamp":"2023-09-13T02:14:02.502772+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:00:30.126256+0000","scrub_duration":0.001393163,"objects_trimmed":0,"snaptrim_duration":0.0067806159999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'42","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:51.369820+0000","last_change":"2023-09-13T02:13:51.369880+0000","last_active":"2023-09-13T02:13:51.369820+0000","last_peered":"2023-09-13T02:13:51.369820+0000","last_clean":"2023-09-13T02:13:51.369820+0000","last_became_active":"2023-09-13T02:12:24.592875+0000","last_became_peered":"2023-09-13T02:12:24.592875+0000","last_unstale":"2023-09-13T02:13:51.369820+0000","last_undegraded":"2023-09-13T02:13:51.369820+0000","last_fullsized":"2023-09-13T02:13:51.369820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'42","last_scrub_stamp":"2023-09-13T02:13:51.369721+0000","last_deep_scrub":"22'42","last_deep_scrub_stamp":"2023-09-13T02:13:51.369721+0000","last_clean_scrub_stamp":"2023-09-13T02:13:51.369721+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:03:49.390369+0000","scrub_duration":0.0021232569999999999,"objects_trimmed":0,"snaptrim_duration":0.0084478739999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'55","reported_seq":97,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:51.284207+0000","last_change":"2023-09-13T02:13:51.284253+0000","last_active":"2023-09-13T02:13:51.284207+0000","last_peered":"2023-09-13T02:13:51.284207+0000","last_clean":"2023-09-13T02:13:51.284207+0000","last_became_active":"2023-09-13T02:12:24.588173+0000","last_became_peered":"2023-09-13T02:12:24.588173+0000","last_unstale":"2023-09-13T02:13:51.284207+0000","last_undegraded":"2023-09-13T02:13:51.284207+0000","last_fullsized":"2023-09-13T02:13:51.284207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2023-09-13T02:13:51.284112+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2023-09-13T02:13:51.284112+0000","last_clean_scrub_stamp":"2023-09-13T02:13:51.284112+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:27:21.238044+0000","scrub_duration":0.0016218739999999999,"objects_trimmed":0,"snaptrim_duration":0.0018416579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'45","reported_seq":87,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:10.449684+0000","last_change":"2023-09-13T02:14:10.449739+0000","last_active":"2023-09-13T02:14:10.449684+0000","last_peered":"2023-09-13T02:14:10.449684+0000","last_clean":"2023-09-13T02:14:10.449684+0000","last_became_active":"2023-09-13T02:12:24.590677+0000","last_became_peered":"2023-09-13T02:12:24.590677+0000","last_unstale":"2023-09-13T02:14:10.449684+0000","last_undegraded":"2023-09-13T02:14:10.449684+0000","last_fullsized":"2023-09-13T02:14:10.449684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'45","last_scrub_stamp":"2023-09-13T02:14:10.449590+0000","last_deep_scrub":"22'45","last_deep_scrub_stamp":"2023-09-13T02:14:10.449590+0000","last_clean_scrub_stamp":"2023-09-13T02:14:10.449590+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:04.530043+0000","scrub_duration":0.0022546419999999998,"objects_trimmed":0,"snaptrim_duration":0.0077055279999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'40","reported_seq":82,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.863153+0000","last_change":"2023-09-13T02:13:41.540019+0000","last_active":"2023-09-13T02:13:43.863153+0000","last_peered":"2023-09-13T02:13:43.863153+0000","last_clean":"2023-09-13T02:13:43.863153+0000","last_became_active":"2023-09-13T02:12:24.586251+0000","last_became_peered":"2023-09-13T02:12:24.586251+0000","last_unstale":"2023-09-13T02:13:43.863153+0000","last_undegraded":"2023-09-13T02:13:43.863153+0000","last_fullsized":"2023-09-13T02:13:43.863153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'40","last_scrub_stamp":"2023-09-13T02:13:41.539885+0000","last_deep_scrub":"22'40","last_deep_scrub_stamp":"2023-09-13T02:13:41.539885+0000","last_clean_scrub_stamp":"2023-09-13T02:13:41.539885+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:09:20.900257+0000","scrub_duration":0.0017396600000000001,"objects_trimmed":0,"snaptrim_duration":0.0032713870000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'2","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:39.513824+0000","last_change":"2023-09-13T02:13:39.513824+0000","last_active":"2023-09-13T02:13:39.513824+0000","last_peered":"2023-09-13T02:13:39.513824+0000","last_clean":"2023-09-13T02:13:39.513824+0000","last_became_active":"2023-09-13T02:12:23.578889+0000","last_became_peered":"2023-09-13T02:12:23.578889+0000","last_unstale":"2023-09-13T02:13:39.513824+0000","last_undegraded":"2023-09-13T02:13:39.513824+0000","last_fullsized":"2023-09-13T02:13:39.513824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2023-09-13T02:13:39.513697+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2023-09-13T02:13:39.513697+0000","last_clean_scrub_stamp":"2023-09-13T02:13:39.513697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:15:21.721741+0000","scrub_duration":0.0019969480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'41","reported_seq":83,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:07.427116+0000","last_change":"2023-09-13T02:14:07.427160+0000","last_active":"2023-09-13T02:14:07.427116+0000","last_peered":"2023-09-13T02:14:07.427116+0000","last_clean":"2023-09-13T02:14:07.427116+0000","last_became_active":"2023-09-13T02:12:24.579243+0000","last_became_peered":"2023-09-13T02:12:24.579243+0000","last_unstale":"2023-09-13T02:14:07.427116+0000","last_undegraded":"2023-09-13T02:14:07.427116+0000","last_fullsized":"2023-09-13T02:14:07.427116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'41","last_scrub_stamp":"2023-09-13T02:14:07.427034+0000","last_deep_scrub":"22'41","last_deep_scrub_stamp":"2023-09-13T02:14:07.427034+0000","last_clean_scrub_stamp":"2023-09-13T02:14:07.427034+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:01.507487+0000","scrub_duration":0.001872421,"objects_trimmed":0,"snaptrim_duration":0.0064049659999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:46.487455+0000","last_change":"2023-09-13T02:13:46.487501+0000","last_active":"2023-09-13T02:13:46.487455+0000","last_peered":"2023-09-13T02:13:46.487455+0000","last_clean":"2023-09-13T02:13:46.487455+0000","last_became_active":"2023-09-13T02:12:23.576754+0000","last_became_peered":"2023-09-13T02:12:23.576754+0000","last_unstale":"2023-09-13T02:13:46.487455+0000","last_undegraded":"2023-09-13T02:13:46.487455+0000","last_fullsized":"2023-09-13T02:13:46.487455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2023-09-13T02:13:46.487370+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2023-09-13T02:13:46.487370+0000","last_clean_scrub_stamp":"2023-09-13T02:13:46.487370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:28:26.543492+0000","scrub_duration":0.0014463200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:47.532140+0000","last_change":"2023-09-13T02:13:47.532221+0000","last_active":"2023-09-13T02:13:47.532140+0000","last_peered":"2023-09-13T02:13:47.532140+0000","last_clean":"2023-09-13T02:13:47.532140+0000","last_became_active":"2023-09-13T02:12:23.579351+0000","last_became_peered":"2023-09-13T02:12:23.579351+0000","last_unstale":"2023-09-13T02:13:47.532140+0000","last_undegraded":"2023-09-13T02:13:47.532140+0000","last_fullsized":"2023-09-13T02:13:47.532140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2023-09-13T02:13:47.532036+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2023-09-13T02:13:47.532036+0000","last_clean_scrub_stamp":"2023-09-13T02:13:47.532036+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:13:40.242654+0000","scrub_duration":0.002094168,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'41","reported_seq":83,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:09.580980+0000","last_change":"2023-09-13T02:14:09.581061+0000","last_active":"2023-09-13T02:14:09.580980+0000","last_peered":"2023-09-13T02:14:09.580980+0000","last_clean":"2023-09-13T02:14:09.580980+0000","last_became_active":"2023-09-13T02:12:24.590126+0000","last_became_peered":"2023-09-13T02:12:24.590126+0000","last_unstale":"2023-09-13T02:14:09.580980+0000","last_undegraded":"2023-09-13T02:14:09.580980+0000","last_fullsized":"2023-09-13T02:14:09.580980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'41","last_scrub_stamp":"2023-09-13T02:14:09.580873+0000","last_deep_scrub":"22'41","last_deep_scrub_stamp":"2023-09-13T02:14:09.580873+0000","last_clean_scrub_stamp":"2023-09-13T02:14:09.580873+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:28.502154+0000","scrub_duration":0.0014948299999999999,"objects_trimmed":0,"snaptrim_duration":0.0057346009999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:36.231609+0000","last_change":"2023-09-13T02:13:36.231609+0000","last_active":"2023-09-13T02:13:36.231609+0000","last_peered":"2023-09-13T02:13:36.231609+0000","last_clean":"2023-09-13T02:13:36.231609+0000","last_became_active":"2023-09-13T02:12:23.585953+0000","last_became_peered":"2023-09-13T02:12:23.585953+0000","last_unstale":"2023-09-13T02:13:36.231609+0000","last_undegraded":"2023-09-13T02:13:36.231609+0000","last_fullsized":"2023-09-13T02:13:36.231609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:36.231480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:36.231480+0000","last_clean_scrub_stamp":"2023-09-13T02:13:36.231480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:28:16.287602+0000","scrub_duration":0.00143738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'47","reported_seq":89,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:11.718989+0000","last_change":"2023-09-13T02:14:11.719038+0000","last_active":"2023-09-13T02:14:11.718989+0000","last_peered":"2023-09-13T02:14:11.718989+0000","last_clean":"2023-09-13T02:14:11.718989+0000","last_became_active":"2023-09-13T02:12:24.584901+0000","last_became_peered":"2023-09-13T02:12:24.584901+0000","last_unstale":"2023-09-13T02:14:11.718989+0000","last_undegraded":"2023-09-13T02:14:11.718989+0000","last_fullsized":"2023-09-13T02:14:11.718989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'47","last_scrub_stamp":"2023-09-13T02:14:11.718906+0000","last_deep_scrub":"22'47","last_deep_scrub_stamp":"2023-09-13T02:14:11.718906+0000","last_clean_scrub_stamp":"2023-09-13T02:14:11.718906+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:05.799359+0000","scrub_duration":0.001415845,"objects_trimmed":0,"snaptrim_duration":0.0047693290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:02.539856+0000","last_change":"2023-09-13T02:14:02.539903+0000","last_active":"2023-09-13T02:14:02.539856+0000","last_peered":"2023-09-13T02:14:02.539856+0000","last_clean":"2023-09-13T02:14:02.539856+0000","last_became_active":"2023-09-13T02:12:23.583305+0000","last_became_peered":"2023-09-13T02:12:23.583305+0000","last_unstale":"2023-09-13T02:14:02.539856+0000","last_undegraded":"2023-09-13T02:14:02.539856+0000","last_fullsized":"2023-09-13T02:14:02.539856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-09-13T02:14:02.539769+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-09-13T02:14:02.539769+0000","last_clean_scrub_stamp":"2023-09-13T02:14:02.539769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:04:00.560416+0000","scrub_duration":0.0014486379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'47","reported_seq":89,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:11.242502+0000","last_change":"2023-09-13T02:14:11.242556+0000","last_active":"2023-09-13T02:14:11.242502+0000","last_peered":"2023-09-13T02:14:11.242502+0000","last_clean":"2023-09-13T02:14:11.242502+0000","last_became_active":"2023-09-13T02:12:24.594434+0000","last_became_peered":"2023-09-13T02:12:24.594434+0000","last_unstale":"2023-09-13T02:14:11.242502+0000","last_undegraded":"2023-09-13T02:14:11.242502+0000","last_fullsized":"2023-09-13T02:14:11.242502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'47","last_scrub_stamp":"2023-09-13T02:14:11.242411+0000","last_deep_scrub":"22'47","last_deep_scrub_stamp":"2023-09-13T02:14:11.242411+0000","last_clean_scrub_stamp":"2023-09-13T02:14:11.242411+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:51:16.943069+0000","scrub_duration":0.001642129,"objects_trimmed":0,"snaptrim_duration":0.010662779000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'1","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:40.327213+0000","last_change":"2023-09-13T02:13:40.327213+0000","last_active":"2023-09-13T02:13:40.327213+0000","last_peered":"2023-09-13T02:13:40.327213+0000","last_clean":"2023-09-13T02:13:40.327213+0000","last_became_active":"2023-09-13T02:12:23.584657+0000","last_became_peered":"2023-09-13T02:12:23.584657+0000","last_unstale":"2023-09-13T02:13:40.327213+0000","last_undegraded":"2023-09-13T02:13:40.327213+0000","last_fullsized":"2023-09-13T02:13:40.327213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-09-13T02:13:40.327064+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-09-13T02:13:40.327064+0000","last_clean_scrub_stamp":"2023-09-13T02:13:40.327064+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:13:33.037682+0000","scrub_duration":0.0014937660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'55","reported_seq":95,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:10.437300+0000","last_change":"2023-09-13T02:14:10.437355+0000","last_active":"2023-09-13T02:14:10.437300+0000","last_peered":"2023-09-13T02:14:10.437300+0000","last_clean":"2023-09-13T02:14:10.437300+0000","last_became_active":"2023-09-13T02:12:24.588455+0000","last_became_peered":"2023-09-13T02:12:24.588455+0000","last_unstale":"2023-09-13T02:14:10.437300+0000","last_undegraded":"2023-09-13T02:14:10.437300+0000","last_fullsized":"2023-09-13T02:14:10.437300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'55","last_scrub_stamp":"2023-09-13T02:14:10.437210+0000","last_deep_scrub":"24'55","last_deep_scrub_stamp":"2023-09-13T02:14:10.437210+0000","last_clean_scrub_stamp":"2023-09-13T02:14:10.437210+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:50:16.145031+0000","scrub_duration":0.0076503229999999997,"objects_trimmed":0,"snaptrim_duration":0.0065331499999999997,"stat_sum":{"num_bytes":8,"num_objects":3,"num_object_clones":2,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'13","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:57.666838+0000","last_change":"2023-09-13T02:13:57.666920+0000","last_active":"2023-09-13T02:13:57.666838+0000","last_peered":"2023-09-13T02:13:57.666838+0000","last_clean":"2023-09-13T02:13:57.666838+0000","last_became_active":"2023-09-13T02:12:23.582506+0000","last_became_peered":"2023-09-13T02:12:23.582506+0000","last_unstale":"2023-09-13T02:13:57.666838+0000","last_undegraded":"2023-09-13T02:13:57.666838+0000","last_fullsized":"2023-09-13T02:13:57.666838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'13","last_scrub_stamp":"2023-09-13T02:13:57.666748+0000","last_deep_scrub":"24'13","last_deep_scrub_stamp":"2023-09-13T02:13:57.666748+0000","last_clean_scrub_stamp":"2023-09-13T02:13:57.666748+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:11:51.438783+0000","scrub_duration":0.0031197999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'55","reported_seq":97,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.863695+0000","last_change":"2023-09-13T02:13:42.538129+0000","last_active":"2023-09-13T02:13:43.863695+0000","last_peered":"2023-09-13T02:13:43.863695+0000","last_clean":"2023-09-13T02:13:43.863695+0000","last_became_active":"2023-09-13T02:12:24.592367+0000","last_became_peered":"2023-09-13T02:12:24.592367+0000","last_unstale":"2023-09-13T02:13:43.863695+0000","last_undegraded":"2023-09-13T02:13:43.863695+0000","last_fullsized":"2023-09-13T02:13:43.863695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2023-09-13T02:13:42.537998+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2023-09-13T02:13:42.537998+0000","last_clean_scrub_stamp":"2023-09-13T02:13:42.537998+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:58:10.391746+0000","scrub_duration":0.001467238,"objects_trimmed":0,"snaptrim_duration":0.0029315080000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'151","reported_seq":176,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:52.645698+0000","last_change":"2023-09-13T02:13:52.645787+0000","last_active":"2023-09-13T02:13:52.645698+0000","last_peered":"2023-09-13T02:13:52.645698+0000","last_clean":"2023-09-13T02:13:52.645698+0000","last_became_active":"2023-09-13T02:12:23.578748+0000","last_became_peered":"2023-09-13T02:12:23.578748+0000","last_unstale":"2023-09-13T02:13:52.645698+0000","last_undegraded":"2023-09-13T02:13:52.645698+0000","last_fullsized":"2023-09-13T02:13:52.645698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'151","last_scrub_stamp":"2023-09-13T02:13:52.645603+0000","last_deep_scrub":"24'151","last_deep_scrub_stamp":"2023-09-13T02:13:52.645603+0000","last_clean_scrub_stamp":"2023-09-13T02:13:52.645603+0000","objects_scrubbed":4,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:13.209968+0000","scrub_duration":0.0056317299999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":543794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'32","reported_seq":74,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:06.870801+0000","last_change":"2023-09-13T02:14:06.870851+0000","last_active":"2023-09-13T02:14:06.870801+0000","last_peered":"2023-09-13T02:14:06.870801+0000","last_clean":"2023-09-13T02:14:06.870801+0000","last_became_active":"2023-09-13T02:12:24.593092+0000","last_became_peered":"2023-09-13T02:12:24.593092+0000","last_unstale":"2023-09-13T02:14:06.870801+0000","last_undegraded":"2023-09-13T02:14:06.870801+0000","last_fullsized":"2023-09-13T02:14:06.870801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'32","last_scrub_stamp":"2023-09-13T02:14:06.870713+0000","last_deep_scrub":"22'32","last_deep_scrub_stamp":"2023-09-13T02:14:06.870713+0000","last_clean_scrub_stamp":"2023-09-13T02:14:06.870713+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:08:42.142155+0000","scrub_duration":0.0021163459999999999,"objects_trimmed":0,"snaptrim_duration":0.011018085,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'5","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:34.538371+0000","last_change":"2023-09-13T02:13:34.538371+0000","last_active":"2023-09-13T02:13:34.538371+0000","last_peered":"2023-09-13T02:13:34.538371+0000","last_clean":"2023-09-13T02:13:34.538371+0000","last_became_active":"2023-09-13T02:12:23.579079+0000","last_became_peered":"2023-09-13T02:12:23.579079+0000","last_unstale":"2023-09-13T02:13:34.538371+0000","last_undegraded":"2023-09-13T02:13:34.538371+0000","last_fullsized":"2023-09-13T02:13:34.538371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2023-09-13T02:13:34.538222+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2023-09-13T02:13:34.538222+0000","last_clean_scrub_stamp":"2023-09-13T02:13:34.538222+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:28:36.195030+0000","scrub_duration":0.003901832,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'52","reported_seq":94,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:50.439759+0000","last_change":"2023-09-13T02:13:50.439804+0000","last_active":"2023-09-13T02:13:50.439759+0000","last_peered":"2023-09-13T02:13:50.439759+0000","last_clean":"2023-09-13T02:13:50.439759+0000","last_became_active":"2023-09-13T02:12:24.586930+0000","last_became_peered":"2023-09-13T02:12:24.586930+0000","last_unstale":"2023-09-13T02:13:50.439759+0000","last_undegraded":"2023-09-13T02:13:50.439759+0000","last_fullsized":"2023-09-13T02:13:50.439759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'52","last_scrub_stamp":"2023-09-13T02:13:50.439661+0000","last_deep_scrub":"22'52","last_deep_scrub_stamp":"2023-09-13T02:13:50.439661+0000","last_clean_scrub_stamp":"2023-09-13T02:13:50.439661+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:11.004026+0000","scrub_duration":0.002002565,"objects_trimmed":0,"snaptrim_duration":0.0063243029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:42.241297+0000","last_change":"2023-09-13T02:13:42.241297+0000","last_active":"2023-09-13T02:13:42.241297+0000","last_peered":"2023-09-13T02:13:42.241297+0000","last_clean":"2023-09-13T02:13:42.241297+0000","last_became_active":"2023-09-13T02:12:23.585417+0000","last_became_peered":"2023-09-13T02:12:23.585417+0000","last_unstale":"2023-09-13T02:13:42.241297+0000","last_undegraded":"2023-09-13T02:13:42.241297+0000","last_fullsized":"2023-09-13T02:13:42.241297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:42.241173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:42.241173+0000","last_clean_scrub_stamp":"2023-09-13T02:13:42.241173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:39:55.326320+0000","scrub_duration":0.001782151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'73","reported_seq":115,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:04.887773+0000","last_change":"2023-09-13T02:14:04.887820+0000","last_active":"2023-09-13T02:14:04.887773+0000","last_peered":"2023-09-13T02:14:04.887773+0000","last_clean":"2023-09-13T02:14:04.887773+0000","last_became_active":"2023-09-13T02:12:24.591849+0000","last_became_peered":"2023-09-13T02:12:24.591849+0000","last_unstale":"2023-09-13T02:14:04.887773+0000","last_undegraded":"2023-09-13T02:14:04.887773+0000","last_fullsized":"2023-09-13T02:14:04.887773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'73","last_scrub_stamp":"2023-09-13T02:14:04.887684+0000","last_deep_scrub":"22'73","last_deep_scrub_stamp":"2023-09-13T02:14:04.887684+0000","last_clean_scrub_stamp":"2023-09-13T02:14:04.887684+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:30:26.366801+0000","scrub_duration":0.0015472680000000001,"objects_trimmed":0,"snaptrim_duration":0.013591097999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:45.531946+0000","last_change":"2023-09-13T02:13:45.532009+0000","last_active":"2023-09-13T02:13:45.531946+0000","last_peered":"2023-09-13T02:13:45.531946+0000","last_clean":"2023-09-13T02:13:45.531946+0000","last_became_active":"2023-09-13T02:12:23.576022+0000","last_became_peered":"2023-09-13T02:12:23.576022+0000","last_unstale":"2023-09-13T02:13:45.531946+0000","last_undegraded":"2023-09-13T02:13:45.531946+0000","last_fullsized":"2023-09-13T02:13:45.531946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:45.531836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:45.531836+0000","last_clean_scrub_stamp":"2023-09-13T02:13:45.531836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:07.611999+0000","scrub_duration":0.001749312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'33","reported_seq":67,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.533342+0000","last_change":"2023-09-13T02:13:33.079219+0000","last_active":"2023-09-13T02:13:44.533342+0000","last_peered":"2023-09-13T02:13:44.533342+0000","last_clean":"2023-09-13T02:13:44.533342+0000","last_became_active":"2023-09-13T02:12:24.591247+0000","last_became_peered":"2023-09-13T02:12:24.591247+0000","last_unstale":"2023-09-13T02:13:44.533342+0000","last_undegraded":"2023-09-13T02:13:44.533342+0000","last_fullsized":"2023-09-13T02:13:44.533342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0077636559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'13","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:40.296099+0000","last_change":"2023-09-13T02:13:40.296099+0000","last_active":"2023-09-13T02:13:40.296099+0000","last_peered":"2023-09-13T02:13:40.296099+0000","last_clean":"2023-09-13T02:13:40.296099+0000","last_became_active":"2023-09-13T02:12:23.570461+0000","last_became_peered":"2023-09-13T02:12:23.570461+0000","last_unstale":"2023-09-13T02:13:40.296099+0000","last_undegraded":"2023-09-13T02:13:40.296099+0000","last_fullsized":"2023-09-13T02:13:40.296099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'13","last_scrub_stamp":"2023-09-13T02:13:40.295924+0000","last_deep_scrub":"23'13","last_deep_scrub_stamp":"2023-09-13T02:13:40.295924+0000","last_clean_scrub_stamp":"2023-09-13T02:13:40.295924+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:09:19.656296+0000","scrub_duration":0.0091344400000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'34","reported_seq":76,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.034368+0000","last_change":"2023-09-13T02:13:43.118040+0000","last_active":"2023-09-13T02:13:44.034368+0000","last_peered":"2023-09-13T02:13:44.034368+0000","last_clean":"2023-09-13T02:13:44.034368+0000","last_became_active":"2023-09-13T02:12:24.591036+0000","last_became_peered":"2023-09-13T02:12:24.591036+0000","last_unstale":"2023-09-13T02:13:44.034368+0000","last_undegraded":"2023-09-13T02:13:44.034368+0000","last_fullsized":"2023-09-13T02:13:44.034368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'34","last_scrub_stamp":"2023-09-13T02:13:43.117902+0000","last_deep_scrub":"22'34","last_deep_scrub_stamp":"2023-09-13T02:13:43.117902+0000","last_clean_scrub_stamp":"2023-09-13T02:13:43.117902+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:03.682267+0000","scrub_duration":0.001555741,"objects_trimmed":0,"snaptrim_duration":0.013568350999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:38.593910+0000","last_change":"2023-09-13T02:13:38.593910+0000","last_active":"2023-09-13T02:13:38.593910+0000","last_peered":"2023-09-13T02:13:38.593910+0000","last_clean":"2023-09-13T02:13:38.593910+0000","last_became_active":"2023-09-13T02:12:23.584235+0000","last_became_peered":"2023-09-13T02:12:23.584235+0000","last_unstale":"2023-09-13T02:13:38.593910+0000","last_undegraded":"2023-09-13T02:13:38.593910+0000","last_fullsized":"2023-09-13T02:13:38.593910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-09-13T02:13:38.593770+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-09-13T02:13:38.593770+0000","last_clean_scrub_stamp":"2023-09-13T02:13:38.593770+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:56.569749+0000","scrub_duration":0.0037909710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'30","reported_seq":63,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.034992+0000","last_change":"2023-09-13T02:13:33.084092+0000","last_active":"2023-09-13T02:13:44.034992+0000","last_peered":"2023-09-13T02:13:44.034992+0000","last_clean":"2023-09-13T02:13:44.034992+0000","last_became_active":"2023-09-13T02:12:24.592242+0000","last_became_peered":"2023-09-13T02:12:24.592242+0000","last_unstale":"2023-09-13T02:13:44.034992+0000","last_undegraded":"2023-09-13T02:13:44.034992+0000","last_fullsized":"2023-09-13T02:13:44.034992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013102625,"stat_sum":{"num_bytes":4,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'3","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:41.313970+0000","last_change":"2023-09-13T02:13:41.313970+0000","last_active":"2023-09-13T02:13:41.313970+0000","last_peered":"2023-09-13T02:13:41.313970+0000","last_clean":"2023-09-13T02:13:41.313970+0000","last_became_active":"2023-09-13T02:12:23.577918+0000","last_became_peered":"2023-09-13T02:12:23.577918+0000","last_unstale":"2023-09-13T02:13:41.313970+0000","last_undegraded":"2023-09-13T02:13:41.313970+0000","last_fullsized":"2023-09-13T02:13:41.313970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2023-09-13T02:13:41.313825+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2023-09-13T02:13:41.313825+0000","last_clean_scrub_stamp":"2023-09-13T02:13:41.313825+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:58:09.167573+0000","scrub_duration":0.0027577909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'45","reported_seq":79,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.035529+0000","last_change":"2023-09-13T02:13:33.085600+0000","last_active":"2023-09-13T02:13:44.035529+0000","last_peered":"2023-09-13T02:13:44.035529+0000","last_clean":"2023-09-13T02:13:44.035529+0000","last_became_active":"2023-09-13T02:12:24.595462+0000","last_became_peered":"2023-09-13T02:12:24.595462+0000","last_unstale":"2023-09-13T02:13:44.035529+0000","last_undegraded":"2023-09-13T02:13:44.035529+0000","last_fullsized":"2023-09-13T02:13:44.035529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013458447,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'2","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:54.743293+0000","last_change":"2023-09-13T02:13:54.743389+0000","last_active":"2023-09-13T02:13:54.743293+0000","last_peered":"2023-09-13T02:13:54.743293+0000","last_clean":"2023-09-13T02:13:54.743293+0000","last_became_active":"2023-09-13T02:12:23.570066+0000","last_became_peered":"2023-09-13T02:12:23.570066+0000","last_unstale":"2023-09-13T02:13:54.743293+0000","last_undegraded":"2023-09-13T02:13:54.743293+0000","last_fullsized":"2023-09-13T02:13:54.743293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2023-09-13T02:13:54.743199+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2023-09-13T02:13:54.743199+0000","last_clean_scrub_stamp":"2023-09-13T02:13:54.743199+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:13:47.453817+0000","scrub_duration":0.0038240399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'35","reported_seq":77,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:03.232122+0000","last_change":"2023-09-13T02:14:03.232171+0000","last_active":"2023-09-13T02:14:03.232122+0000","last_peered":"2023-09-13T02:14:03.232122+0000","last_clean":"2023-09-13T02:14:03.232122+0000","last_became_active":"2023-09-13T02:12:24.595327+0000","last_became_peered":"2023-09-13T02:12:24.595327+0000","last_unstale":"2023-09-13T02:14:03.232122+0000","last_undegraded":"2023-09-13T02:14:03.232122+0000","last_fullsized":"2023-09-13T02:14:03.232122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'35","last_scrub_stamp":"2023-09-13T02:14:03.232026+0000","last_deep_scrub":"22'35","last_deep_scrub_stamp":"2023-09-13T02:14:03.232026+0000","last_clean_scrub_stamp":"2023-09-13T02:14:03.232026+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:48.770658+0000","scrub_duration":0.0022005940000000002,"objects_trimmed":0,"snaptrim_duration":0.010369821,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'2","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:49.342539+0000","last_change":"2023-09-13T02:13:49.342605+0000","last_active":"2023-09-13T02:13:49.342539+0000","last_peered":"2023-09-13T02:13:49.342539+0000","last_clean":"2023-09-13T02:13:49.342539+0000","last_became_active":"2023-09-13T02:12:23.582841+0000","last_became_peered":"2023-09-13T02:12:23.582841+0000","last_unstale":"2023-09-13T02:13:49.342539+0000","last_undegraded":"2023-09-13T02:13:49.342539+0000","last_fullsized":"2023-09-13T02:13:49.342539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2023-09-13T02:13:49.342427+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2023-09-13T02:13:49.342427+0000","last_clean_scrub_stamp":"2023-09-13T02:13:49.342427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:15:31.550471+0000","scrub_duration":0.002249348,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'38","reported_seq":80,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:07.862036+0000","last_change":"2023-09-13T02:14:07.862095+0000","last_active":"2023-09-13T02:14:07.862036+0000","last_peered":"2023-09-13T02:14:07.862036+0000","last_clean":"2023-09-13T02:14:07.862036+0000","last_became_active":"2023-09-13T02:12:24.590343+0000","last_became_peered":"2023-09-13T02:12:24.590343+0000","last_unstale":"2023-09-13T02:14:07.862036+0000","last_undegraded":"2023-09-13T02:14:07.862036+0000","last_fullsized":"2023-09-13T02:14:07.862036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'38","last_scrub_stamp":"2023-09-13T02:14:07.861943+0000","last_deep_scrub":"22'38","last_deep_scrub_stamp":"2023-09-13T02:14:07.861943+0000","last_clean_scrub_stamp":"2023-09-13T02:14:07.861943+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:55:10.756889+0000","scrub_duration":0.001410721,"objects_trimmed":0,"snaptrim_duration":0.013157841999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"24'119","reported_seq":180,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.132025+0000","last_change":"2023-09-13T02:13:44.132100+0000","last_active":"2023-09-13T02:13:44.132025+0000","last_peered":"2023-09-13T02:13:44.132025+0000","last_clean":"2023-09-13T02:13:44.132025+0000","last_became_active":"2023-09-13T02:12:13.260630+0000","last_became_peered":"2023-09-13T02:12:13.260630+0000","last_unstale":"2023-09-13T02:13:44.132025+0000","last_undegraded":"2023-09-13T02:13:44.132025+0000","last_fullsized":"2023-09-13T02:13:44.132025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'119","last_scrub_stamp":"2023-09-13T02:13:44.131943+0000","last_deep_scrub":"24'119","last_deep_scrub_stamp":"2023-09-13T02:13:44.131943+0000","last_clean_scrub_stamp":"2023-09-13T02:13:44.131943+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:39:57.217089+0000","scrub_duration":0.0082749480000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:35.245588+0000","last_change":"2023-09-13T02:13:35.245588+0000","last_active":"2023-09-13T02:13:35.245588+0000","last_peered":"2023-09-13T02:13:35.245588+0000","last_clean":"2023-09-13T02:13:35.245588+0000","last_became_active":"2023-09-13T02:12:23.583874+0000","last_became_peered":"2023-09-13T02:12:23.583874+0000","last_unstale":"2023-09-13T02:13:35.245588+0000","last_undegraded":"2023-09-13T02:13:35.245588+0000","last_fullsized":"2023-09-13T02:13:35.245588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:35.245450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:35.245450+0000","last_clean_scrub_stamp":"2023-09-13T02:13:35.245450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:18:57.325613+0000","scrub_duration":0.0016768289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'35","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:48.551086+0000","last_change":"2023-09-13T02:13:48.551133+0000","last_active":"2023-09-13T02:13:48.551086+0000","last_peered":"2023-09-13T02:13:48.551086+0000","last_clean":"2023-09-13T02:13:48.551086+0000","last_became_active":"2023-09-13T02:13:05.918736+0000","last_became_peered":"2023-09-13T02:13:05.918736+0000","last_unstale":"2023-09-13T02:13:48.551086+0000","last_undegraded":"2023-09-13T02:13:48.551086+0000","last_fullsized":"2023-09-13T02:13:48.551086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'35","last_scrub_stamp":"2023-09-13T02:13:48.550991+0000","last_deep_scrub":"22'35","last_deep_scrub_stamp":"2023-09-13T02:13:48.550991+0000","last_clean_scrub_stamp":"2023-09-13T02:13:48.550991+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:09.115357+0000","scrub_duration":0.001473416,"objects_trimmed":0,"snaptrim_duration":0.0055331570000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"22'1","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:55.021064+0000","last_change":"2023-09-13T02:13:55.021108+0000","last_active":"2023-09-13T02:13:55.021064+0000","last_peered":"2023-09-13T02:13:55.021064+0000","last_clean":"2023-09-13T02:13:55.021064+0000","last_became_active":"2023-09-13T02:12:23.580670+0000","last_became_peered":"2023-09-13T02:12:23.580670+0000","last_unstale":"2023-09-13T02:13:55.021064+0000","last_undegraded":"2023-09-13T02:13:55.021064+0000","last_fullsized":"2023-09-13T02:13:55.021064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-09-13T02:13:55.020970+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-09-13T02:13:55.020970+0000","last_clean_scrub_stamp":"2023-09-13T02:13:55.020970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:00:22.644454+0000","scrub_duration":0.002331919,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'24","reported_seq":66,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.125745+0000","last_change":"2023-09-13T02:13:43.492872+0000","last_active":"2023-09-13T02:13:44.125745+0000","last_peered":"2023-09-13T02:13:44.125745+0000","last_clean":"2023-09-13T02:13:44.125745+0000","last_became_active":"2023-09-13T02:12:24.578715+0000","last_became_peered":"2023-09-13T02:12:24.578715+0000","last_unstale":"2023-09-13T02:13:44.125745+0000","last_undegraded":"2023-09-13T02:13:44.125745+0000","last_fullsized":"2023-09-13T02:13:44.125745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2023-09-13T02:13:43.492725+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2023-09-13T02:13:43.492725+0000","last_clean_scrub_stamp":"2023-09-13T02:13:43.492725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:05.572888+0000","scrub_duration":0.001908161,"objects_trimmed":0,"snaptrim_duration":0.0043944989999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'15","reported_seq":53,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:37.258923+0000","last_change":"2023-09-13T02:13:37.258923+0000","last_active":"2023-09-13T02:13:37.258923+0000","last_peered":"2023-09-13T02:13:37.258923+0000","last_clean":"2023-09-13T02:13:37.258923+0000","last_became_active":"2023-09-13T02:12:23.577786+0000","last_became_peered":"2023-09-13T02:12:23.577786+0000","last_unstale":"2023-09-13T02:13:37.258923+0000","last_undegraded":"2023-09-13T02:13:37.258923+0000","last_fullsized":"2023-09-13T02:13:37.258923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'15","last_scrub_stamp":"2023-09-13T02:13:37.258768+0000","last_deep_scrub":"22'15","last_deep_scrub_stamp":"2023-09-13T02:13:37.258768+0000","last_clean_scrub_stamp":"2023-09-13T02:13:37.258768+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:55.234747+0000","scrub_duration":0.001911905,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5781,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":13,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'46","reported_seq":88,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:03.687592+0000","last_change":"2023-09-13T02:14:03.687651+0000","last_active":"2023-09-13T02:14:03.687592+0000","last_peered":"2023-09-13T02:14:03.687592+0000","last_clean":"2023-09-13T02:14:03.687592+0000","last_became_active":"2023-09-13T02:12:24.582439+0000","last_became_peered":"2023-09-13T02:12:24.582439+0000","last_unstale":"2023-09-13T02:14:03.687592+0000","last_undegraded":"2023-09-13T02:14:03.687592+0000","last_fullsized":"2023-09-13T02:14:03.687592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'46","last_scrub_stamp":"2023-09-13T02:14:03.687510+0000","last_deep_scrub":"22'46","last_deep_scrub_stamp":"2023-09-13T02:14:03.687510+0000","last_clean_scrub_stamp":"2023-09-13T02:14:03.687510+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:04:01.708158+0000","scrub_duration":0.001478236,"objects_trimmed":0,"snaptrim_duration":0.003781501,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:41.290553+0000","last_change":"2023-09-13T02:13:41.290553+0000","last_active":"2023-09-13T02:13:41.290553+0000","last_peered":"2023-09-13T02:13:41.290553+0000","last_clean":"2023-09-13T02:13:41.290553+0000","last_became_active":"2023-09-13T02:12:23.585349+0000","last_became_peered":"2023-09-13T02:12:23.585349+0000","last_unstale":"2023-09-13T02:13:41.290553+0000","last_undegraded":"2023-09-13T02:13:41.290553+0000","last_fullsized":"2023-09-13T02:13:41.290553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:41.290413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:41.290413+0000","last_clean_scrub_stamp":"2023-09-13T02:13:41.290413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:01.854778+0000","scrub_duration":0.0021446849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'33","reported_seq":75,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.863868+0000","last_change":"2023-09-13T02:13:43.543289+0000","last_active":"2023-09-13T02:13:43.863868+0000","last_peered":"2023-09-13T02:13:43.863868+0000","last_clean":"2023-09-13T02:13:43.863868+0000","last_became_active":"2023-09-13T02:12:24.585054+0000","last_became_peered":"2023-09-13T02:12:24.585054+0000","last_unstale":"2023-09-13T02:13:43.863868+0000","last_undegraded":"2023-09-13T02:13:43.863868+0000","last_fullsized":"2023-09-13T02:13:43.863868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'33","last_scrub_stamp":"2023-09-13T02:13:43.543086+0000","last_deep_scrub":"22'33","last_deep_scrub_stamp":"2023-09-13T02:13:43.543086+0000","last_clean_scrub_stamp":"2023-09-13T02:13:43.543086+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:28:45.199893+0000","scrub_duration":0.001743007,"objects_trimmed":0,"snaptrim_duration":0.0030300140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:46.777555+0000","last_change":"2023-09-13T02:13:46.777621+0000","last_active":"2023-09-13T02:13:46.777555+0000","last_peered":"2023-09-13T02:13:46.777555+0000","last_clean":"2023-09-13T02:13:46.777555+0000","last_became_active":"2023-09-13T02:12:23.579844+0000","last_became_peered":"2023-09-13T02:12:23.579844+0000","last_unstale":"2023-09-13T02:13:46.777555+0000","last_undegraded":"2023-09-13T02:13:46.777555+0000","last_fullsized":"2023-09-13T02:13:46.777555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:46.777446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:46.777446+0000","last_clean_scrub_stamp":"2023-09-13T02:13:46.777446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:15:28.985490+0000","scrub_duration":0.001613361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'32","reported_seq":74,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:00.233003+0000","last_change":"2023-09-13T02:14:00.233057+0000","last_active":"2023-09-13T02:14:00.233003+0000","last_peered":"2023-09-13T02:14:00.233003+0000","last_clean":"2023-09-13T02:14:00.233003+0000","last_became_active":"2023-09-13T02:12:24.592436+0000","last_became_peered":"2023-09-13T02:12:24.592436+0000","last_unstale":"2023-09-13T02:14:00.233003+0000","last_undegraded":"2023-09-13T02:14:00.233003+0000","last_fullsized":"2023-09-13T02:14:00.233003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'32","last_scrub_stamp":"2023-09-13T02:14:00.232906+0000","last_deep_scrub":"22'32","last_deep_scrub_stamp":"2023-09-13T02:14:00.232906+0000","last_clean_scrub_stamp":"2023-09-13T02:14:00.232906+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:07.398505+0000","scrub_duration":0.0021228039999999998,"objects_trimmed":0,"snaptrim_duration":0.010782369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:00.873172+0000","last_change":"2023-09-13T02:14:00.873236+0000","last_active":"2023-09-13T02:14:00.873172+0000","last_peered":"2023-09-13T02:14:00.873172+0000","last_clean":"2023-09-13T02:14:00.873172+0000","last_became_active":"2023-09-13T02:12:23.585411+0000","last_became_peered":"2023-09-13T02:12:23.585411+0000","last_unstale":"2023-09-13T02:14:00.873172+0000","last_undegraded":"2023-09-13T02:14:00.873172+0000","last_fullsized":"2023-09-13T02:14:00.873172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:14:00.873057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:14:00.873057+0000","last_clean_scrub_stamp":"2023-09-13T02:14:00.873057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:08.038656+0000","scrub_duration":0.001554197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'45","reported_seq":79,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.864235+0000","last_change":"2023-09-13T02:13:32.968005+0000","last_active":"2023-09-13T02:13:43.864235+0000","last_peered":"2023-09-13T02:13:43.864235+0000","last_clean":"2023-09-13T02:13:43.864235+0000","last_became_active":"2023-09-13T02:12:24.582517+0000","last_became_peered":"2023-09-13T02:12:24.582517+0000","last_unstale":"2023-09-13T02:13:43.864235+0000","last_undegraded":"2023-09-13T02:13:43.864235+0000","last_fullsized":"2023-09-13T02:13:43.864235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039709990000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'6","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:48.787190+0000","last_change":"2023-09-13T02:13:48.787277+0000","last_active":"2023-09-13T02:13:48.787190+0000","last_peered":"2023-09-13T02:13:48.787190+0000","last_clean":"2023-09-13T02:13:48.787190+0000","last_became_active":"2023-09-13T02:12:23.575875+0000","last_became_peered":"2023-09-13T02:12:23.575875+0000","last_unstale":"2023-09-13T02:13:48.787190+0000","last_undegraded":"2023-09-13T02:13:48.787190+0000","last_fullsized":"2023-09-13T02:13:48.787190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2023-09-13T02:13:48.787080+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2023-09-13T02:13:48.787080+0000","last_clean_scrub_stamp":"2023-09-13T02:13:48.787080+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:10.867244+0000","scrub_duration":0.0022005359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'31","reported_seq":73,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:11.558539+0000","last_change":"2023-09-13T02:14:11.558588+0000","last_active":"2023-09-13T02:14:11.558539+0000","last_peered":"2023-09-13T02:14:11.558539+0000","last_clean":"2023-09-13T02:14:11.558539+0000","last_became_active":"2023-09-13T02:12:24.592247+0000","last_became_peered":"2023-09-13T02:12:24.592247+0000","last_unstale":"2023-09-13T02:14:11.558539+0000","last_undegraded":"2023-09-13T02:14:11.558539+0000","last_fullsized":"2023-09-13T02:14:11.558539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'31","last_scrub_stamp":"2023-09-13T02:14:11.558445+0000","last_deep_scrub":"22'31","last_deep_scrub_stamp":"2023-09-13T02:14:11.558445+0000","last_clean_scrub_stamp":"2023-09-13T02:14:11.558445+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:57.097078+0000","scrub_duration":0.001809022,"objects_trimmed":0,"snaptrim_duration":0.005600257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'5","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:53.637440+0000","last_change":"2023-09-13T02:13:53.637482+0000","last_active":"2023-09-13T02:13:53.637440+0000","last_peered":"2023-09-13T02:13:53.637440+0000","last_clean":"2023-09-13T02:13:53.637440+0000","last_became_active":"2023-09-13T02:12:23.579389+0000","last_became_peered":"2023-09-13T02:12:23.579389+0000","last_unstale":"2023-09-13T02:13:53.637440+0000","last_undegraded":"2023-09-13T02:13:53.637440+0000","last_fullsized":"2023-09-13T02:13:53.637440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5","last_scrub_stamp":"2023-09-13T02:13:53.637361+0000","last_deep_scrub":"24'5","last_deep_scrub_stamp":"2023-09-13T02:13:53.637361+0000","last_clean_scrub_stamp":"2023-09-13T02:13:53.637361+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:40:06.722507+0000","scrub_duration":0.0027642069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'42","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:51.458114+0000","last_change":"2023-09-13T02:13:51.458182+0000","last_active":"2023-09-13T02:13:51.458114+0000","last_peered":"2023-09-13T02:13:51.458114+0000","last_clean":"2023-09-13T02:13:51.458114+0000","last_became_active":"2023-09-13T02:12:24.584791+0000","last_became_peered":"2023-09-13T02:12:24.584791+0000","last_unstale":"2023-09-13T02:13:51.458114+0000","last_undegraded":"2023-09-13T02:13:51.458114+0000","last_fullsized":"2023-09-13T02:13:51.458114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'42","last_scrub_stamp":"2023-09-13T02:13:51.458031+0000","last_deep_scrub":"22'42","last_deep_scrub_stamp":"2023-09-13T02:13:51.458031+0000","last_clean_scrub_stamp":"2023-09-13T02:13:51.458031+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:40:04.543178+0000","scrub_duration":0.001389373,"objects_trimmed":0,"snaptrim_duration":0.0066515319999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'1","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:49.025031+0000","last_change":"2023-09-13T02:13:49.025087+0000","last_active":"2023-09-13T02:13:49.025031+0000","last_peered":"2023-09-13T02:13:49.025031+0000","last_clean":"2023-09-13T02:13:49.025031+0000","last_became_active":"2023-09-13T02:12:23.585321+0000","last_became_peered":"2023-09-13T02:12:23.585321+0000","last_unstale":"2023-09-13T02:13:49.025031+0000","last_undegraded":"2023-09-13T02:13:49.025031+0000","last_fullsized":"2023-09-13T02:13:49.025031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-09-13T02:13:49.024944+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-09-13T02:13:49.024944+0000","last_clean_scrub_stamp":"2023-09-13T02:13:49.024944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:09:28.855756+0000","scrub_duration":0.001872844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'13","reported_seq":55,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:52.536398+0000","last_change":"2023-09-13T02:13:52.536493+0000","last_active":"2023-09-13T02:13:52.536398+0000","last_peered":"2023-09-13T02:13:52.536398+0000","last_clean":"2023-09-13T02:13:52.536398+0000","last_became_active":"2023-09-13T02:12:24.586072+0000","last_became_peered":"2023-09-13T02:12:24.586072+0000","last_unstale":"2023-09-13T02:13:52.536398+0000","last_undegraded":"2023-09-13T02:13:52.536398+0000","last_fullsized":"2023-09-13T02:13:52.536398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'13","last_scrub_stamp":"2023-09-13T02:13:52.536294+0000","last_deep_scrub":"22'13","last_deep_scrub_stamp":"2023-09-13T02:13:52.536294+0000","last_clean_scrub_stamp":"2023-09-13T02:13:52.536294+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:14.616457+0000","scrub_duration":0.0021574200000000002,"objects_trimmed":0,"snaptrim_duration":0.002920593,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:35.678606+0000","last_change":"2023-09-13T02:13:35.678606+0000","last_active":"2023-09-13T02:13:35.678606+0000","last_peered":"2023-09-13T02:13:35.678606+0000","last_clean":"2023-09-13T02:13:35.678606+0000","last_became_active":"2023-09-13T02:12:23.578649+0000","last_became_peered":"2023-09-13T02:12:23.578649+0000","last_unstale":"2023-09-13T02:13:35.678606+0000","last_undegraded":"2023-09-13T02:13:35.678606+0000","last_fullsized":"2023-09-13T02:13:35.678606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:35.678498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:35.678498+0000","last_clean_scrub_stamp":"2023-09-13T02:13:35.678498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:09:15.038871+0000","scrub_duration":0.0013642319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'43","reported_seq":82,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:00.258233+0000","last_change":"2023-09-13T02:14:00.258280+0000","last_active":"2023-09-13T02:14:00.258233+0000","last_peered":"2023-09-13T02:14:00.258233+0000","last_clean":"2023-09-13T02:14:00.258233+0000","last_became_active":"2023-09-13T02:13:05.914007+0000","last_became_peered":"2023-09-13T02:13:05.914007+0000","last_unstale":"2023-09-13T02:14:00.258233+0000","last_undegraded":"2023-09-13T02:14:00.258233+0000","last_fullsized":"2023-09-13T02:14:00.258233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2023-09-13T02:14:00.258150+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2023-09-13T02:14:00.258150+0000","last_clean_scrub_stamp":"2023-09-13T02:14:00.258150+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:41:40.682053+0000","scrub_duration":0.0014043689999999999,"objects_trimmed":0,"snaptrim_duration":0.0012388329999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:55.748830+0000","last_change":"2023-09-13T02:13:55.748877+0000","last_active":"2023-09-13T02:13:55.748830+0000","last_peered":"2023-09-13T02:13:55.748830+0000","last_clean":"2023-09-13T02:13:55.748830+0000","last_became_active":"2023-09-13T02:12:23.578121+0000","last_became_peered":"2023-09-13T02:12:23.578121+0000","last_unstale":"2023-09-13T02:13:55.748830+0000","last_undegraded":"2023-09-13T02:13:55.748830+0000","last_fullsized":"2023-09-13T02:13:55.748830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-09-13T02:13:55.748727+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-09-13T02:13:55.748727+0000","last_clean_scrub_stamp":"2023-09-13T02:13:55.748727+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:16.313093+0000","scrub_duration":0.0014883450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'42","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:50.542763+0000","last_change":"2023-09-13T02:13:50.542813+0000","last_active":"2023-09-13T02:13:50.542763+0000","last_peered":"2023-09-13T02:13:50.542763+0000","last_clean":"2023-09-13T02:13:50.542763+0000","last_became_active":"2023-09-13T02:12:24.587040+0000","last_became_peered":"2023-09-13T02:12:24.587040+0000","last_unstale":"2023-09-13T02:13:50.542763+0000","last_undegraded":"2023-09-13T02:13:50.542763+0000","last_fullsized":"2023-09-13T02:13:50.542763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'42","last_scrub_stamp":"2023-09-13T02:13:50.542679+0000","last_deep_scrub":"22'42","last_deep_scrub_stamp":"2023-09-13T02:13:50.542679+0000","last_clean_scrub_stamp":"2023-09-13T02:13:50.542679+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:41:30.966582+0000","scrub_duration":0.0013316300000000001,"objects_trimmed":0,"snaptrim_duration":0.0055712349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'5","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:52.003358+0000","last_change":"2023-09-13T02:13:52.003423+0000","last_active":"2023-09-13T02:13:52.003358+0000","last_peered":"2023-09-13T02:13:52.003358+0000","last_clean":"2023-09-13T02:13:52.003358+0000","last_became_active":"2023-09-13T02:12:23.578258+0000","last_became_peered":"2023-09-13T02:12:23.578258+0000","last_unstale":"2023-09-13T02:13:52.003358+0000","last_undegraded":"2023-09-13T02:13:52.003358+0000","last_fullsized":"2023-09-13T02:13:52.003358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5","last_scrub_stamp":"2023-09-13T02:13:52.003272+0000","last_deep_scrub":"24'5","last_deep_scrub_stamp":"2023-09-13T02:13:52.003272+0000","last_clean_scrub_stamp":"2023-09-13T02:13:52.003272+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:03:50.023919+0000","scrub_duration":0.0027335189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'29","reported_seq":63,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.533487+0000","last_change":"2023-09-13T02:13:33.075939+0000","last_active":"2023-09-13T02:13:44.533487+0000","last_peered":"2023-09-13T02:13:44.533487+0000","last_clean":"2023-09-13T02:13:44.533487+0000","last_became_active":"2023-09-13T02:12:24.590494+0000","last_became_peered":"2023-09-13T02:12:24.590494+0000","last_unstale":"2023-09-13T02:13:44.533487+0000","last_undegraded":"2023-09-13T02:13:44.533487+0000","last_fullsized":"2023-09-13T02:13:44.533487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050570779999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'70","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.244009+0000","last_change":"2023-09-13T02:13:33.083960+0000","last_active":"2023-09-13T02:13:44.244009+0000","last_peered":"2023-09-13T02:13:44.244009+0000","last_clean":"2023-09-13T02:13:44.244009+0000","last_became_active":"2023-09-13T02:12:24.597024+0000","last_became_peered":"2023-09-13T02:12:24.597024+0000","last_unstale":"2023-09-13T02:13:44.244009+0000","last_undegraded":"2023-09-13T02:13:44.244009+0000","last_fullsized":"2023-09-13T02:13:44.244009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010975594999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"24'3","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:59.919484+0000","last_change":"2023-09-13T02:13:59.919540+0000","last_active":"2023-09-13T02:13:59.919484+0000","last_peered":"2023-09-13T02:13:59.919484+0000","last_clean":"2023-09-13T02:13:59.919484+0000","last_became_active":"2023-09-13T02:12:23.584671+0000","last_became_peered":"2023-09-13T02:12:23.584671+0000","last_unstale":"2023-09-13T02:13:59.919484+0000","last_undegraded":"2023-09-13T02:13:59.919484+0000","last_fullsized":"2023-09-13T02:13:59.919484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2023-09-13T02:13:59.919401+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2023-09-13T02:13:59.919401+0000","last_clean_scrub_stamp":"2023-09-13T02:13:59.919401+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:52:53.999854+0000","scrub_duration":0.0025323730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'41","reported_seq":83,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:10.221150+0000","last_change":"2023-09-13T02:14:10.221207+0000","last_active":"2023-09-13T02:14:10.221150+0000","last_peered":"2023-09-13T02:14:10.221150+0000","last_clean":"2023-09-13T02:14:10.221150+0000","last_became_active":"2023-09-13T02:12:24.595918+0000","last_became_peered":"2023-09-13T02:12:24.595918+0000","last_unstale":"2023-09-13T02:14:10.221150+0000","last_undegraded":"2023-09-13T02:14:10.221150+0000","last_fullsized":"2023-09-13T02:14:10.221150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'41","last_scrub_stamp":"2023-09-13T02:14:10.221043+0000","last_deep_scrub":"22'41","last_deep_scrub_stamp":"2023-09-13T02:14:10.221043+0000","last_clean_scrub_stamp":"2023-09-13T02:14:10.221043+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:25:34.091614+0000","scrub_duration":0.001603978,"objects_trimmed":0,"snaptrim_duration":0.010091243999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'4","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:01.850933+0000","last_change":"2023-09-13T02:14:01.850989+0000","last_active":"2023-09-13T02:14:01.850933+0000","last_peered":"2023-09-13T02:14:01.850933+0000","last_clean":"2023-09-13T02:14:01.850933+0000","last_became_active":"2023-09-13T02:12:23.579239+0000","last_became_peered":"2023-09-13T02:12:23.579239+0000","last_unstale":"2023-09-13T02:14:01.850933+0000","last_undegraded":"2023-09-13T02:14:01.850933+0000","last_fullsized":"2023-09-13T02:14:01.850933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4","last_scrub_stamp":"2023-09-13T02:14:01.850843+0000","last_deep_scrub":"24'4","last_deep_scrub_stamp":"2023-09-13T02:14:01.850843+0000","last_clean_scrub_stamp":"2023-09-13T02:14:01.850843+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:20.772124+0000","scrub_duration":0.0027872470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'35","reported_seq":77,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:08.402529+0000","last_change":"2023-09-13T02:14:08.402576+0000","last_active":"2023-09-13T02:14:08.402529+0000","last_peered":"2023-09-13T02:14:08.402529+0000","last_clean":"2023-09-13T02:14:08.402529+0000","last_became_active":"2023-09-13T02:12:24.589039+0000","last_became_peered":"2023-09-13T02:12:24.589039+0000","last_unstale":"2023-09-13T02:14:08.402529+0000","last_undegraded":"2023-09-13T02:14:08.402529+0000","last_fullsized":"2023-09-13T02:14:08.402529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'35","last_scrub_stamp":"2023-09-13T02:14:08.402426+0000","last_deep_scrub":"22'35","last_deep_scrub_stamp":"2023-09-13T02:14:08.402426+0000","last_clean_scrub_stamp":"2023-09-13T02:14:08.402426+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:15.568026+0000","scrub_duration":0.001868813,"objects_trimmed":0,"snaptrim_duration":0.0066201710000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:41.502547+0000","last_change":"2023-09-13T02:13:41.502547+0000","last_active":"2023-09-13T02:13:41.502547+0000","last_peered":"2023-09-13T02:13:41.502547+0000","last_clean":"2023-09-13T02:13:41.502547+0000","last_became_active":"2023-09-13T02:12:23.583920+0000","last_became_peered":"2023-09-13T02:12:23.583920+0000","last_unstale":"2023-09-13T02:13:41.502547+0000","last_undegraded":"2023-09-13T02:13:41.502547+0000","last_fullsized":"2023-09-13T02:13:41.502547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2023-09-13T02:13:41.502420+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2023-09-13T02:13:41.502420+0000","last_clean_scrub_stamp":"2023-09-13T02:13:41.502420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:27:11.456352+0000","scrub_duration":0.001286082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'26","reported_seq":60,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.539953+0000","last_change":"2023-09-13T02:13:32.969716+0000","last_active":"2023-09-13T02:13:44.539953+0000","last_peered":"2023-09-13T02:13:44.539953+0000","last_clean":"2023-09-13T02:13:44.539953+0000","last_became_active":"2023-09-13T02:12:24.587697+0000","last_became_peered":"2023-09-13T02:12:24.587697+0000","last_unstale":"2023-09-13T02:13:44.539953+0000","last_undegraded":"2023-09-13T02:13:44.539953+0000","last_fullsized":"2023-09-13T02:13:44.539953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:12:23.560171+0000","last_clean_scrub_stamp":"2023-09-13T02:12:23.560171+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056801320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'7","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:41.484295+0000","last_change":"2023-09-13T02:13:41.484295+0000","last_active":"2023-09-13T02:13:41.484295+0000","last_peered":"2023-09-13T02:13:41.484295+0000","last_clean":"2023-09-13T02:13:41.484295+0000","last_became_active":"2023-09-13T02:12:23.583443+0000","last_became_peered":"2023-09-13T02:12:23.583443+0000","last_unstale":"2023-09-13T02:13:41.484295+0000","last_undegraded":"2023-09-13T02:13:41.484295+0000","last_fullsized":"2023-09-13T02:13:41.484295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2023-09-13T02:13:41.484120+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2023-09-13T02:13:41.484120+0000","last_clean_scrub_stamp":"2023-09-13T02:13:41.484120+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:15:23.692164+0000","scrub_duration":0.0038019579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":12,"num_objects":5,"num_object_clones":3,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":24,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2588,"ondisk_log_size":2588,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":550373,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":219,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1163264,"data_stored":1100746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":248,"ondisk_log_size":248,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":856064,"data_stored":686971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.625},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.67200000000000004}]},{"osd":2,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.63700000000000001}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.68899999999999995}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.56499999999999995}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.58999999999999997}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":806912,"data_stored":639811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.57999999999999996}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.53700000000000003}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.56000000000000005}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.627}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.39800000000000002}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.442},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.60899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":96115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.65100000000000002}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.66700000000000004}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.71799999999999997}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.51300000000000001}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.38800000000000001}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.498}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.439},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":96147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.59699999999999998}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.621},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.60899999999999999}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.56299999999999994}]},{"osd":3,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.53900000000000003}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.495}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.433},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.46200000000000002}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":815104,"data_stored":645592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.437}]},{"osd":1,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.40500000000000003}]},{"osd":2,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.379},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.35099999999999998}]},{"osd":4,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.50800000000000001}]},{"osd":5,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.46200000000000002}]},{"osd":6,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed Sep 13 02:13:12 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.48399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":101798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.30199999999999999}]},{"osd":1,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.377}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.41599999999999998}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.52800000000000002}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.499},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55300000000000005}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":96177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.42099999999999999}]},{"osd":2,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.442}]},{"osd":3,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.47899999999999998}]},{"osd":4,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.61199999999999999}]},{"osd":5,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.625}]},{"osd":6,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.75600000000000001}]},{"osd":7,"last update":"Wed Sep 13 02:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.74199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":864256,"data_stored":686012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.41299999999999998}]},{"osd":2,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.44800000000000001}]},{"osd":3,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.375},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.34499999999999997}]},{"osd":4,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.624},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.57799999999999996}]},{"osd":5,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.59399999999999997}]},{"osd":6,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.60499999999999998}]},{"osd":7,"last update":"Wed Sep 13 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":5781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":549575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":543794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T02:14:17.069 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:14:17.070 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:14:17.070 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:14:17.070 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:14:17.071 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:14:17.071 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:14:17.072 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:14:17.072 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:14:17.073 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:14:17.073 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:14:17.074 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:14:17.074 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:14:17.075 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:14:17.075 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:14:17.075 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-09-13T02:12:23.560171+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=12, tm_sec=23, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=2, tm_min=13, tm_sec=31, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T02:14:17.076 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-13T02:14:24.308 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:14:24.311 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:14:37.077 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T02:14:37.191 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.190+0000 7f18fa051640 1 -- 172.21.15.104:0/1003908645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18dc003970 msgr2=0x7f18dc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:37.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.190+0000 7f18fa051640 1 --2- 172.21.15.104:0/1003908645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18dc003970 0x7f18dc003d90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009b80 tx=0x7f18dc0057f0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.190+0000 7f18f3fff640 1 -- 172.21.15.104:0/1003908645 reap_dead start 2023-09-13T02:14:37.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.190+0000 7f18fa051640 1 -- 172.21.15.104:0/1003908645 shutdown_connections 2023-09-13T02:14:37.192 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.190+0000 7f18fa051640 1 -- 172.21.15.104:0/1003908645 >> 172.21.15.104:0/1003908645 conn(0x7f18f40b56f0 msgr2=0x7f18f40b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:37.193 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.190+0000 7f18fa051640 1 -- 172.21.15.104:0/1003908645 shutdown_connections 2023-09-13T02:14:37.193 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.190+0000 7f18fa051640 1 -- 172.21.15.104:0/1003908645 wait complete. 2023-09-13T02:14:37.196 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.191+0000 7f18fa051640 1 Processor -- start 2023-09-13T02:14:37.196 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.191+0000 7f18fa051640 1 -- start start 2023-09-13T02:14:37.196 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18fa051640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18dc003970 0x7f18f40ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:37.197 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18fa051640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18f413f000 0x7f18f413f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:37.197 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18fa051640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18f413fc90 0x7f18f4138880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:37.197 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18fa051640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f413c8a0 con 0x7f18f413fc90 2023-09-13T02:14:37.198 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18fa051640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f4140120 con 0x7f18dc003970 2023-09-13T02:14:37.198 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18fa051640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f40ada50 con 0x7f18f413f000 2023-09-13T02:14:37.198 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18f3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18f413fc90 0x7f18f4138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:37.198 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18f3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18f413fc90 0x7f18f4138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34560/0 (socket says 172.21.15.104:34560) 2023-09-13T02:14:37.199 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18f3fff640 1 -- 172.21.15.104:0/3443599581 learned_addr learned my addr 172.21.15.104:0/3443599581 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:14:37.199 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18f2ffd640 1 --2- 172.21.15.104:0/3443599581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18f413f000 0x7f18f413f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:37.199 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18f37fe640 1 --2- 172.21.15.104:0/3443599581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18dc003970 0x7f18f40ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:37.199 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18f3fff640 1 -- 172.21.15.104:0/3443599581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18f413f000 msgr2=0x7f18f413f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:37.200 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18f3fff640 1 --2- 172.21.15.104:0/3443599581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18f413f000 0x7f18f413f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.200 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18f3fff640 1 -- 172.21.15.104:0/3443599581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18dc003970 msgr2=0x7f18f40ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:37.200 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18f3fff640 1 --2- 172.21.15.104:0/3443599581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18dc003970 0x7f18f40ac270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.200 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18f3fff640 1 -- 172.21.15.104:0/3443599581 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f40add30 con 0x7f18f413fc90 2023-09-13T02:14:37.201 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18f3fff640 1 --2- 172.21.15.104:0/3443599581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18f413fc90 0x7f18f4138880 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f18f40b2140 tx=0x7f18ec006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:37.201 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18dbfff640 1 -- 172.21.15.104:0/3443599581 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec00fa80 con 0x7f18f413fc90 2023-09-13T02:14:37.201 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18dbfff640 1 -- 172.21.15.104:0/3443599581 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f18ec00fc00 con 0x7f18f413fc90 2023-09-13T02:14:37.202 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18fa051640 1 -- 172.21.15.104:0/3443599581 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f40ae010 con 0x7f18f413fc90 2023-09-13T02:14:37.202 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18dbfff640 1 -- 172.21.15.104:0/3443599581 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec011430 con 0x7f18f413fc90 2023-09-13T02:14:37.202 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.192+0000 7f18fa051640 1 -- 172.21.15.104:0/3443599581 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f40ae6a0 con 0x7f18f413fc90 2023-09-13T02:14:37.202 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.193+0000 7f18fa051640 1 -- 172.21.15.104:0/3443599581 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f40ae200 con 0x7f18f413fc90 2023-09-13T02:14:37.203 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.194+0000 7f18dbfff640 1 -- 172.21.15.104:0/3443599581 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f18ec011590 con 0x7f18f413fc90 2023-09-13T02:14:37.203 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.194+0000 7f18dbfff640 1 --2- 172.21.15.104:0/3443599581 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f18e006a4f0 0x7f18e006c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:37.203 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.194+0000 7f18dbfff640 1 -- 172.21.15.104:0/3443599581 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f18ec089800 con 0x7f18f413fc90 2023-09-13T02:14:37.203 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.194+0000 7f18f37fe640 1 --2- 172.21.15.104:0/3443599581 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f18e006a4f0 0x7f18e006c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:37.204 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.195+0000 7f18f37fe640 1 --2- 172.21.15.104:0/3443599581 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f18e006a4f0 0x7f18e006c9b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f18e4036000 tx=0x7f18e40046c0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:37.204 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.198+0000 7f18dbfff640 1 -- 172.21.15.104:0/3443599581 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f18ec054e30 con 0x7f18f413fc90 2023-09-13T02:14:37.363 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.362+0000 7f18fa051640 1 -- 172.21.15.104:0/3443599581 --> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18f40adbc0 con 0x7f18e006a4f0 2023-09-13T02:14:37.370 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.369+0000 7f18dbfff640 1 -- 172.21.15.104:0/3443599581 <== mgr.4182 v2:172.21.15.104:6832/3152101627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+292775 (secure 0 0 0) 0x7f18f40adbc0 con 0x7f18e006a4f0 2023-09-13T02:14:37.373 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:14:37.375 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2023-09-13T02:14:37.377 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.372+0000 7f18fa051640 1 -- 172.21.15.104:0/3443599581 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f18e006a4f0 msgr2=0x7f18e006c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:37.377 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.372+0000 7f18fa051640 1 --2- 172.21.15.104:0/3443599581 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f18e006a4f0 0x7f18e006c9b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f18e4036000 tx=0x7f18e40046c0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.377 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.372+0000 7f18fa051640 1 -- 172.21.15.104:0/3443599581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18f413fc90 msgr2=0x7f18f4138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:37.377 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.372+0000 7f18fa051640 1 --2- 172.21.15.104:0/3443599581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18f413fc90 0x7f18f4138880 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f18f40b2140 tx=0x7f18ec006660 comp rx=0 tx=0).stop 2023-09-13T02:14:37.378 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.373+0000 7f18fa051640 1 -- 172.21.15.104:0/3443599581 shutdown_connections 2023-09-13T02:14:37.378 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.373+0000 7f18fa051640 1 --2- 172.21.15.104:0/3443599581 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f18e006a4f0 0x7f18e006c9b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.378 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.373+0000 7f18fa051640 1 --2- 172.21.15.104:0/3443599581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18f413fc90 0x7f18f4138880 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.379 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.373+0000 7f18fa051640 1 --2- 172.21.15.104:0/3443599581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18f413f000 0x7f18f413f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.379 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.373+0000 7f18fa051640 1 --2- 172.21.15.104:0/3443599581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18dc003970 0x7f18f40ac270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.379 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.373+0000 7f18fa051640 1 -- 172.21.15.104:0/3443599581 >> 172.21.15.104:0/3443599581 conn(0x7f18f40b56f0 msgr2=0x7f18f413abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:37.381 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.373+0000 7f18fa051640 1 -- 172.21.15.104:0/3443599581 shutdown_connections 2023-09-13T02:14:37.381 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.373+0000 7f18fa051640 1 -- 172.21.15.104:0/3443599581 wait complete. 2023-09-13T02:14:37.384 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-09-13T02:14:36.060646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1140753,"num_objects":30,"num_object_clones":3,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":2,"num_read":129,"num_read_kb":116,"num_write":435,"num_write_kb":3094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2957,"ondisk_log_size":2957,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220428,"kb_used_data":4300,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754292,"statfs":{"total":773094113280,"available":772868395008,"internally_reserved":0,"allocated":4403200,"data_stored":3048623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003172"},"pg_stats":[{"pgid":"3.3f","version":"22'38","reported_seq":81,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:15.810696+0000","last_change":"2023-09-13T02:14:15.810696+0000","last_active":"2023-09-13T02:14:15.810696+0000","last_peered":"2023-09-13T02:14:15.810696+0000","last_clean":"2023-09-13T02:14:15.810696+0000","last_became_active":"2023-09-13T02:12:24.592754+0000","last_became_peered":"2023-09-13T02:12:24.592754+0000","last_unstale":"2023-09-13T02:14:15.810696+0000","last_undegraded":"2023-09-13T02:14:15.810696+0000","last_fullsized":"2023-09-13T02:14:15.810696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'38","last_scrub_stamp":"2023-09-13T02:14:15.810520+0000","last_deep_scrub":"22'38","last_deep_scrub_stamp":"2023-09-13T02:14:15.810520+0000","last_clean_scrub_stamp":"2023-09-13T02:14:15.810520+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:31.885453+0000","scrub_duration":0.00138484,"objects_trimmed":0,"snaptrim_duration":0.013309302,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'23","reported_seq":66,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:06.725056+0000","last_change":"2023-09-13T02:14:06.725056+0000","last_active":"2023-09-13T02:14:06.725056+0000","last_peered":"2023-09-13T02:14:06.725056+0000","last_clean":"2023-09-13T02:14:06.725056+0000","last_became_active":"2023-09-13T02:12:24.579873+0000","last_became_peered":"2023-09-13T02:12:24.579873+0000","last_unstale":"2023-09-13T02:14:06.725056+0000","last_undegraded":"2023-09-13T02:14:06.725056+0000","last_fullsized":"2023-09-13T02:14:06.725056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'23","last_scrub_stamp":"2023-09-13T02:14:06.724875+0000","last_deep_scrub":"22'23","last_deep_scrub_stamp":"2023-09-13T02:14:06.724875+0000","last_clean_scrub_stamp":"2023-09-13T02:14:06.724875+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:00:34.348358+0000","scrub_duration":0.001382526,"objects_trimmed":0,"snaptrim_duration":0.0039927269999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'35","reported_seq":78,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:59.482941+0000","last_change":"2023-09-13T02:13:59.482941+0000","last_active":"2023-09-13T02:13:59.482941+0000","last_peered":"2023-09-13T02:13:59.482941+0000","last_clean":"2023-09-13T02:13:59.482941+0000","last_became_active":"2023-09-13T02:12:24.584249+0000","last_became_peered":"2023-09-13T02:12:24.584249+0000","last_unstale":"2023-09-13T02:13:59.482941+0000","last_undegraded":"2023-09-13T02:13:59.482941+0000","last_fullsized":"2023-09-13T02:13:59.482941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'35","last_scrub_stamp":"2023-09-13T02:13:59.482806+0000","last_deep_scrub":"22'35","last_deep_scrub_stamp":"2023-09-13T02:13:59.482806+0000","last_clean_scrub_stamp":"2023-09-13T02:13:59.482806+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:03:57.503453+0000","scrub_duration":0.0016009030000000001,"objects_trimmed":0,"snaptrim_duration":0.0065359670000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'37","reported_seq":80,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:15.320851+0000","last_change":"2023-09-13T02:14:15.320851+0000","last_active":"2023-09-13T02:14:15.320851+0000","last_peered":"2023-09-13T02:14:15.320851+0000","last_clean":"2023-09-13T02:14:15.320851+0000","last_became_active":"2023-09-13T02:12:24.595817+0000","last_became_peered":"2023-09-13T02:12:24.595817+0000","last_unstale":"2023-09-13T02:14:15.320851+0000","last_undegraded":"2023-09-13T02:14:15.320851+0000","last_fullsized":"2023-09-13T02:14:15.320851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'37","last_scrub_stamp":"2023-09-13T02:14:15.320710+0000","last_deep_scrub":"22'37","last_deep_scrub_stamp":"2023-09-13T02:14:15.320710+0000","last_clean_scrub_stamp":"2023-09-13T02:14:15.320710+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:31.395643+0000","scrub_duration":0.0018906839999999999,"objects_trimmed":0,"snaptrim_duration":0.010630479,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'25","reported_seq":67,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.034575+0000","last_change":"2023-09-13T02:13:36.092892+0000","last_active":"2023-09-13T02:13:44.034575+0000","last_peered":"2023-09-13T02:13:44.034575+0000","last_clean":"2023-09-13T02:13:44.034575+0000","last_became_active":"2023-09-13T02:12:24.591503+0000","last_became_peered":"2023-09-13T02:12:24.591503+0000","last_unstale":"2023-09-13T02:13:44.034575+0000","last_undegraded":"2023-09-13T02:13:44.034575+0000","last_fullsized":"2023-09-13T02:13:44.034575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'25","last_scrub_stamp":"2023-09-13T02:13:36.092761+0000","last_deep_scrub":"22'25","last_deep_scrub_stamp":"2023-09-13T02:13:36.092761+0000","last_clean_scrub_stamp":"2023-09-13T02:13:36.092761+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:40:10.458930+0000","scrub_duration":0.001560248,"objects_trimmed":0,"snaptrim_duration":0.013411609999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'30","reported_seq":69,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:58.305766+0000","last_change":"2023-09-13T02:13:58.305817+0000","last_active":"2023-09-13T02:13:58.305766+0000","last_peered":"2023-09-13T02:13:58.305766+0000","last_clean":"2023-09-13T02:13:58.305766+0000","last_became_active":"2023-09-13T02:13:06.365133+0000","last_became_peered":"2023-09-13T02:13:06.365133+0000","last_unstale":"2023-09-13T02:13:58.305766+0000","last_undegraded":"2023-09-13T02:13:58.305766+0000","last_fullsized":"2023-09-13T02:13:58.305766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'30","last_scrub_stamp":"2023-09-13T02:13:58.305663+0000","last_deep_scrub":"22'30","last_deep_scrub_stamp":"2023-09-13T02:13:58.305663+0000","last_clean_scrub_stamp":"2023-09-13T02:13:58.305663+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:18.870029+0000","scrub_duration":0.0015825749999999999,"objects_trimmed":0,"snaptrim_duration":0.0014597519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"22'26","reported_seq":68,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:03.892979+0000","last_change":"2023-09-13T02:14:03.893035+0000","last_active":"2023-09-13T02:14:03.892979+0000","last_peered":"2023-09-13T02:14:03.892979+0000","last_clean":"2023-09-13T02:14:03.892979+0000","last_became_active":"2023-09-13T02:12:24.590654+0000","last_became_peered":"2023-09-13T02:12:24.590654+0000","last_unstale":"2023-09-13T02:14:03.892979+0000","last_undegraded":"2023-09-13T02:14:03.892979+0000","last_fullsized":"2023-09-13T02:14:03.892979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'26","last_scrub_stamp":"2023-09-13T02:14:03.892892+0000","last_deep_scrub":"22'26","last_deep_scrub_stamp":"2023-09-13T02:14:03.892892+0000","last_clean_scrub_stamp":"2023-09-13T02:14:03.892892+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:49.431524+0000","scrub_duration":0.002047363,"objects_trimmed":0,"snaptrim_duration":0.013463309,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'37","reported_seq":79,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:16.681661+0000","last_change":"2023-09-13T02:14:16.681744+0000","last_active":"2023-09-13T02:14:16.681661+0000","last_peered":"2023-09-13T02:14:16.681661+0000","last_clean":"2023-09-13T02:14:16.681661+0000","last_became_active":"2023-09-13T02:12:24.588438+0000","last_became_peered":"2023-09-13T02:12:24.588438+0000","last_unstale":"2023-09-13T02:14:16.681661+0000","last_undegraded":"2023-09-13T02:14:16.681661+0000","last_fullsized":"2023-09-13T02:14:16.681661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'37","last_scrub_stamp":"2023-09-13T02:14:16.681557+0000","last_deep_scrub":"22'37","last_deep_scrub_stamp":"2023-09-13T02:14:16.681557+0000","last_clean_scrub_stamp":"2023-09-13T02:14:16.681557+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:08:51.952999+0000","scrub_duration":0.0019544810000000001,"objects_trimmed":0,"snaptrim_duration":0.00578898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'51","reported_seq":93,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:22.769626+0000","last_change":"2023-09-13T02:14:22.769669+0000","last_active":"2023-09-13T02:14:22.769626+0000","last_peered":"2023-09-13T02:14:22.769626+0000","last_clean":"2023-09-13T02:14:22.769626+0000","last_became_active":"2023-09-13T02:12:24.589606+0000","last_became_peered":"2023-09-13T02:12:24.589606+0000","last_unstale":"2023-09-13T02:14:22.769626+0000","last_undegraded":"2023-09-13T02:14:22.769626+0000","last_fullsized":"2023-09-13T02:14:22.769626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2023-09-13T02:14:22.769530+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2023-09-13T02:14:22.769530+0000","last_clean_scrub_stamp":"2023-09-13T02:14:22.769530+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:59:06.601475+0000","scrub_duration":0.001494514,"objects_trimmed":0,"snaptrim_duration":0.013475894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'75","reported_seq":117,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:13.475909+0000","last_change":"2023-09-13T02:14:13.475949+0000","last_active":"2023-09-13T02:14:13.475909+0000","last_peered":"2023-09-13T02:14:13.475909+0000","last_clean":"2023-09-13T02:14:13.475909+0000","last_became_active":"2023-09-13T02:12:24.588522+0000","last_became_peered":"2023-09-13T02:12:24.588522+0000","last_unstale":"2023-09-13T02:14:13.475909+0000","last_undegraded":"2023-09-13T02:14:13.475909+0000","last_fullsized":"2023-09-13T02:14:13.475909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'75","last_scrub_stamp":"2023-09-13T02:14:13.475828+0000","last_deep_scrub":"22'75","last_deep_scrub_stamp":"2023-09-13T02:14:13.475828+0000","last_clean_scrub_stamp":"2023-09-13T02:14:13.475828+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:50:19.183648+0000","scrub_duration":0.001328681,"objects_trimmed":0,"snaptrim_duration":0.0069747890000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'33","reported_seq":75,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:20.458605+0000","last_change":"2023-09-13T02:14:20.458649+0000","last_active":"2023-09-13T02:14:20.458605+0000","last_peered":"2023-09-13T02:14:20.458605+0000","last_clean":"2023-09-13T02:14:20.458605+0000","last_became_active":"2023-09-13T02:12:24.588891+0000","last_became_peered":"2023-09-13T02:12:24.588891+0000","last_unstale":"2023-09-13T02:14:20.458605+0000","last_undegraded":"2023-09-13T02:14:20.458605+0000","last_fullsized":"2023-09-13T02:14:20.458605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'33","last_scrub_stamp":"2023-09-13T02:14:20.458520+0000","last_deep_scrub":"22'33","last_deep_scrub_stamp":"2023-09-13T02:14:20.458520+0000","last_clean_scrub_stamp":"2023-09-13T02:14:20.458520+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:55:23.353465+0000","scrub_duration":0.0014594759999999999,"objects_trimmed":0,"snaptrim_duration":0.0069801409999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'36","reported_seq":78,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:50.510598+0000","last_change":"2023-09-13T02:13:50.510664+0000","last_active":"2023-09-13T02:13:50.510598+0000","last_peered":"2023-09-13T02:13:50.510598+0000","last_clean":"2023-09-13T02:13:50.510598+0000","last_became_active":"2023-09-13T02:12:24.587023+0000","last_became_peered":"2023-09-13T02:12:24.587023+0000","last_unstale":"2023-09-13T02:13:50.510598+0000","last_undegraded":"2023-09-13T02:13:50.510598+0000","last_fullsized":"2023-09-13T02:13:50.510598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'36","last_scrub_stamp":"2023-09-13T02:13:50.510498+0000","last_deep_scrub":"22'36","last_deep_scrub_stamp":"2023-09-13T02:13:50.510498+0000","last_clean_scrub_stamp":"2023-09-13T02:13:50.510498+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:15:32.718542+0000","scrub_duration":0.0014528880000000001,"objects_trimmed":0,"snaptrim_duration":0.002856936,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'49","reported_seq":91,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:07.560027+0000","last_change":"2023-09-13T02:14:07.560094+0000","last_active":"2023-09-13T02:14:07.560027+0000","last_peered":"2023-09-13T02:14:07.560027+0000","last_clean":"2023-09-13T02:14:07.560027+0000","last_became_active":"2023-09-13T02:12:24.587730+0000","last_became_peered":"2023-09-13T02:12:24.587730+0000","last_unstale":"2023-09-13T02:14:07.560027+0000","last_undegraded":"2023-09-13T02:14:07.560027+0000","last_fullsized":"2023-09-13T02:14:07.560027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'49","last_scrub_stamp":"2023-09-13T02:14:07.559925+0000","last_deep_scrub":"22'49","last_deep_scrub_stamp":"2023-09-13T02:14:07.559925+0000","last_clean_scrub_stamp":"2023-09-13T02:14:07.559925+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:14.725524+0000","scrub_duration":0.0018154899999999999,"objects_trimmed":0,"snaptrim_duration":0.0057195980000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'41","reported_seq":83,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:49.389442+0000","last_change":"2023-09-13T02:13:49.389523+0000","last_active":"2023-09-13T02:13:49.389442+0000","last_peered":"2023-09-13T02:13:49.389442+0000","last_clean":"2023-09-13T02:13:49.389442+0000","last_became_active":"2023-09-13T02:12:24.584734+0000","last_became_peered":"2023-09-13T02:12:24.584734+0000","last_unstale":"2023-09-13T02:13:49.389442+0000","last_undegraded":"2023-09-13T02:13:49.389442+0000","last_fullsized":"2023-09-13T02:13:49.389442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'41","last_scrub_stamp":"2023-09-13T02:13:49.389330+0000","last_deep_scrub":"22'41","last_deep_scrub_stamp":"2023-09-13T02:13:49.389330+0000","last_clean_scrub_stamp":"2023-09-13T02:13:49.389330+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:13:42.099948+0000","scrub_duration":0.00133534,"objects_trimmed":0,"snaptrim_duration":0.006295564,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'39","reported_seq":81,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:00.625131+0000","last_change":"2023-09-13T02:14:00.625195+0000","last_active":"2023-09-13T02:14:00.625131+0000","last_peered":"2023-09-13T02:14:00.625131+0000","last_clean":"2023-09-13T02:14:00.625131+0000","last_became_active":"2023-09-13T02:12:24.578553+0000","last_became_peered":"2023-09-13T02:12:24.578553+0000","last_unstale":"2023-09-13T02:14:00.625131+0000","last_undegraded":"2023-09-13T02:14:00.625131+0000","last_fullsized":"2023-09-13T02:14:00.625131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'39","last_scrub_stamp":"2023-09-13T02:14:00.625028+0000","last_deep_scrub":"22'39","last_deep_scrub_stamp":"2023-09-13T02:14:00.625028+0000","last_clean_scrub_stamp":"2023-09-13T02:14:00.625028+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:09:40.455839+0000","scrub_duration":0.0019467169999999999,"objects_trimmed":0,"snaptrim_duration":0.0041892860000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'48","reported_seq":90,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:04.216237+0000","last_change":"2023-09-13T02:14:04.216315+0000","last_active":"2023-09-13T02:14:04.216237+0000","last_peered":"2023-09-13T02:14:04.216237+0000","last_clean":"2023-09-13T02:14:04.216237+0000","last_became_active":"2023-09-13T02:12:24.590871+0000","last_became_peered":"2023-09-13T02:12:24.590871+0000","last_unstale":"2023-09-13T02:14:04.216237+0000","last_undegraded":"2023-09-13T02:14:04.216237+0000","last_fullsized":"2023-09-13T02:14:04.216237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'48","last_scrub_stamp":"2023-09-13T02:14:04.216132+0000","last_deep_scrub":"22'48","last_deep_scrub_stamp":"2023-09-13T02:14:04.216132+0000","last_clean_scrub_stamp":"2023-09-13T02:14:04.216132+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:30:25.695248+0000","scrub_duration":0.001919149,"objects_trimmed":0,"snaptrim_duration":0.0089611650000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'41","reported_seq":83,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:54.277826+0000","last_change":"2023-09-13T02:13:54.277876+0000","last_active":"2023-09-13T02:13:54.277826+0000","last_peered":"2023-09-13T02:13:54.277826+0000","last_clean":"2023-09-13T02:13:54.277826+0000","last_became_active":"2023-09-13T02:12:24.592325+0000","last_became_peered":"2023-09-13T02:12:24.592325+0000","last_unstale":"2023-09-13T02:13:54.277826+0000","last_undegraded":"2023-09-13T02:13:54.277826+0000","last_fullsized":"2023-09-13T02:13:54.277826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'41","last_scrub_stamp":"2023-09-13T02:13:54.277729+0000","last_deep_scrub":"22'41","last_deep_scrub_stamp":"2023-09-13T02:13:54.277729+0000","last_clean_scrub_stamp":"2023-09-13T02:13:54.277729+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:00:21.901212+0000","scrub_duration":0.0015243769999999999,"objects_trimmed":0,"snaptrim_duration":0.010777484,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'57","reported_seq":99,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:57.284755+0000","last_change":"2023-09-13T02:13:57.284824+0000","last_active":"2023-09-13T02:13:57.284755+0000","last_peered":"2023-09-13T02:13:57.284755+0000","last_clean":"2023-09-13T02:13:57.284755+0000","last_became_active":"2023-09-13T02:12:24.587552+0000","last_became_peered":"2023-09-13T02:12:24.587552+0000","last_unstale":"2023-09-13T02:13:57.284755+0000","last_undegraded":"2023-09-13T02:13:57.284755+0000","last_fullsized":"2023-09-13T02:13:57.284755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'57","last_scrub_stamp":"2023-09-13T02:13:57.284678+0000","last_deep_scrub":"22'57","last_deep_scrub_stamp":"2023-09-13T02:13:57.284678+0000","last_clean_scrub_stamp":"2023-09-13T02:13:57.284678+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:13:49.995296+0000","scrub_duration":0.0019501150000000001,"objects_trimmed":0,"snaptrim_duration":0.001551586,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'39","reported_seq":81,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:11.816481+0000","last_change":"2023-09-13T02:14:11.816530+0000","last_active":"2023-09-13T02:14:11.816481+0000","last_peered":"2023-09-13T02:14:11.816481+0000","last_clean":"2023-09-13T02:14:11.816481+0000","last_became_active":"2023-09-13T02:12:24.590670+0000","last_became_peered":"2023-09-13T02:12:24.590670+0000","last_unstale":"2023-09-13T02:14:11.816481+0000","last_undegraded":"2023-09-13T02:14:11.816481+0000","last_fullsized":"2023-09-13T02:14:11.816481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'39","last_scrub_stamp":"2023-09-13T02:14:11.816401+0000","last_deep_scrub":"22'39","last_deep_scrub_stamp":"2023-09-13T02:14:11.816401+0000","last_clean_scrub_stamp":"2023-09-13T02:14:11.816401+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:51:17.517058+0000","scrub_duration":0.001855329,"objects_trimmed":0,"snaptrim_duration":0.013177124,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'41","reported_seq":83,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:05.516798+0000","last_change":"2023-09-13T02:14:05.516848+0000","last_active":"2023-09-13T02:14:05.516798+0000","last_peered":"2023-09-13T02:14:05.516798+0000","last_clean":"2023-09-13T02:14:05.516798+0000","last_became_active":"2023-09-13T02:12:24.591065+0000","last_became_peered":"2023-09-13T02:12:24.591065+0000","last_unstale":"2023-09-13T02:14:05.516798+0000","last_undegraded":"2023-09-13T02:14:05.516798+0000","last_fullsized":"2023-09-13T02:14:05.516798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'41","last_scrub_stamp":"2023-09-13T02:14:05.516706+0000","last_deep_scrub":"22'41","last_deep_scrub_stamp":"2023-09-13T02:14:05.516706+0000","last_clean_scrub_stamp":"2023-09-13T02:14:05.516706+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:00:33.140189+0000","scrub_duration":0.0014842919999999999,"objects_trimmed":0,"snaptrim_duration":0.0072721169999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'56","reported_seq":98,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:56.453179+0000","last_change":"2023-09-13T02:13:56.453221+0000","last_active":"2023-09-13T02:13:56.453179+0000","last_peered":"2023-09-13T02:13:56.453179+0000","last_clean":"2023-09-13T02:13:56.453179+0000","last_became_active":"2023-09-13T02:12:24.586981+0000","last_became_peered":"2023-09-13T02:12:24.586981+0000","last_unstale":"2023-09-13T02:13:56.453179+0000","last_undegraded":"2023-09-13T02:13:56.453179+0000","last_fullsized":"2023-09-13T02:13:56.453179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'56","last_scrub_stamp":"2023-09-13T02:13:56.453097+0000","last_deep_scrub":"22'56","last_deep_scrub_stamp":"2023-09-13T02:13:56.453097+0000","last_clean_scrub_stamp":"2023-09-13T02:13:56.453097+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:09:36.283909+0000","scrub_duration":0.0021104549999999998,"objects_trimmed":0,"snaptrim_duration":0.0064443770000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'48","reported_seq":90,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:59.277707+0000","last_change":"2023-09-13T02:13:59.277760+0000","last_active":"2023-09-13T02:13:59.277707+0000","last_peered":"2023-09-13T02:13:59.277707+0000","last_clean":"2023-09-13T02:13:59.277707+0000","last_became_active":"2023-09-13T02:12:24.594351+0000","last_became_peered":"2023-09-13T02:12:24.594351+0000","last_unstale":"2023-09-13T02:13:59.277707+0000","last_undegraded":"2023-09-13T02:13:59.277707+0000","last_fullsized":"2023-09-13T02:13:59.277707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'48","last_scrub_stamp":"2023-09-13T02:13:59.277609+0000","last_deep_scrub":"22'48","last_deep_scrub_stamp":"2023-09-13T02:13:59.277609+0000","last_clean_scrub_stamp":"2023-09-13T02:13:59.277609+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:52:53.358062+0000","scrub_duration":0.0015780340000000001,"objects_trimmed":0,"snaptrim_duration":0.010224219999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'43","reported_seq":85,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:06.600873+0000","last_change":"2023-09-13T02:14:06.600922+0000","last_active":"2023-09-13T02:14:06.600873+0000","last_peered":"2023-09-13T02:14:06.600873+0000","last_clean":"2023-09-13T02:14:06.600873+0000","last_became_active":"2023-09-13T02:12:24.590295+0000","last_became_peered":"2023-09-13T02:12:24.590295+0000","last_unstale":"2023-09-13T02:14:06.600873+0000","last_undegraded":"2023-09-13T02:14:06.600873+0000","last_fullsized":"2023-09-13T02:14:06.600873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2023-09-13T02:14:06.600781+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2023-09-13T02:14:06.600781+0000","last_clean_scrub_stamp":"2023-09-13T02:14:06.600781+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:00.681233+0000","scrub_duration":0.002113799,"objects_trimmed":0,"snaptrim_duration":0.0059803399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'37","reported_seq":79,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:02.226799+0000","last_change":"2023-09-13T02:14:02.226851+0000","last_active":"2023-09-13T02:14:02.226799+0000","last_peered":"2023-09-13T02:14:02.226799+0000","last_clean":"2023-09-13T02:14:02.226799+0000","last_became_active":"2023-09-13T02:12:24.593673+0000","last_became_peered":"2023-09-13T02:12:24.593673+0000","last_unstale":"2023-09-13T02:14:02.226799+0000","last_undegraded":"2023-09-13T02:14:02.226799+0000","last_fullsized":"2023-09-13T02:14:02.226799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'37","last_scrub_stamp":"2023-09-13T02:14:02.226704+0000","last_deep_scrub":"22'37","last_deep_scrub_stamp":"2023-09-13T02:14:02.226704+0000","last_clean_scrub_stamp":"2023-09-13T02:14:02.226704+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:50:07.934525+0000","scrub_duration":0.0019959930000000002,"objects_trimmed":0,"snaptrim_duration":0.010617236,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'16","reported_seq":58,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:03.521449+0000","last_change":"2023-09-13T02:14:03.521537+0000","last_active":"2023-09-13T02:14:03.521449+0000","last_peered":"2023-09-13T02:14:03.521449+0000","last_clean":"2023-09-13T02:14:03.521449+0000","last_became_active":"2023-09-13T02:12:24.590231+0000","last_became_peered":"2023-09-13T02:12:24.590231+0000","last_unstale":"2023-09-13T02:14:03.521449+0000","last_undegraded":"2023-09-13T02:14:03.521449+0000","last_fullsized":"2023-09-13T02:14:03.521449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'16","last_scrub_stamp":"2023-09-13T02:14:03.521351+0000","last_deep_scrub":"22'16","last_deep_scrub_stamp":"2023-09-13T02:14:03.521351+0000","last_clean_scrub_stamp":"2023-09-13T02:14:03.521351+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:03:54.163016+0000","scrub_duration":0.001747406,"objects_trimmed":0,"snaptrim_duration":0.0055340570000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'68","reported_seq":117,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:23.426194+0000","last_change":"2023-09-13T02:14:23.426267+0000","last_active":"2023-09-13T02:14:23.426194+0000","last_peered":"2023-09-13T02:14:23.426194+0000","last_clean":"2023-09-13T02:14:23.426194+0000","last_became_active":"2023-09-13T02:13:05.916435+0000","last_became_peered":"2023-09-13T02:13:05.916435+0000","last_unstale":"2023-09-13T02:14:23.426194+0000","last_undegraded":"2023-09-13T02:14:23.426194+0000","last_fullsized":"2023-09-13T02:14:23.426194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'68","last_scrub_stamp":"2023-09-13T02:14:23.426086+0000","last_deep_scrub":"22'68","last_deep_scrub_stamp":"2023-09-13T02:14:23.426086+0000","last_clean_scrub_stamp":"2023-09-13T02:14:23.426086+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:51:29.126743+0000","scrub_duration":0.0018735259999999999,"objects_trimmed":0,"snaptrim_duration":0.0065577700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'34","reported_seq":76,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:14.767773+0000","last_change":"2023-09-13T02:14:14.767822+0000","last_active":"2023-09-13T02:14:14.767773+0000","last_peered":"2023-09-13T02:14:14.767773+0000","last_clean":"2023-09-13T02:14:14.767773+0000","last_became_active":"2023-09-13T02:12:24.583782+0000","last_became_peered":"2023-09-13T02:12:24.583782+0000","last_unstale":"2023-09-13T02:14:14.767773+0000","last_undegraded":"2023-09-13T02:14:14.767773+0000","last_fullsized":"2023-09-13T02:14:14.767773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'34","last_scrub_stamp":"2023-09-13T02:14:14.767682+0000","last_deep_scrub":"22'34","last_deep_scrub_stamp":"2023-09-13T02:14:14.767682+0000","last_clean_scrub_stamp":"2023-09-13T02:14:14.767682+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:50:20.475503+0000","scrub_duration":0.0015691450000000001,"objects_trimmed":0,"snaptrim_duration":0.0041099719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'23","reported_seq":65,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:58.492856+0000","last_change":"2023-09-13T02:13:58.492902+0000","last_active":"2023-09-13T02:13:58.492856+0000","last_peered":"2023-09-13T02:13:58.492856+0000","last_clean":"2023-09-13T02:13:58.492856+0000","last_became_active":"2023-09-13T02:12:24.590189+0000","last_became_peered":"2023-09-13T02:12:24.590189+0000","last_unstale":"2023-09-13T02:13:58.492856+0000","last_undegraded":"2023-09-13T02:13:58.492856+0000","last_fullsized":"2023-09-13T02:13:58.492856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'23","last_scrub_stamp":"2023-09-13T02:13:58.492771+0000","last_deep_scrub":"22'23","last_deep_scrub_stamp":"2023-09-13T02:13:58.492771+0000","last_clean_scrub_stamp":"2023-09-13T02:13:58.492771+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:03:56.513419+0000","scrub_duration":0.002203521,"objects_trimmed":0,"snaptrim_duration":0.005267819,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'35","reported_seq":78,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:02.502921+0000","last_change":"2023-09-13T02:14:02.502921+0000","last_active":"2023-09-13T02:14:02.502921+0000","last_peered":"2023-09-13T02:14:02.502921+0000","last_clean":"2023-09-13T02:14:02.502921+0000","last_became_active":"2023-09-13T02:12:24.583453+0000","last_became_peered":"2023-09-13T02:12:24.583453+0000","last_unstale":"2023-09-13T02:14:02.502921+0000","last_undegraded":"2023-09-13T02:14:02.502921+0000","last_fullsized":"2023-09-13T02:14:02.502921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'35","last_scrub_stamp":"2023-09-13T02:14:02.502772+0000","last_deep_scrub":"22'35","last_deep_scrub_stamp":"2023-09-13T02:14:02.502772+0000","last_clean_scrub_stamp":"2023-09-13T02:14:02.502772+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:00:30.126256+0000","scrub_duration":0.001393163,"objects_trimmed":0,"snaptrim_duration":0.0067806159999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'42","reported_seq":85,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:51.369880+0000","last_change":"2023-09-13T02:13:51.369880+0000","last_active":"2023-09-13T02:13:51.369880+0000","last_peered":"2023-09-13T02:13:51.369880+0000","last_clean":"2023-09-13T02:13:51.369880+0000","last_became_active":"2023-09-13T02:12:24.592875+0000","last_became_peered":"2023-09-13T02:12:24.592875+0000","last_unstale":"2023-09-13T02:13:51.369880+0000","last_undegraded":"2023-09-13T02:13:51.369880+0000","last_fullsized":"2023-09-13T02:13:51.369880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'42","last_scrub_stamp":"2023-09-13T02:13:51.369721+0000","last_deep_scrub":"22'42","last_deep_scrub_stamp":"2023-09-13T02:13:51.369721+0000","last_clean_scrub_stamp":"2023-09-13T02:13:51.369721+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:03:49.390369+0000","scrub_duration":0.0021232569999999999,"objects_trimmed":0,"snaptrim_duration":0.0084478739999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'55","reported_seq":98,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:51.284253+0000","last_change":"2023-09-13T02:13:51.284253+0000","last_active":"2023-09-13T02:13:51.284253+0000","last_peered":"2023-09-13T02:13:51.284253+0000","last_clean":"2023-09-13T02:13:51.284253+0000","last_became_active":"2023-09-13T02:12:24.588173+0000","last_became_peered":"2023-09-13T02:12:24.588173+0000","last_unstale":"2023-09-13T02:13:51.284253+0000","last_undegraded":"2023-09-13T02:13:51.284253+0000","last_fullsized":"2023-09-13T02:13:51.284253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2023-09-13T02:13:51.284112+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2023-09-13T02:13:51.284112+0000","last_clean_scrub_stamp":"2023-09-13T02:13:51.284112+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:27:21.238044+0000","scrub_duration":0.0016218739999999999,"objects_trimmed":0,"snaptrim_duration":0.0018416579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'45","reported_seq":88,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:10.449739+0000","last_change":"2023-09-13T02:14:10.449739+0000","last_active":"2023-09-13T02:14:10.449739+0000","last_peered":"2023-09-13T02:14:10.449739+0000","last_clean":"2023-09-13T02:14:10.449739+0000","last_became_active":"2023-09-13T02:12:24.590677+0000","last_became_peered":"2023-09-13T02:12:24.590677+0000","last_unstale":"2023-09-13T02:14:10.449739+0000","last_undegraded":"2023-09-13T02:14:10.449739+0000","last_fullsized":"2023-09-13T02:14:10.449739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'45","last_scrub_stamp":"2023-09-13T02:14:10.449590+0000","last_deep_scrub":"22'45","last_deep_scrub_stamp":"2023-09-13T02:14:10.449590+0000","last_clean_scrub_stamp":"2023-09-13T02:14:10.449590+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:04.530043+0000","scrub_duration":0.0022546419999999998,"objects_trimmed":0,"snaptrim_duration":0.0077055279999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'40","reported_seq":82,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.863153+0000","last_change":"2023-09-13T02:13:41.540019+0000","last_active":"2023-09-13T02:13:43.863153+0000","last_peered":"2023-09-13T02:13:43.863153+0000","last_clean":"2023-09-13T02:13:43.863153+0000","last_became_active":"2023-09-13T02:12:24.586251+0000","last_became_peered":"2023-09-13T02:12:24.586251+0000","last_unstale":"2023-09-13T02:13:43.863153+0000","last_undegraded":"2023-09-13T02:13:43.863153+0000","last_fullsized":"2023-09-13T02:13:43.863153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'40","last_scrub_stamp":"2023-09-13T02:13:41.539885+0000","last_deep_scrub":"22'40","last_deep_scrub_stamp":"2023-09-13T02:13:41.539885+0000","last_clean_scrub_stamp":"2023-09-13T02:13:41.539885+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:09:20.900257+0000","scrub_duration":0.0017396600000000001,"objects_trimmed":0,"snaptrim_duration":0.0032713870000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'2","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:39.513824+0000","last_change":"2023-09-13T02:13:39.513824+0000","last_active":"2023-09-13T02:13:39.513824+0000","last_peered":"2023-09-13T02:13:39.513824+0000","last_clean":"2023-09-13T02:13:39.513824+0000","last_became_active":"2023-09-13T02:12:23.578889+0000","last_became_peered":"2023-09-13T02:12:23.578889+0000","last_unstale":"2023-09-13T02:13:39.513824+0000","last_undegraded":"2023-09-13T02:13:39.513824+0000","last_fullsized":"2023-09-13T02:13:39.513824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2023-09-13T02:13:39.513697+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2023-09-13T02:13:39.513697+0000","last_clean_scrub_stamp":"2023-09-13T02:13:39.513697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:15:21.721741+0000","scrub_duration":0.0019969480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'41","reported_seq":83,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:07.427116+0000","last_change":"2023-09-13T02:14:07.427160+0000","last_active":"2023-09-13T02:14:07.427116+0000","last_peered":"2023-09-13T02:14:07.427116+0000","last_clean":"2023-09-13T02:14:07.427116+0000","last_became_active":"2023-09-13T02:12:24.579243+0000","last_became_peered":"2023-09-13T02:12:24.579243+0000","last_unstale":"2023-09-13T02:14:07.427116+0000","last_undegraded":"2023-09-13T02:14:07.427116+0000","last_fullsized":"2023-09-13T02:14:07.427116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'41","last_scrub_stamp":"2023-09-13T02:14:07.427034+0000","last_deep_scrub":"22'41","last_deep_scrub_stamp":"2023-09-13T02:14:07.427034+0000","last_clean_scrub_stamp":"2023-09-13T02:14:07.427034+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:01.507487+0000","scrub_duration":0.001872421,"objects_trimmed":0,"snaptrim_duration":0.0064049659999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:46.487455+0000","last_change":"2023-09-13T02:13:46.487501+0000","last_active":"2023-09-13T02:13:46.487455+0000","last_peered":"2023-09-13T02:13:46.487455+0000","last_clean":"2023-09-13T02:13:46.487455+0000","last_became_active":"2023-09-13T02:12:23.576754+0000","last_became_peered":"2023-09-13T02:12:23.576754+0000","last_unstale":"2023-09-13T02:13:46.487455+0000","last_undegraded":"2023-09-13T02:13:46.487455+0000","last_fullsized":"2023-09-13T02:13:46.487455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2023-09-13T02:13:46.487370+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2023-09-13T02:13:46.487370+0000","last_clean_scrub_stamp":"2023-09-13T02:13:46.487370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:28:26.543492+0000","scrub_duration":0.0014463200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:47.532140+0000","last_change":"2023-09-13T02:13:47.532221+0000","last_active":"2023-09-13T02:13:47.532140+0000","last_peered":"2023-09-13T02:13:47.532140+0000","last_clean":"2023-09-13T02:13:47.532140+0000","last_became_active":"2023-09-13T02:12:23.579351+0000","last_became_peered":"2023-09-13T02:12:23.579351+0000","last_unstale":"2023-09-13T02:13:47.532140+0000","last_undegraded":"2023-09-13T02:13:47.532140+0000","last_fullsized":"2023-09-13T02:13:47.532140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2023-09-13T02:13:47.532036+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2023-09-13T02:13:47.532036+0000","last_clean_scrub_stamp":"2023-09-13T02:13:47.532036+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:13:40.242654+0000","scrub_duration":0.002094168,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'41","reported_seq":83,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:09.580980+0000","last_change":"2023-09-13T02:14:09.581061+0000","last_active":"2023-09-13T02:14:09.580980+0000","last_peered":"2023-09-13T02:14:09.580980+0000","last_clean":"2023-09-13T02:14:09.580980+0000","last_became_active":"2023-09-13T02:12:24.590126+0000","last_became_peered":"2023-09-13T02:12:24.590126+0000","last_unstale":"2023-09-13T02:14:09.580980+0000","last_undegraded":"2023-09-13T02:14:09.580980+0000","last_fullsized":"2023-09-13T02:14:09.580980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'41","last_scrub_stamp":"2023-09-13T02:14:09.580873+0000","last_deep_scrub":"22'41","last_deep_scrub_stamp":"2023-09-13T02:14:09.580873+0000","last_clean_scrub_stamp":"2023-09-13T02:14:09.580873+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:28.502154+0000","scrub_duration":0.0014948299999999999,"objects_trimmed":0,"snaptrim_duration":0.0057346009999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:36.231609+0000","last_change":"2023-09-13T02:13:36.231609+0000","last_active":"2023-09-13T02:13:36.231609+0000","last_peered":"2023-09-13T02:13:36.231609+0000","last_clean":"2023-09-13T02:13:36.231609+0000","last_became_active":"2023-09-13T02:12:23.585953+0000","last_became_peered":"2023-09-13T02:12:23.585953+0000","last_unstale":"2023-09-13T02:13:36.231609+0000","last_undegraded":"2023-09-13T02:13:36.231609+0000","last_fullsized":"2023-09-13T02:13:36.231609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:36.231480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:36.231480+0000","last_clean_scrub_stamp":"2023-09-13T02:13:36.231480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:28:16.287602+0000","scrub_duration":0.00143738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'47","reported_seq":89,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:11.718989+0000","last_change":"2023-09-13T02:14:11.719038+0000","last_active":"2023-09-13T02:14:11.718989+0000","last_peered":"2023-09-13T02:14:11.718989+0000","last_clean":"2023-09-13T02:14:11.718989+0000","last_became_active":"2023-09-13T02:12:24.584901+0000","last_became_peered":"2023-09-13T02:12:24.584901+0000","last_unstale":"2023-09-13T02:14:11.718989+0000","last_undegraded":"2023-09-13T02:14:11.718989+0000","last_fullsized":"2023-09-13T02:14:11.718989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'47","last_scrub_stamp":"2023-09-13T02:14:11.718906+0000","last_deep_scrub":"22'47","last_deep_scrub_stamp":"2023-09-13T02:14:11.718906+0000","last_clean_scrub_stamp":"2023-09-13T02:14:11.718906+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:05.799359+0000","scrub_duration":0.001415845,"objects_trimmed":0,"snaptrim_duration":0.0047693290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:02.539856+0000","last_change":"2023-09-13T02:14:02.539903+0000","last_active":"2023-09-13T02:14:02.539856+0000","last_peered":"2023-09-13T02:14:02.539856+0000","last_clean":"2023-09-13T02:14:02.539856+0000","last_became_active":"2023-09-13T02:12:23.583305+0000","last_became_peered":"2023-09-13T02:12:23.583305+0000","last_unstale":"2023-09-13T02:14:02.539856+0000","last_undegraded":"2023-09-13T02:14:02.539856+0000","last_fullsized":"2023-09-13T02:14:02.539856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-09-13T02:14:02.539769+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-09-13T02:14:02.539769+0000","last_clean_scrub_stamp":"2023-09-13T02:14:02.539769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:04:00.560416+0000","scrub_duration":0.0014486379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'47","reported_seq":89,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:11.242502+0000","last_change":"2023-09-13T02:14:11.242556+0000","last_active":"2023-09-13T02:14:11.242502+0000","last_peered":"2023-09-13T02:14:11.242502+0000","last_clean":"2023-09-13T02:14:11.242502+0000","last_became_active":"2023-09-13T02:12:24.594434+0000","last_became_peered":"2023-09-13T02:12:24.594434+0000","last_unstale":"2023-09-13T02:14:11.242502+0000","last_undegraded":"2023-09-13T02:14:11.242502+0000","last_fullsized":"2023-09-13T02:14:11.242502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'47","last_scrub_stamp":"2023-09-13T02:14:11.242411+0000","last_deep_scrub":"22'47","last_deep_scrub_stamp":"2023-09-13T02:14:11.242411+0000","last_clean_scrub_stamp":"2023-09-13T02:14:11.242411+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:51:16.943069+0000","scrub_duration":0.001642129,"objects_trimmed":0,"snaptrim_duration":0.010662779000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'1","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:40.327213+0000","last_change":"2023-09-13T02:13:40.327213+0000","last_active":"2023-09-13T02:13:40.327213+0000","last_peered":"2023-09-13T02:13:40.327213+0000","last_clean":"2023-09-13T02:13:40.327213+0000","last_became_active":"2023-09-13T02:12:23.584657+0000","last_became_peered":"2023-09-13T02:12:23.584657+0000","last_unstale":"2023-09-13T02:13:40.327213+0000","last_undegraded":"2023-09-13T02:13:40.327213+0000","last_fullsized":"2023-09-13T02:13:40.327213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-09-13T02:13:40.327064+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-09-13T02:13:40.327064+0000","last_clean_scrub_stamp":"2023-09-13T02:13:40.327064+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:13:33.037682+0000","scrub_duration":0.0014937660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'55","reported_seq":95,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:10.437300+0000","last_change":"2023-09-13T02:14:10.437355+0000","last_active":"2023-09-13T02:14:10.437300+0000","last_peered":"2023-09-13T02:14:10.437300+0000","last_clean":"2023-09-13T02:14:10.437300+0000","last_became_active":"2023-09-13T02:12:24.588455+0000","last_became_peered":"2023-09-13T02:12:24.588455+0000","last_unstale":"2023-09-13T02:14:10.437300+0000","last_undegraded":"2023-09-13T02:14:10.437300+0000","last_fullsized":"2023-09-13T02:14:10.437300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'55","last_scrub_stamp":"2023-09-13T02:14:10.437210+0000","last_deep_scrub":"24'55","last_deep_scrub_stamp":"2023-09-13T02:14:10.437210+0000","last_clean_scrub_stamp":"2023-09-13T02:14:10.437210+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:50:16.145031+0000","scrub_duration":0.0076503229999999997,"objects_trimmed":0,"snaptrim_duration":0.0065331499999999997,"stat_sum":{"num_bytes":8,"num_objects":3,"num_object_clones":2,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'13","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:57.666838+0000","last_change":"2023-09-13T02:13:57.666920+0000","last_active":"2023-09-13T02:13:57.666838+0000","last_peered":"2023-09-13T02:13:57.666838+0000","last_clean":"2023-09-13T02:13:57.666838+0000","last_became_active":"2023-09-13T02:12:23.582506+0000","last_became_peered":"2023-09-13T02:12:23.582506+0000","last_unstale":"2023-09-13T02:13:57.666838+0000","last_undegraded":"2023-09-13T02:13:57.666838+0000","last_fullsized":"2023-09-13T02:13:57.666838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'13","last_scrub_stamp":"2023-09-13T02:13:57.666748+0000","last_deep_scrub":"24'13","last_deep_scrub_stamp":"2023-09-13T02:13:57.666748+0000","last_clean_scrub_stamp":"2023-09-13T02:13:57.666748+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:11:51.438783+0000","scrub_duration":0.0031197999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'55","reported_seq":97,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.863695+0000","last_change":"2023-09-13T02:13:42.538129+0000","last_active":"2023-09-13T02:13:43.863695+0000","last_peered":"2023-09-13T02:13:43.863695+0000","last_clean":"2023-09-13T02:13:43.863695+0000","last_became_active":"2023-09-13T02:12:24.592367+0000","last_became_peered":"2023-09-13T02:12:24.592367+0000","last_unstale":"2023-09-13T02:13:43.863695+0000","last_undegraded":"2023-09-13T02:13:43.863695+0000","last_fullsized":"2023-09-13T02:13:43.863695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2023-09-13T02:13:42.537998+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2023-09-13T02:13:42.537998+0000","last_clean_scrub_stamp":"2023-09-13T02:13:42.537998+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:58:10.391746+0000","scrub_duration":0.001467238,"objects_trimmed":0,"snaptrim_duration":0.0029315080000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'151","reported_seq":176,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:52.645698+0000","last_change":"2023-09-13T02:13:52.645787+0000","last_active":"2023-09-13T02:13:52.645698+0000","last_peered":"2023-09-13T02:13:52.645698+0000","last_clean":"2023-09-13T02:13:52.645698+0000","last_became_active":"2023-09-13T02:12:23.578748+0000","last_became_peered":"2023-09-13T02:12:23.578748+0000","last_unstale":"2023-09-13T02:13:52.645698+0000","last_undegraded":"2023-09-13T02:13:52.645698+0000","last_fullsized":"2023-09-13T02:13:52.645698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'151","last_scrub_stamp":"2023-09-13T02:13:52.645603+0000","last_deep_scrub":"24'151","last_deep_scrub_stamp":"2023-09-13T02:13:52.645603+0000","last_clean_scrub_stamp":"2023-09-13T02:13:52.645603+0000","objects_scrubbed":4,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:13.209968+0000","scrub_duration":0.0056317299999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":543794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'32","reported_seq":74,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:06.870801+0000","last_change":"2023-09-13T02:14:06.870851+0000","last_active":"2023-09-13T02:14:06.870801+0000","last_peered":"2023-09-13T02:14:06.870801+0000","last_clean":"2023-09-13T02:14:06.870801+0000","last_became_active":"2023-09-13T02:12:24.593092+0000","last_became_peered":"2023-09-13T02:12:24.593092+0000","last_unstale":"2023-09-13T02:14:06.870801+0000","last_undegraded":"2023-09-13T02:14:06.870801+0000","last_fullsized":"2023-09-13T02:14:06.870801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'32","last_scrub_stamp":"2023-09-13T02:14:06.870713+0000","last_deep_scrub":"22'32","last_deep_scrub_stamp":"2023-09-13T02:14:06.870713+0000","last_clean_scrub_stamp":"2023-09-13T02:14:06.870713+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:08:42.142155+0000","scrub_duration":0.0021163459999999999,"objects_trimmed":0,"snaptrim_duration":0.011018085,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'5","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:34.538371+0000","last_change":"2023-09-13T02:13:34.538371+0000","last_active":"2023-09-13T02:13:34.538371+0000","last_peered":"2023-09-13T02:13:34.538371+0000","last_clean":"2023-09-13T02:13:34.538371+0000","last_became_active":"2023-09-13T02:12:23.579079+0000","last_became_peered":"2023-09-13T02:12:23.579079+0000","last_unstale":"2023-09-13T02:13:34.538371+0000","last_undegraded":"2023-09-13T02:13:34.538371+0000","last_fullsized":"2023-09-13T02:13:34.538371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2023-09-13T02:13:34.538222+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2023-09-13T02:13:34.538222+0000","last_clean_scrub_stamp":"2023-09-13T02:13:34.538222+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:28:36.195030+0000","scrub_duration":0.003901832,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'52","reported_seq":94,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:50.439759+0000","last_change":"2023-09-13T02:13:50.439804+0000","last_active":"2023-09-13T02:13:50.439759+0000","last_peered":"2023-09-13T02:13:50.439759+0000","last_clean":"2023-09-13T02:13:50.439759+0000","last_became_active":"2023-09-13T02:12:24.586930+0000","last_became_peered":"2023-09-13T02:12:24.586930+0000","last_unstale":"2023-09-13T02:13:50.439759+0000","last_undegraded":"2023-09-13T02:13:50.439759+0000","last_fullsized":"2023-09-13T02:13:50.439759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'52","last_scrub_stamp":"2023-09-13T02:13:50.439661+0000","last_deep_scrub":"22'52","last_deep_scrub_stamp":"2023-09-13T02:13:50.439661+0000","last_clean_scrub_stamp":"2023-09-13T02:13:50.439661+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:11.004026+0000","scrub_duration":0.002002565,"objects_trimmed":0,"snaptrim_duration":0.0063243029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:42.241297+0000","last_change":"2023-09-13T02:13:42.241297+0000","last_active":"2023-09-13T02:13:42.241297+0000","last_peered":"2023-09-13T02:13:42.241297+0000","last_clean":"2023-09-13T02:13:42.241297+0000","last_became_active":"2023-09-13T02:12:23.585417+0000","last_became_peered":"2023-09-13T02:12:23.585417+0000","last_unstale":"2023-09-13T02:13:42.241297+0000","last_undegraded":"2023-09-13T02:13:42.241297+0000","last_fullsized":"2023-09-13T02:13:42.241297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:42.241173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:42.241173+0000","last_clean_scrub_stamp":"2023-09-13T02:13:42.241173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:39:55.326320+0000","scrub_duration":0.001782151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'73","reported_seq":115,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:04.887773+0000","last_change":"2023-09-13T02:14:04.887820+0000","last_active":"2023-09-13T02:14:04.887773+0000","last_peered":"2023-09-13T02:14:04.887773+0000","last_clean":"2023-09-13T02:14:04.887773+0000","last_became_active":"2023-09-13T02:12:24.591849+0000","last_became_peered":"2023-09-13T02:12:24.591849+0000","last_unstale":"2023-09-13T02:14:04.887773+0000","last_undegraded":"2023-09-13T02:14:04.887773+0000","last_fullsized":"2023-09-13T02:14:04.887773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'73","last_scrub_stamp":"2023-09-13T02:14:04.887684+0000","last_deep_scrub":"22'73","last_deep_scrub_stamp":"2023-09-13T02:14:04.887684+0000","last_clean_scrub_stamp":"2023-09-13T02:14:04.887684+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:30:26.366801+0000","scrub_duration":0.0015472680000000001,"objects_trimmed":0,"snaptrim_duration":0.013591097999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:45.531946+0000","last_change":"2023-09-13T02:13:45.532009+0000","last_active":"2023-09-13T02:13:45.531946+0000","last_peered":"2023-09-13T02:13:45.531946+0000","last_clean":"2023-09-13T02:13:45.531946+0000","last_became_active":"2023-09-13T02:12:23.576022+0000","last_became_peered":"2023-09-13T02:12:23.576022+0000","last_unstale":"2023-09-13T02:13:45.531946+0000","last_undegraded":"2023-09-13T02:13:45.531946+0000","last_fullsized":"2023-09-13T02:13:45.531946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:45.531836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:45.531836+0000","last_clean_scrub_stamp":"2023-09-13T02:13:45.531836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:07.611999+0000","scrub_duration":0.001749312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'33","reported_seq":75,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:14.437159+0000","last_change":"2023-09-13T02:14:14.437201+0000","last_active":"2023-09-13T02:14:14.437159+0000","last_peered":"2023-09-13T02:14:14.437159+0000","last_clean":"2023-09-13T02:14:14.437159+0000","last_became_active":"2023-09-13T02:12:24.591247+0000","last_became_peered":"2023-09-13T02:12:24.591247+0000","last_unstale":"2023-09-13T02:14:14.437159+0000","last_undegraded":"2023-09-13T02:14:14.437159+0000","last_fullsized":"2023-09-13T02:14:14.437159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'33","last_scrub_stamp":"2023-09-13T02:14:14.437072+0000","last_deep_scrub":"22'33","last_deep_scrub_stamp":"2023-09-13T02:14:14.437072+0000","last_clean_scrub_stamp":"2023-09-13T02:14:14.437072+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:24:01.475000+0000","scrub_duration":0.00222039,"objects_trimmed":0,"snaptrim_duration":0.0077636559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'13","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:40.296099+0000","last_change":"2023-09-13T02:13:40.296099+0000","last_active":"2023-09-13T02:13:40.296099+0000","last_peered":"2023-09-13T02:13:40.296099+0000","last_clean":"2023-09-13T02:13:40.296099+0000","last_became_active":"2023-09-13T02:12:23.570461+0000","last_became_peered":"2023-09-13T02:12:23.570461+0000","last_unstale":"2023-09-13T02:13:40.296099+0000","last_undegraded":"2023-09-13T02:13:40.296099+0000","last_fullsized":"2023-09-13T02:13:40.296099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'13","last_scrub_stamp":"2023-09-13T02:13:40.295924+0000","last_deep_scrub":"23'13","last_deep_scrub_stamp":"2023-09-13T02:13:40.295924+0000","last_clean_scrub_stamp":"2023-09-13T02:13:40.295924+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:09:19.656296+0000","scrub_duration":0.0091344400000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'34","reported_seq":76,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.034368+0000","last_change":"2023-09-13T02:13:43.118040+0000","last_active":"2023-09-13T02:13:44.034368+0000","last_peered":"2023-09-13T02:13:44.034368+0000","last_clean":"2023-09-13T02:13:44.034368+0000","last_became_active":"2023-09-13T02:12:24.591036+0000","last_became_peered":"2023-09-13T02:12:24.591036+0000","last_unstale":"2023-09-13T02:13:44.034368+0000","last_undegraded":"2023-09-13T02:13:44.034368+0000","last_fullsized":"2023-09-13T02:13:44.034368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'34","last_scrub_stamp":"2023-09-13T02:13:43.117902+0000","last_deep_scrub":"22'34","last_deep_scrub_stamp":"2023-09-13T02:13:43.117902+0000","last_clean_scrub_stamp":"2023-09-13T02:13:43.117902+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:03.682267+0000","scrub_duration":0.001555741,"objects_trimmed":0,"snaptrim_duration":0.013568350999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:38.593910+0000","last_change":"2023-09-13T02:13:38.593910+0000","last_active":"2023-09-13T02:13:38.593910+0000","last_peered":"2023-09-13T02:13:38.593910+0000","last_clean":"2023-09-13T02:13:38.593910+0000","last_became_active":"2023-09-13T02:12:23.584235+0000","last_became_peered":"2023-09-13T02:12:23.584235+0000","last_unstale":"2023-09-13T02:13:38.593910+0000","last_undegraded":"2023-09-13T02:13:38.593910+0000","last_fullsized":"2023-09-13T02:13:38.593910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-09-13T02:13:38.593770+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-09-13T02:13:38.593770+0000","last_clean_scrub_stamp":"2023-09-13T02:13:38.593770+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:56.569749+0000","scrub_duration":0.0037909710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'32","reported_seq":73,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:12.835908+0000","last_change":"2023-09-13T02:14:12.835981+0000","last_active":"2023-09-13T02:14:12.835908+0000","last_peered":"2023-09-13T02:14:12.835908+0000","last_clean":"2023-09-13T02:14:12.835908+0000","last_became_active":"2023-09-13T02:12:24.592242+0000","last_became_peered":"2023-09-13T02:12:24.592242+0000","last_unstale":"2023-09-13T02:14:12.835908+0000","last_undegraded":"2023-09-13T02:14:12.835908+0000","last_fullsized":"2023-09-13T02:14:12.835908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'32","last_scrub_stamp":"2023-09-13T02:14:12.835816+0000","last_deep_scrub":"24'32","last_deep_scrub_stamp":"2023-09-13T02:14:12.835816+0000","last_clean_scrub_stamp":"2023-09-13T02:14:12.835816+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:32:23.179331+0000","scrub_duration":0.0059865170000000002,"objects_trimmed":0,"snaptrim_duration":0.013102625,"stat_sum":{"num_bytes":4,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'3","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:41.313970+0000","last_change":"2023-09-13T02:13:41.313970+0000","last_active":"2023-09-13T02:13:41.313970+0000","last_peered":"2023-09-13T02:13:41.313970+0000","last_clean":"2023-09-13T02:13:41.313970+0000","last_became_active":"2023-09-13T02:12:23.577918+0000","last_became_peered":"2023-09-13T02:12:23.577918+0000","last_unstale":"2023-09-13T02:13:41.313970+0000","last_undegraded":"2023-09-13T02:13:41.313970+0000","last_fullsized":"2023-09-13T02:13:41.313970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2023-09-13T02:13:41.313825+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2023-09-13T02:13:41.313825+0000","last_clean_scrub_stamp":"2023-09-13T02:13:41.313825+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:58:09.167573+0000","scrub_duration":0.0027577909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'45","reported_seq":87,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:23.794464+0000","last_change":"2023-09-13T02:14:23.794507+0000","last_active":"2023-09-13T02:14:23.794464+0000","last_peered":"2023-09-13T02:14:23.794464+0000","last_clean":"2023-09-13T02:14:23.794464+0000","last_became_active":"2023-09-13T02:12:24.595462+0000","last_became_peered":"2023-09-13T02:12:24.595462+0000","last_unstale":"2023-09-13T02:14:23.794464+0000","last_undegraded":"2023-09-13T02:14:23.794464+0000","last_fullsized":"2023-09-13T02:14:23.794464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'45","last_scrub_stamp":"2023-09-13T02:14:23.794381+0000","last_deep_scrub":"22'45","last_deep_scrub_stamp":"2023-09-13T02:14:23.794381+0000","last_clean_scrub_stamp":"2023-09-13T02:14:23.794381+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:10:05.202839+0000","scrub_duration":0.001345293,"objects_trimmed":0,"snaptrim_duration":0.013458447,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'2","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:54.743293+0000","last_change":"2023-09-13T02:13:54.743389+0000","last_active":"2023-09-13T02:13:54.743293+0000","last_peered":"2023-09-13T02:13:54.743293+0000","last_clean":"2023-09-13T02:13:54.743293+0000","last_became_active":"2023-09-13T02:12:23.570066+0000","last_became_peered":"2023-09-13T02:12:23.570066+0000","last_unstale":"2023-09-13T02:13:54.743293+0000","last_undegraded":"2023-09-13T02:13:54.743293+0000","last_fullsized":"2023-09-13T02:13:54.743293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2023-09-13T02:13:54.743199+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2023-09-13T02:13:54.743199+0000","last_clean_scrub_stamp":"2023-09-13T02:13:54.743199+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:13:47.453817+0000","scrub_duration":0.0038240399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'35","reported_seq":77,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:03.232122+0000","last_change":"2023-09-13T02:14:03.232171+0000","last_active":"2023-09-13T02:14:03.232122+0000","last_peered":"2023-09-13T02:14:03.232122+0000","last_clean":"2023-09-13T02:14:03.232122+0000","last_became_active":"2023-09-13T02:12:24.595327+0000","last_became_peered":"2023-09-13T02:12:24.595327+0000","last_unstale":"2023-09-13T02:14:03.232122+0000","last_undegraded":"2023-09-13T02:14:03.232122+0000","last_fullsized":"2023-09-13T02:14:03.232122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'35","last_scrub_stamp":"2023-09-13T02:14:03.232026+0000","last_deep_scrub":"22'35","last_deep_scrub_stamp":"2023-09-13T02:14:03.232026+0000","last_clean_scrub_stamp":"2023-09-13T02:14:03.232026+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:48.770658+0000","scrub_duration":0.0022005940000000002,"objects_trimmed":0,"snaptrim_duration":0.010369821,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'2","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:49.342539+0000","last_change":"2023-09-13T02:13:49.342605+0000","last_active":"2023-09-13T02:13:49.342539+0000","last_peered":"2023-09-13T02:13:49.342539+0000","last_clean":"2023-09-13T02:13:49.342539+0000","last_became_active":"2023-09-13T02:12:23.582841+0000","last_became_peered":"2023-09-13T02:12:23.582841+0000","last_unstale":"2023-09-13T02:13:49.342539+0000","last_undegraded":"2023-09-13T02:13:49.342539+0000","last_fullsized":"2023-09-13T02:13:49.342539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2023-09-13T02:13:49.342427+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2023-09-13T02:13:49.342427+0000","last_clean_scrub_stamp":"2023-09-13T02:13:49.342427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:15:31.550471+0000","scrub_duration":0.002249348,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'38","reported_seq":80,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:07.862036+0000","last_change":"2023-09-13T02:14:07.862095+0000","last_active":"2023-09-13T02:14:07.862036+0000","last_peered":"2023-09-13T02:14:07.862036+0000","last_clean":"2023-09-13T02:14:07.862036+0000","last_became_active":"2023-09-13T02:12:24.590343+0000","last_became_peered":"2023-09-13T02:12:24.590343+0000","last_unstale":"2023-09-13T02:14:07.862036+0000","last_undegraded":"2023-09-13T02:14:07.862036+0000","last_fullsized":"2023-09-13T02:14:07.862036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'38","last_scrub_stamp":"2023-09-13T02:14:07.861943+0000","last_deep_scrub":"22'38","last_deep_scrub_stamp":"2023-09-13T02:14:07.861943+0000","last_clean_scrub_stamp":"2023-09-13T02:14:07.861943+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:55:10.756889+0000","scrub_duration":0.001410721,"objects_trimmed":0,"snaptrim_duration":0.013157841999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"24'119","reported_seq":181,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.132100+0000","last_change":"2023-09-13T02:13:44.132100+0000","last_active":"2023-09-13T02:13:44.132100+0000","last_peered":"2023-09-13T02:13:44.132100+0000","last_clean":"2023-09-13T02:13:44.132100+0000","last_became_active":"2023-09-13T02:12:13.260630+0000","last_became_peered":"2023-09-13T02:12:13.260630+0000","last_unstale":"2023-09-13T02:13:44.132100+0000","last_undegraded":"2023-09-13T02:13:44.132100+0000","last_fullsized":"2023-09-13T02:13:44.132100+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'119","last_scrub_stamp":"2023-09-13T02:13:44.131943+0000","last_deep_scrub":"24'119","last_deep_scrub_stamp":"2023-09-13T02:13:44.131943+0000","last_clean_scrub_stamp":"2023-09-13T02:13:44.131943+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:39:57.217089+0000","scrub_duration":0.0082749480000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.243401+0000","last_change":"2023-09-13T02:13:35.245588+0000","last_active":"2023-09-13T02:13:44.243401+0000","last_peered":"2023-09-13T02:13:44.243401+0000","last_clean":"2023-09-13T02:13:44.243401+0000","last_became_active":"2023-09-13T02:12:23.583874+0000","last_became_peered":"2023-09-13T02:12:23.583874+0000","last_unstale":"2023-09-13T02:13:44.243401+0000","last_undegraded":"2023-09-13T02:13:44.243401+0000","last_fullsized":"2023-09-13T02:13:44.243401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:35.245450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:35.245450+0000","last_clean_scrub_stamp":"2023-09-13T02:13:35.245450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:18:57.325613+0000","scrub_duration":0.0016768289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'35","reported_seq":85,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:48.551133+0000","last_change":"2023-09-13T02:13:48.551133+0000","last_active":"2023-09-13T02:13:48.551133+0000","last_peered":"2023-09-13T02:13:48.551133+0000","last_clean":"2023-09-13T02:13:48.551133+0000","last_became_active":"2023-09-13T02:13:05.918736+0000","last_became_peered":"2023-09-13T02:13:05.918736+0000","last_unstale":"2023-09-13T02:13:48.551133+0000","last_undegraded":"2023-09-13T02:13:48.551133+0000","last_fullsized":"2023-09-13T02:13:48.551133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'35","last_scrub_stamp":"2023-09-13T02:13:48.550991+0000","last_deep_scrub":"22'35","last_deep_scrub_stamp":"2023-09-13T02:13:48.550991+0000","last_clean_scrub_stamp":"2023-09-13T02:13:48.550991+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:09.115357+0000","scrub_duration":0.001473416,"objects_trimmed":0,"snaptrim_duration":0.0055331570000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"22'1","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:55.021108+0000","last_change":"2023-09-13T02:13:55.021108+0000","last_active":"2023-09-13T02:13:55.021108+0000","last_peered":"2023-09-13T02:13:55.021108+0000","last_clean":"2023-09-13T02:13:55.021108+0000","last_became_active":"2023-09-13T02:12:23.580670+0000","last_became_peered":"2023-09-13T02:12:23.580670+0000","last_unstale":"2023-09-13T02:13:55.021108+0000","last_undegraded":"2023-09-13T02:13:55.021108+0000","last_fullsized":"2023-09-13T02:13:55.021108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-09-13T02:13:55.020970+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-09-13T02:13:55.020970+0000","last_clean_scrub_stamp":"2023-09-13T02:13:55.020970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:00:22.644454+0000","scrub_duration":0.002331919,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'24","reported_seq":67,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.125824+0000","last_change":"2023-09-13T02:13:43.492872+0000","last_active":"2023-09-13T02:13:44.125824+0000","last_peered":"2023-09-13T02:13:44.125824+0000","last_clean":"2023-09-13T02:13:44.125824+0000","last_became_active":"2023-09-13T02:12:24.578715+0000","last_became_peered":"2023-09-13T02:12:24.578715+0000","last_unstale":"2023-09-13T02:13:44.125824+0000","last_undegraded":"2023-09-13T02:13:44.125824+0000","last_fullsized":"2023-09-13T02:13:44.125824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2023-09-13T02:13:43.492725+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2023-09-13T02:13:43.492725+0000","last_clean_scrub_stamp":"2023-09-13T02:13:43.492725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:05.572888+0000","scrub_duration":0.001908161,"objects_trimmed":0,"snaptrim_duration":0.0043944989999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'15","reported_seq":54,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.862984+0000","last_change":"2023-09-13T02:13:37.258923+0000","last_active":"2023-09-13T02:13:43.862984+0000","last_peered":"2023-09-13T02:13:43.862984+0000","last_clean":"2023-09-13T02:13:43.862984+0000","last_became_active":"2023-09-13T02:12:23.577786+0000","last_became_peered":"2023-09-13T02:12:23.577786+0000","last_unstale":"2023-09-13T02:13:43.862984+0000","last_undegraded":"2023-09-13T02:13:43.862984+0000","last_fullsized":"2023-09-13T02:13:43.862984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'15","last_scrub_stamp":"2023-09-13T02:13:37.258768+0000","last_deep_scrub":"22'15","last_deep_scrub_stamp":"2023-09-13T02:13:37.258768+0000","last_clean_scrub_stamp":"2023-09-13T02:13:37.258768+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:55.234747+0000","scrub_duration":0.001911905,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5781,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":13,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'46","reported_seq":89,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:03.687651+0000","last_change":"2023-09-13T02:14:03.687651+0000","last_active":"2023-09-13T02:14:03.687651+0000","last_peered":"2023-09-13T02:14:03.687651+0000","last_clean":"2023-09-13T02:14:03.687651+0000","last_became_active":"2023-09-13T02:12:24.582439+0000","last_became_peered":"2023-09-13T02:12:24.582439+0000","last_unstale":"2023-09-13T02:14:03.687651+0000","last_undegraded":"2023-09-13T02:14:03.687651+0000","last_fullsized":"2023-09-13T02:14:03.687651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'46","last_scrub_stamp":"2023-09-13T02:14:03.687510+0000","last_deep_scrub":"22'46","last_deep_scrub_stamp":"2023-09-13T02:14:03.687510+0000","last_clean_scrub_stamp":"2023-09-13T02:14:03.687510+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:04:01.708158+0000","scrub_duration":0.001478236,"objects_trimmed":0,"snaptrim_duration":0.003781501,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.243883+0000","last_change":"2023-09-13T02:13:41.290553+0000","last_active":"2023-09-13T02:13:44.243883+0000","last_peered":"2023-09-13T02:13:44.243883+0000","last_clean":"2023-09-13T02:13:44.243883+0000","last_became_active":"2023-09-13T02:12:23.585349+0000","last_became_peered":"2023-09-13T02:12:23.585349+0000","last_unstale":"2023-09-13T02:13:44.243883+0000","last_undegraded":"2023-09-13T02:13:44.243883+0000","last_fullsized":"2023-09-13T02:13:44.243883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:41.290413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:41.290413+0000","last_clean_scrub_stamp":"2023-09-13T02:13:41.290413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:01.854778+0000","scrub_duration":0.0021446849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'33","reported_seq":76,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:43.863920+0000","last_change":"2023-09-13T02:13:43.543289+0000","last_active":"2023-09-13T02:13:43.863920+0000","last_peered":"2023-09-13T02:13:43.863920+0000","last_clean":"2023-09-13T02:13:43.863920+0000","last_became_active":"2023-09-13T02:12:24.585054+0000","last_became_peered":"2023-09-13T02:12:24.585054+0000","last_unstale":"2023-09-13T02:13:43.863920+0000","last_undegraded":"2023-09-13T02:13:43.863920+0000","last_fullsized":"2023-09-13T02:13:43.863920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'33","last_scrub_stamp":"2023-09-13T02:13:43.543086+0000","last_deep_scrub":"22'33","last_deep_scrub_stamp":"2023-09-13T02:13:43.543086+0000","last_clean_scrub_stamp":"2023-09-13T02:13:43.543086+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:28:45.199893+0000","scrub_duration":0.001743007,"objects_trimmed":0,"snaptrim_duration":0.0030300140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:46.777621+0000","last_change":"2023-09-13T02:13:46.777621+0000","last_active":"2023-09-13T02:13:46.777621+0000","last_peered":"2023-09-13T02:13:46.777621+0000","last_clean":"2023-09-13T02:13:46.777621+0000","last_became_active":"2023-09-13T02:12:23.579844+0000","last_became_peered":"2023-09-13T02:12:23.579844+0000","last_unstale":"2023-09-13T02:13:46.777621+0000","last_undegraded":"2023-09-13T02:13:46.777621+0000","last_fullsized":"2023-09-13T02:13:46.777621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:46.777446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:46.777446+0000","last_clean_scrub_stamp":"2023-09-13T02:13:46.777446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:15:28.985490+0000","scrub_duration":0.001613361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'32","reported_seq":75,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:00.233057+0000","last_change":"2023-09-13T02:14:00.233057+0000","last_active":"2023-09-13T02:14:00.233057+0000","last_peered":"2023-09-13T02:14:00.233057+0000","last_clean":"2023-09-13T02:14:00.233057+0000","last_became_active":"2023-09-13T02:12:24.592436+0000","last_became_peered":"2023-09-13T02:12:24.592436+0000","last_unstale":"2023-09-13T02:14:00.233057+0000","last_undegraded":"2023-09-13T02:14:00.233057+0000","last_fullsized":"2023-09-13T02:14:00.233057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'32","last_scrub_stamp":"2023-09-13T02:14:00.232906+0000","last_deep_scrub":"22'32","last_deep_scrub_stamp":"2023-09-13T02:14:00.232906+0000","last_clean_scrub_stamp":"2023-09-13T02:14:00.232906+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:07.398505+0000","scrub_duration":0.0021228039999999998,"objects_trimmed":0,"snaptrim_duration":0.010782369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:00.873236+0000","last_change":"2023-09-13T02:14:00.873236+0000","last_active":"2023-09-13T02:14:00.873236+0000","last_peered":"2023-09-13T02:14:00.873236+0000","last_clean":"2023-09-13T02:14:00.873236+0000","last_became_active":"2023-09-13T02:12:23.585411+0000","last_became_peered":"2023-09-13T02:12:23.585411+0000","last_unstale":"2023-09-13T02:14:00.873236+0000","last_undegraded":"2023-09-13T02:14:00.873236+0000","last_fullsized":"2023-09-13T02:14:00.873236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:14:00.873057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:14:00.873057+0000","last_clean_scrub_stamp":"2023-09-13T02:14:00.873057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:08.038656+0000","scrub_duration":0.001554197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'45","reported_seq":88,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:12.714010+0000","last_change":"2023-09-13T02:14:12.714010+0000","last_active":"2023-09-13T02:14:12.714010+0000","last_peered":"2023-09-13T02:14:12.714010+0000","last_clean":"2023-09-13T02:14:12.714010+0000","last_became_active":"2023-09-13T02:12:24.582517+0000","last_became_peered":"2023-09-13T02:12:24.582517+0000","last_unstale":"2023-09-13T02:14:12.714010+0000","last_undegraded":"2023-09-13T02:14:12.714010+0000","last_fullsized":"2023-09-13T02:14:12.714010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'45","last_scrub_stamp":"2023-09-13T02:14:12.713862+0000","last_deep_scrub":"22'45","last_deep_scrub_stamp":"2023-09-13T02:14:12.713862+0000","last_clean_scrub_stamp":"2023-09-13T02:14:12.713862+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:19.879461+0000","scrub_duration":0.0015342439999999999,"objects_trimmed":0,"snaptrim_duration":0.0039709990000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'6","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:48.787190+0000","last_change":"2023-09-13T02:13:48.787277+0000","last_active":"2023-09-13T02:13:48.787190+0000","last_peered":"2023-09-13T02:13:48.787190+0000","last_clean":"2023-09-13T02:13:48.787190+0000","last_became_active":"2023-09-13T02:12:23.575875+0000","last_became_peered":"2023-09-13T02:12:23.575875+0000","last_unstale":"2023-09-13T02:13:48.787190+0000","last_undegraded":"2023-09-13T02:13:48.787190+0000","last_fullsized":"2023-09-13T02:13:48.787190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2023-09-13T02:13:48.787080+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2023-09-13T02:13:48.787080+0000","last_clean_scrub_stamp":"2023-09-13T02:13:48.787080+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:10.867244+0000","scrub_duration":0.0022005359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'31","reported_seq":73,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:11.558539+0000","last_change":"2023-09-13T02:14:11.558588+0000","last_active":"2023-09-13T02:14:11.558539+0000","last_peered":"2023-09-13T02:14:11.558539+0000","last_clean":"2023-09-13T02:14:11.558539+0000","last_became_active":"2023-09-13T02:12:24.592247+0000","last_became_peered":"2023-09-13T02:12:24.592247+0000","last_unstale":"2023-09-13T02:14:11.558539+0000","last_undegraded":"2023-09-13T02:14:11.558539+0000","last_fullsized":"2023-09-13T02:14:11.558539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'31","last_scrub_stamp":"2023-09-13T02:14:11.558445+0000","last_deep_scrub":"22'31","last_deep_scrub_stamp":"2023-09-13T02:14:11.558445+0000","last_clean_scrub_stamp":"2023-09-13T02:14:11.558445+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:57.097078+0000","scrub_duration":0.001809022,"objects_trimmed":0,"snaptrim_duration":0.005600257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'5","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:53.637440+0000","last_change":"2023-09-13T02:13:53.637482+0000","last_active":"2023-09-13T02:13:53.637440+0000","last_peered":"2023-09-13T02:13:53.637440+0000","last_clean":"2023-09-13T02:13:53.637440+0000","last_became_active":"2023-09-13T02:12:23.579389+0000","last_became_peered":"2023-09-13T02:12:23.579389+0000","last_unstale":"2023-09-13T02:13:53.637440+0000","last_undegraded":"2023-09-13T02:13:53.637440+0000","last_fullsized":"2023-09-13T02:13:53.637440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5","last_scrub_stamp":"2023-09-13T02:13:53.637361+0000","last_deep_scrub":"24'5","last_deep_scrub_stamp":"2023-09-13T02:13:53.637361+0000","last_clean_scrub_stamp":"2023-09-13T02:13:53.637361+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:40:06.722507+0000","scrub_duration":0.0027642069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'42","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:51.458114+0000","last_change":"2023-09-13T02:13:51.458182+0000","last_active":"2023-09-13T02:13:51.458114+0000","last_peered":"2023-09-13T02:13:51.458114+0000","last_clean":"2023-09-13T02:13:51.458114+0000","last_became_active":"2023-09-13T02:12:24.584791+0000","last_became_peered":"2023-09-13T02:12:24.584791+0000","last_unstale":"2023-09-13T02:13:51.458114+0000","last_undegraded":"2023-09-13T02:13:51.458114+0000","last_fullsized":"2023-09-13T02:13:51.458114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'42","last_scrub_stamp":"2023-09-13T02:13:51.458031+0000","last_deep_scrub":"22'42","last_deep_scrub_stamp":"2023-09-13T02:13:51.458031+0000","last_clean_scrub_stamp":"2023-09-13T02:13:51.458031+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:40:04.543178+0000","scrub_duration":0.001389373,"objects_trimmed":0,"snaptrim_duration":0.0066515319999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'1","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:49.025031+0000","last_change":"2023-09-13T02:13:49.025087+0000","last_active":"2023-09-13T02:13:49.025031+0000","last_peered":"2023-09-13T02:13:49.025031+0000","last_clean":"2023-09-13T02:13:49.025031+0000","last_became_active":"2023-09-13T02:12:23.585321+0000","last_became_peered":"2023-09-13T02:12:23.585321+0000","last_unstale":"2023-09-13T02:13:49.025031+0000","last_undegraded":"2023-09-13T02:13:49.025031+0000","last_fullsized":"2023-09-13T02:13:49.025031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-09-13T02:13:49.024944+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-09-13T02:13:49.024944+0000","last_clean_scrub_stamp":"2023-09-13T02:13:49.024944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:09:28.855756+0000","scrub_duration":0.001872844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'13","reported_seq":55,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:52.536398+0000","last_change":"2023-09-13T02:13:52.536493+0000","last_active":"2023-09-13T02:13:52.536398+0000","last_peered":"2023-09-13T02:13:52.536398+0000","last_clean":"2023-09-13T02:13:52.536398+0000","last_became_active":"2023-09-13T02:12:24.586072+0000","last_became_peered":"2023-09-13T02:12:24.586072+0000","last_unstale":"2023-09-13T02:13:52.536398+0000","last_undegraded":"2023-09-13T02:13:52.536398+0000","last_fullsized":"2023-09-13T02:13:52.536398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'13","last_scrub_stamp":"2023-09-13T02:13:52.536294+0000","last_deep_scrub":"22'13","last_deep_scrub_stamp":"2023-09-13T02:13:52.536294+0000","last_clean_scrub_stamp":"2023-09-13T02:13:52.536294+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:14.616457+0000","scrub_duration":0.0021574200000000002,"objects_trimmed":0,"snaptrim_duration":0.002920593,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T02:13:35.678606+0000","last_change":"2023-09-13T02:13:35.678606+0000","last_active":"2023-09-13T02:13:35.678606+0000","last_peered":"2023-09-13T02:13:35.678606+0000","last_clean":"2023-09-13T02:13:35.678606+0000","last_became_active":"2023-09-13T02:12:23.578649+0000","last_became_peered":"2023-09-13T02:12:23.578649+0000","last_unstale":"2023-09-13T02:13:35.678606+0000","last_undegraded":"2023-09-13T02:13:35.678606+0000","last_fullsized":"2023-09-13T02:13:35.678606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T02:13:35.678498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T02:13:35.678498+0000","last_clean_scrub_stamp":"2023-09-13T02:13:35.678498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T04:09:15.038871+0000","scrub_duration":0.0013642319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'43","reported_seq":82,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:00.258233+0000","last_change":"2023-09-13T02:14:00.258280+0000","last_active":"2023-09-13T02:14:00.258233+0000","last_peered":"2023-09-13T02:14:00.258233+0000","last_clean":"2023-09-13T02:14:00.258233+0000","last_became_active":"2023-09-13T02:13:05.914007+0000","last_became_peered":"2023-09-13T02:13:05.914007+0000","last_unstale":"2023-09-13T02:14:00.258233+0000","last_undegraded":"2023-09-13T02:14:00.258233+0000","last_fullsized":"2023-09-13T02:14:00.258233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2023-09-13T02:14:00.258150+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2023-09-13T02:14:00.258150+0000","last_clean_scrub_stamp":"2023-09-13T02:14:00.258150+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:41:40.682053+0000","scrub_duration":0.0014043689999999999,"objects_trimmed":0,"snaptrim_duration":0.0012388329999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:55.748830+0000","last_change":"2023-09-13T02:13:55.748877+0000","last_active":"2023-09-13T02:13:55.748830+0000","last_peered":"2023-09-13T02:13:55.748830+0000","last_clean":"2023-09-13T02:13:55.748830+0000","last_became_active":"2023-09-13T02:12:23.578121+0000","last_became_peered":"2023-09-13T02:12:23.578121+0000","last_unstale":"2023-09-13T02:13:55.748830+0000","last_undegraded":"2023-09-13T02:13:55.748830+0000","last_fullsized":"2023-09-13T02:13:55.748830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-09-13T02:13:55.748727+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-09-13T02:13:55.748727+0000","last_clean_scrub_stamp":"2023-09-13T02:13:55.748727+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:16.313093+0000","scrub_duration":0.0014883450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'42","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:50.542763+0000","last_change":"2023-09-13T02:13:50.542813+0000","last_active":"2023-09-13T02:13:50.542763+0000","last_peered":"2023-09-13T02:13:50.542763+0000","last_clean":"2023-09-13T02:13:50.542763+0000","last_became_active":"2023-09-13T02:12:24.587040+0000","last_became_peered":"2023-09-13T02:12:24.587040+0000","last_unstale":"2023-09-13T02:13:50.542763+0000","last_undegraded":"2023-09-13T02:13:50.542763+0000","last_fullsized":"2023-09-13T02:13:50.542763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'42","last_scrub_stamp":"2023-09-13T02:13:50.542679+0000","last_deep_scrub":"22'42","last_deep_scrub_stamp":"2023-09-13T02:13:50.542679+0000","last_clean_scrub_stamp":"2023-09-13T02:13:50.542679+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:41:30.966582+0000","scrub_duration":0.0013316300000000001,"objects_trimmed":0,"snaptrim_duration":0.0055712349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'5","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:52.003358+0000","last_change":"2023-09-13T02:13:52.003423+0000","last_active":"2023-09-13T02:13:52.003358+0000","last_peered":"2023-09-13T02:13:52.003358+0000","last_clean":"2023-09-13T02:13:52.003358+0000","last_became_active":"2023-09-13T02:12:23.578258+0000","last_became_peered":"2023-09-13T02:12:23.578258+0000","last_unstale":"2023-09-13T02:13:52.003358+0000","last_undegraded":"2023-09-13T02:13:52.003358+0000","last_fullsized":"2023-09-13T02:13:52.003358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5","last_scrub_stamp":"2023-09-13T02:13:52.003272+0000","last_deep_scrub":"24'5","last_deep_scrub_stamp":"2023-09-13T02:13:52.003272+0000","last_clean_scrub_stamp":"2023-09-13T02:13:52.003272+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:03:50.023919+0000","scrub_duration":0.0027335189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'29","reported_seq":71,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:12.463445+0000","last_change":"2023-09-13T02:14:12.463526+0000","last_active":"2023-09-13T02:14:12.463445+0000","last_peered":"2023-09-13T02:14:12.463445+0000","last_clean":"2023-09-13T02:14:12.463445+0000","last_became_active":"2023-09-13T02:12:24.590494+0000","last_became_peered":"2023-09-13T02:12:24.590494+0000","last_unstale":"2023-09-13T02:14:12.463445+0000","last_undegraded":"2023-09-13T02:14:12.463445+0000","last_fullsized":"2023-09-13T02:14:12.463445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'29","last_scrub_stamp":"2023-09-13T02:14:12.463340+0000","last_deep_scrub":"22'29","last_deep_scrub_stamp":"2023-09-13T02:14:12.463340+0000","last_clean_scrub_stamp":"2023-09-13T02:14:12.463340+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:54:05.978074+0000","scrub_duration":0.0014357459999999999,"objects_trimmed":0,"snaptrim_duration":0.0050570779999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'70","reported_seq":112,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:13.253112+0000","last_change":"2023-09-13T02:14:13.253162+0000","last_active":"2023-09-13T02:14:13.253112+0000","last_peered":"2023-09-13T02:14:13.253112+0000","last_clean":"2023-09-13T02:14:13.253112+0000","last_became_active":"2023-09-13T02:12:24.597024+0000","last_became_peered":"2023-09-13T02:12:24.597024+0000","last_unstale":"2023-09-13T02:14:13.253112+0000","last_undegraded":"2023-09-13T02:14:13.253112+0000","last_fullsized":"2023-09-13T02:14:13.253112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'70","last_scrub_stamp":"2023-09-13T02:14:13.253016+0000","last_deep_scrub":"22'70","last_deep_scrub_stamp":"2023-09-13T02:14:13.253016+0000","last_clean_scrub_stamp":"2023-09-13T02:14:13.253016+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:32:23.596530+0000","scrub_duration":0.0015112120000000001,"objects_trimmed":0,"snaptrim_duration":0.010975594999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"24'3","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:59.919484+0000","last_change":"2023-09-13T02:13:59.919540+0000","last_active":"2023-09-13T02:13:59.919484+0000","last_peered":"2023-09-13T02:13:59.919484+0000","last_clean":"2023-09-13T02:13:59.919484+0000","last_became_active":"2023-09-13T02:12:23.584671+0000","last_became_peered":"2023-09-13T02:12:23.584671+0000","last_unstale":"2023-09-13T02:13:59.919484+0000","last_undegraded":"2023-09-13T02:13:59.919484+0000","last_fullsized":"2023-09-13T02:13:59.919484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2023-09-13T02:13:59.919401+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2023-09-13T02:13:59.919401+0000","last_clean_scrub_stamp":"2023-09-13T02:13:59.919401+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:52:53.999854+0000","scrub_duration":0.0025323730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'41","reported_seq":83,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:10.221150+0000","last_change":"2023-09-13T02:14:10.221207+0000","last_active":"2023-09-13T02:14:10.221150+0000","last_peered":"2023-09-13T02:14:10.221150+0000","last_clean":"2023-09-13T02:14:10.221150+0000","last_became_active":"2023-09-13T02:12:24.595918+0000","last_became_peered":"2023-09-13T02:12:24.595918+0000","last_unstale":"2023-09-13T02:14:10.221150+0000","last_undegraded":"2023-09-13T02:14:10.221150+0000","last_fullsized":"2023-09-13T02:14:10.221150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'41","last_scrub_stamp":"2023-09-13T02:14:10.221043+0000","last_deep_scrub":"22'41","last_deep_scrub_stamp":"2023-09-13T02:14:10.221043+0000","last_clean_scrub_stamp":"2023-09-13T02:14:10.221043+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:25:34.091614+0000","scrub_duration":0.001603978,"objects_trimmed":0,"snaptrim_duration":0.010091243999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'4","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:01.850933+0000","last_change":"2023-09-13T02:14:01.850989+0000","last_active":"2023-09-13T02:14:01.850933+0000","last_peered":"2023-09-13T02:14:01.850933+0000","last_clean":"2023-09-13T02:14:01.850933+0000","last_became_active":"2023-09-13T02:12:23.579239+0000","last_became_peered":"2023-09-13T02:12:23.579239+0000","last_unstale":"2023-09-13T02:14:01.850933+0000","last_undegraded":"2023-09-13T02:14:01.850933+0000","last_fullsized":"2023-09-13T02:14:01.850933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4","last_scrub_stamp":"2023-09-13T02:14:01.850843+0000","last_deep_scrub":"24'4","last_deep_scrub_stamp":"2023-09-13T02:14:01.850843+0000","last_clean_scrub_stamp":"2023-09-13T02:14:01.850843+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:20.772124+0000","scrub_duration":0.0027872470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'35","reported_seq":78,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:08.402576+0000","last_change":"2023-09-13T02:14:08.402576+0000","last_active":"2023-09-13T02:14:08.402576+0000","last_peered":"2023-09-13T02:14:08.402576+0000","last_clean":"2023-09-13T02:14:08.402576+0000","last_became_active":"2023-09-13T02:12:24.589039+0000","last_became_peered":"2023-09-13T02:12:24.589039+0000","last_unstale":"2023-09-13T02:14:08.402576+0000","last_undegraded":"2023-09-13T02:14:08.402576+0000","last_fullsized":"2023-09-13T02:14:08.402576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'35","last_scrub_stamp":"2023-09-13T02:14:08.402426+0000","last_deep_scrub":"22'35","last_deep_scrub_stamp":"2023-09-13T02:14:08.402426+0000","last_clean_scrub_stamp":"2023-09-13T02:14:08.402426+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:19:15.568026+0000","scrub_duration":0.001868813,"objects_trimmed":0,"snaptrim_duration":0.0066201710000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.540078+0000","last_change":"2023-09-13T02:13:41.502547+0000","last_active":"2023-09-13T02:13:44.540078+0000","last_peered":"2023-09-13T02:13:44.540078+0000","last_clean":"2023-09-13T02:13:44.540078+0000","last_became_active":"2023-09-13T02:12:23.583920+0000","last_became_peered":"2023-09-13T02:12:23.583920+0000","last_unstale":"2023-09-13T02:13:44.540078+0000","last_undegraded":"2023-09-13T02:13:44.540078+0000","last_fullsized":"2023-09-13T02:13:44.540078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2023-09-13T02:13:41.502420+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2023-09-13T02:13:41.502420+0000","last_clean_scrub_stamp":"2023-09-13T02:13:41.502420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:27:11.456352+0000","scrub_duration":0.001286082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'26","reported_seq":69,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:14:17.729446+0000","last_change":"2023-09-13T02:14:17.729446+0000","last_active":"2023-09-13T02:14:17.729446+0000","last_peered":"2023-09-13T02:14:17.729446+0000","last_clean":"2023-09-13T02:14:17.729446+0000","last_became_active":"2023-09-13T02:12:24.587697+0000","last_became_peered":"2023-09-13T02:12:24.587697+0000","last_unstale":"2023-09-13T02:14:17.729446+0000","last_undegraded":"2023-09-13T02:14:17.729446+0000","last_fullsized":"2023-09-13T02:14:17.729446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'26","last_scrub_stamp":"2023-09-13T02:14:17.729262+0000","last_deep_scrub":"22'26","last_deep_scrub_stamp":"2023-09-13T02:14:17.729262+0000","last_clean_scrub_stamp":"2023-09-13T02:14:17.729262+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:55:20.624207+0000","scrub_duration":0.0019290609999999999,"objects_trimmed":0,"snaptrim_duration":0.0056801320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'7","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T02:13:44.126473+0000","last_change":"2023-09-13T02:13:41.484295+0000","last_active":"2023-09-13T02:13:44.126473+0000","last_peered":"2023-09-13T02:13:44.126473+0000","last_clean":"2023-09-13T02:13:44.126473+0000","last_became_active":"2023-09-13T02:12:23.583443+0000","last_became_peered":"2023-09-13T02:12:23.583443+0000","last_unstale":"2023-09-13T02:13:44.126473+0000","last_undegraded":"2023-09-13T02:13:44.126473+0000","last_fullsized":"2023-09-13T02:13:44.126473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2023-09-13T02:13:41.484120+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2023-09-13T02:13:41.484120+0000","last_clean_scrub_stamp":"2023-09-13T02:13:41.484120+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:15:23.692164+0000","scrub_duration":0.0038019579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":12,"num_objects":5,"num_object_clones":3,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":24,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2590,"ondisk_log_size":2590,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":550373,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":16,"num_write":219,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1163264,"data_stored":1100746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":248,"ondisk_log_size":248,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":856064,"data_stored":686971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.438,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.65000000000000002,"5min":1.387,"15min":1.387},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.40699999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.71499999999999997,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.59299999999999997}]},{"osd":1,"last update":"Wed Sep 13 02:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.42599999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71499999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.626},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.5,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76800000000000002,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.61299999999999999}]},{"osd":2,"last update":"Wed Sep 13 02:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.41799999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.752,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.53600000000000003},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.65300000000000002,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.46200000000000002}]},{"osd":3,"last update":"Wed Sep 13 02:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.46400000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.72699999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.69299999999999995,"5min":0.998,"15min":0.998},"last":0.51800000000000002}]},{"osd":4,"last update":"Wed Sep 13 02:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.47099999999999997,"15min":0.47999999999999998},"min":{"1min":0.31900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.60099999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51900000000000002,"15min":0.52700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68100000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.39300000000000002}]},{"osd":5,"last update":"Wed Sep 13 02:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.51400000000000001,"15min":0.52200000000000002},"min":{"1min":0.35099999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.65100000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.54900000000000004,"15min":0.56200000000000006},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67400000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.437}]},{"osd":6,"last update":"Wed Sep 13 02:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.55500000000000005,"15min":0.56799999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69699999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.497},{"interface":"front","average":{"1min":0.502,"5min":0.57199999999999995,"15min":0.58399999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66500000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.53400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":806912,"data_stored":639811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.40400000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72399999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.497,"15min":0.48899999999999999},"min":{"1min":0.432,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66800000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.75}]},{"osd":1,"last update":"Wed Sep 13 02:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.438,"5min":0.312,"15min":0.312},"max":{"1min":0.66200000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54300000000000004,"15min":0.53600000000000003},"min":{"1min":0.44700000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.75600000000000001,"5min":0.88,"15min":0.88},"last":0.874}]},{"osd":2,"last update":"Wed Sep 13 02:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.41899999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66900000000000004,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.45800000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.69299999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.84499999999999997}]},{"osd":3,"last update":"Wed Sep 13 02:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70499999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.44900000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.752,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.97299999999999998}]},{"osd":4,"last update":"Wed Sep 13 02:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.32300000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.70499999999999996,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71799999999999997,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.67600000000000005}]},{"osd":5,"last update":"Wed Sep 13 02:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.53500000000000003,"15min":0.54700000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71599999999999997,"5min":0.754,"15min":0.754},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77300000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":1.0149999999999999}]},{"osd":7,"last update":"Wed Sep 13 02:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.56200000000000006,"15min":0.57199999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.61199999999999999,"15min":0.623},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73799999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.64600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":96115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.28299999999999997,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.379,"5min":0.309,"15min":0.309},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.57099999999999995}]},{"osd":1,"last update":"Wed Sep 13 02:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69099999999999995,"5min":1.298,"15min":1.298},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed Sep 13 02:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.42299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.35999999999999999}]},{"osd":3,"last update":"Wed Sep 13 02:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.71199999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.39400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.54800000000000004}]},{"osd":4,"last update":"Wed Sep 13 02:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.55700000000000005,"15min":0.57399999999999995},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67500000000000004,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.55100000000000005,"15min":0.56599999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.627}]},{"osd":6,"last update":"Wed Sep 13 02:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.65800000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.59699999999999998,"15min":0.61499999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72499999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.70199999999999996}]},{"osd":7,"last update":"Wed Sep 13 02:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74199999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.498},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.61199999999999999,"15min":0.621},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76200000000000001,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.60599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":96147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.51100000000000001,"15min":0.499},"min":{"1min":0.48499999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73299999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.51700000000000002,"15min":0.503},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.73799999999999999}]},{"osd":1,"last update":"Wed Sep 13 02:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.42899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.66700000000000004,"5min":1.121,"15min":1.121},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.52300000000000002,"15min":0.51100000000000001},"min":{"1min":0.41099999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.746,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.72299999999999998}]},{"osd":2,"last update":"Wed Sep 13 02:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.35299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76300000000000001,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.68300000000000005}]},{"osd":3,"last update":"Wed Sep 13 02:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.754,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.44600000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71099999999999997,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.754}]},{"osd":5,"last update":"Wed Sep 13 02:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.501},{"interface":"front","average":{"1min":0.503,"5min":0.55500000000000005,"15min":0.56399999999999995},"min":{"1min":0.33300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.78300000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.54000000000000004}]},{"osd":6,"last update":"Wed Sep 13 02:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71399999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.56999999999999995}]},{"osd":7,"last update":"Wed Sep 13 02:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.38400000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.80700000000000005,"5min":1.22,"15min":1.22},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59699999999999998,"15min":0.59999999999999998},"min":{"1min":0.438,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79300000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.63}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":815104,"data_stored":645592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.318,"15min":0.318},"min":{"1min":0.21099999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.29499999999999998,"15min":0.28299999999999997},"min":{"1min":0.27800000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.33700000000000002}]},{"osd":1,"last update":"Wed Sep 13 02:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.33400000000000002,"15min":0.32800000000000001},"min":{"1min":0.247,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57299999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.441},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56200000000000006,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.376}]},{"osd":2,"last update":"Wed Sep 13 02:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.372,"15min":0.371},"min":{"1min":0.27900000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51600000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38300000000000001,"15min":0.38},"min":{"1min":0.314,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.41899999999999998}]},{"osd":4,"last update":"Wed Sep 13 02:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60399999999999998,"15min":0.61299999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76600000000000001,"5min":1.133,"15min":1.133},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.46100000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91500000000000004,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.59799999999999998}]},{"osd":5,"last update":"Wed Sep 13 02:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.39900000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59999999999999998,"15min":0.60399999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.77900000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.79500000000000004}]},{"osd":6,"last update":"Wed Sep 13 02:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.40100000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79200000000000004,"5min":1.046,"15min":1.046},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.622,"15min":0.625},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85999999999999999,"5min":1.109,"15min":1.109},"last":0.63}]},{"osd":7,"last update":"Wed Sep 13 02:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81899999999999995,"5min":1.024,"15min":1.024},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.621,"15min":0.627},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.84299999999999997,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.75900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":101798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:14:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.33400000000000002,"15min":0.32600000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35199999999999998,"15min":0.34699999999999998},"min":{"1min":0.23999999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.38700000000000001}]},{"osd":1,"last update":"Wed Sep 13 02:14:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35199999999999998,"15min":0.34499999999999997},"min":{"1min":0.254,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.26700000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.373}]},{"osd":3,"last update":"Wed Sep 13 02:14:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.373,"15min":0.37},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.41299999999999998,"15min":0.41099999999999998},"min":{"1min":0.28100000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.44700000000000001}]},{"osd":4,"last update":"Wed Sep 13 02:14:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63,"15min":0.63200000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56899999999999995}]},{"osd":5,"last update":"Wed Sep 13 02:14:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.76600000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.63200000000000001}]},{"osd":6,"last update":"Wed Sep 13 02:14:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.51300000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46999999999999997,"5min":0.432,"15min":0.432},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.76200000000000001}]},{"osd":7,"last update":"Wed Sep 13 02:14:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.47499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.58499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":96177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 02:14:19 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.30599999999999999,"15min":0.30499999999999999},"min":{"1min":0.20100000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.317,"15min":0.313},"min":{"1min":0.254,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.42099999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.38700000000000001}]},{"osd":2,"last update":"Wed Sep 13 02:14:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32700000000000001,"15min":0.32500000000000001},"min":{"1min":0.20899999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.45600000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.375,"15min":0.373},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.50800000000000001}]},{"osd":3,"last update":"Wed Sep 13 02:14:19 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.46899999999999997,"5min":0.497,"15min":0.497},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.36399999999999999,"15min":0.36799999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.47899999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.44700000000000001}]},{"osd":4,"last update":"Wed Sep 13 02:14:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.622}]},{"osd":5,"last update":"Wed Sep 13 02:14:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.72199999999999998}]},{"osd":6,"last update":"Wed Sep 13 02:14:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60799999999999998,"15min":0.60599999999999998},"min":{"1min":0.45700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42799999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.84999999999999998}]},{"osd":7,"last update":"Wed Sep 13 02:14:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.58999999999999997},"min":{"1min":0.40899999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70499999999999996,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.74199999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.64000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":864256,"data_stored":686012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 02:14:15 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35299999999999998,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.223,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.44900000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.49399999999999999}]},{"osd":2,"last update":"Wed Sep 13 02:14:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.26500000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.53600000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38200000000000001,"15min":0.38100000000000001},"min":{"1min":0.25900000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.55100000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.36899999999999999}]},{"osd":3,"last update":"Wed Sep 13 02:14:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.372,"15min":0.375},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.48299999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.30499999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.5,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.51600000000000001}]},{"osd":4,"last update":"Wed Sep 13 02:14:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.47299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78800000000000003,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.49299999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.68799999999999994}]},{"osd":5,"last update":"Wed Sep 13 02:14:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.46500000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.80000000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.64700000000000002}]},{"osd":6,"last update":"Wed Sep 13 02:14:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.47799999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.77500000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.59899999999999998,"15min":0.59399999999999997},"min":{"1min":0.496,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.70099999999999996}]},{"osd":7,"last update":"Wed Sep 13 02:14:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63300000000000001,"15min":0.626},"min":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.49399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82999999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.67600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":5781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":549575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":543794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T02:14:37.393 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-09-13T02:14:37.526 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.524+0000 7f8c2bed7640 1 -- 172.21.15.104:0/1648403045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c240b02e0 msgr2=0x7f8c241443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:37.526 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.524+0000 7f8c2bed7640 1 --2- 172.21.15.104:0/1648403045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c240b02e0 0x7f8c241443b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8c24071b30 tx=0x7f8c2002bd10 comp rx=0 tx=0).stop 2023-09-13T02:14:37.527 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.524+0000 7f8c2bed7640 1 -- 172.21.15.104:0/1648403045 shutdown_connections 2023-09-13T02:14:37.527 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.524+0000 7f8c2bed7640 1 --2- 172.21.15.104:0/1648403045 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c24140dc0 0x7f8c24141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.528 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.524+0000 7f8c2bed7640 1 --2- 172.21.15.104:0/1648403045 >> v2:172.21.15.119:3300/0 conn(0x7f8c2413ab80 0x7f8c2413afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.528 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.524+0000 7f8c2bed7640 1 --2- 172.21.15.104:0/1648403045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c240b02e0 0x7f8c241443b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.528 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.524+0000 7f8c2bed7640 1 -- 172.21.15.104:0/1648403045 >> 172.21.15.104:0/1648403045 conn(0x7f8c240b56f0 msgr2=0x7f8c240b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:37.529 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.524+0000 7f8c2bed7640 1 -- 172.21.15.104:0/1648403045 shutdown_connections 2023-09-13T02:14:37.529 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.524+0000 7f8c2bed7640 1 -- 172.21.15.104:0/1648403045 wait complete. 2023-09-13T02:14:37.533 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.525+0000 7f8c2bed7640 1 Processor -- start 2023-09-13T02:14:37.533 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.525+0000 7f8c2bed7640 1 -- start start 2023-09-13T02:14:37.534 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.526+0000 7f8c2bed7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c240b02e0 0x7f8c241d7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:37.534 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.526+0000 7f8c2bed7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c2413ab80 0x7f8c241da5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:37.534 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.526+0000 7f8c2bed7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c24140dc0 0x7f8c2413daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:37.535 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.526+0000 7f8c2bed7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c241db5a0 con 0x7f8c2413ab80 2023-09-13T02:14:37.535 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.526+0000 7f8c2bed7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240a6c40 con 0x7f8c24140dc0 2023-09-13T02:14:37.536 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.526+0000 7f8c2bed7640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2413e5a0 con 0x7f8c240b02e0 2023-09-13T02:14:37.536 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.526+0000 7f8c29472640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c2413ab80 0x7f8c241da5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:37.536 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.526+0000 7f8c29472640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c2413ab80 0x7f8c241da5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34570/0 (socket says 172.21.15.104:34570) 2023-09-13T02:14:37.537 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.526+0000 7f8c29472640 1 -- 172.21.15.104:0/791230979 learned_addr learned my addr 172.21.15.104:0/791230979 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:14:37.537 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.526+0000 7f8c29c73640 1 --2- 172.21.15.104:0/791230979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c240b02e0 0x7f8c241d7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:37.537 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.526+0000 7f8c2a474640 1 --2- 172.21.15.104:0/791230979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c24140dc0 0x7f8c2413daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:37.538 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.526+0000 7f8c29472640 1 -- 172.21.15.104:0/791230979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c240b02e0 msgr2=0x7f8c241d7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:37.538 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.526+0000 7f8c29472640 1 --2- 172.21.15.104:0/791230979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c240b02e0 0x7f8c241d7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.538 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.526+0000 7f8c29472640 1 -- 172.21.15.104:0/791230979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c24140dc0 msgr2=0x7f8c2413daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:37.538 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.526+0000 7f8c29472640 1 --2- 172.21.15.104:0/791230979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c24140dc0 0x7f8c2413daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.539 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.526+0000 7f8c29472640 1 -- 172.21.15.104:0/791230979 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c20009560 con 0x7f8c2413ab80 2023-09-13T02:14:37.539 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.526+0000 7f8c29c73640 1 --2- 172.21.15.104:0/791230979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c240b02e0 0x7f8c241d7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:14:37.539 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.527+0000 7f8c29472640 1 --2- 172.21.15.104:0/791230979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c2413ab80 0x7f8c241da5a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400d990 tx=0x7f8c1400de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:37.540 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.527+0000 7f8c1a7fc640 1 -- 172.21.15.104:0/791230979 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400edf0 con 0x7f8c2413ab80 2023-09-13T02:14:37.540 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.527+0000 7f8c1a7fc640 1 -- 172.21.15.104:0/791230979 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8c14016440 con 0x7f8c2413ab80 2023-09-13T02:14:37.540 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.527+0000 7f8c2bed7640 1 -- 172.21.15.104:0/791230979 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c241d7100 con 0x7f8c2413ab80 2023-09-13T02:14:37.540 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.527+0000 7f8c1a7fc640 1 -- 172.21.15.104:0/791230979 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14016850 con 0x7f8c2413ab80 2023-09-13T02:14:37.541 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.527+0000 7f8c2bed7640 1 -- 172.21.15.104:0/791230979 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c241d76c0 con 0x7f8c2413ab80 2023-09-13T02:14:37.541 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.528+0000 7f8c2bed7640 1 -- 172.21.15.104:0/791230979 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2406d650 con 0x7f8c2413ab80 2023-09-13T02:14:37.541 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.528+0000 7f8c1a7fc640 1 -- 172.21.15.104:0/791230979 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f8c1401f3b0 con 0x7f8c2413ab80 2023-09-13T02:14:37.542 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.528+0000 7f8c1a7fc640 1 --2- 172.21.15.104:0/791230979 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8c0806a4f0 0x7f8c0806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:37.542 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.528+0000 7f8c1a7fc640 1 -- 172.21.15.104:0/791230979 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8c1408ad50 con 0x7f8c2413ab80 2023-09-13T02:14:37.542 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.528+0000 7f8c29c73640 1 --2- 172.21.15.104:0/791230979 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8c0806a4f0 0x7f8c0806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:37.543 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.529+0000 7f8c29c73640 1 --2- 172.21.15.104:0/791230979 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8c0806a4f0 0x7f8c0806c9b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8c20035000 tx=0x7f8c20004730 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:37.543 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.533+0000 7f8c1a7fc640 1 -- 172.21.15.104:0/791230979 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8c1408e030 con 0x7f8c2413ab80 2023-09-13T02:14:37.700 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.700+0000 7f8c2bed7640 1 -- 172.21.15.104:0/791230979 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f8c2404e100 con 0x7f8c2413ab80 2023-09-13T02:14:37.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.703+0000 7f8c1a7fc640 1 -- 172.21.15.104:0/791230979 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v31)=0 v31) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8c1401b0c0 con 0x7f8c2413ab80 2023-09-13T02:14:37.704 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.703+0000 7f8c1a7fc640 1 -- 172.21.15.104:0/791230979 <== mon.0 v2:172.21.15.104:3300/0 8 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8c14059d60 con 0x7f8c2413ab80 2023-09-13T02:14:37.706 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.705+0000 7f8c2bed7640 1 -- 172.21.15.104:0/791230979 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8c0806a4f0 msgr2=0x7f8c0806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:37.707 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.705+0000 7f8c2bed7640 1 --2- 172.21.15.104:0/791230979 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8c0806a4f0 0x7f8c0806c9b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8c20035000 tx=0x7f8c20004730 comp rx=0 tx=0).stop 2023-09-13T02:14:37.707 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.705+0000 7f8c2bed7640 1 -- 172.21.15.104:0/791230979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c2413ab80 msgr2=0x7f8c241da5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:37.707 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.705+0000 7f8c2bed7640 1 --2- 172.21.15.104:0/791230979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c2413ab80 0x7f8c241da5a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400d990 tx=0x7f8c1400de50 comp rx=0 tx=0).stop 2023-09-13T02:14:37.708 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.705+0000 7f8c2bed7640 1 -- 172.21.15.104:0/791230979 shutdown_connections 2023-09-13T02:14:37.708 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.705+0000 7f8c2bed7640 1 --2- 172.21.15.104:0/791230979 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8c0806a4f0 0x7f8c0806c9b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.708 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.705+0000 7f8c2bed7640 1 --2- 172.21.15.104:0/791230979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c24140dc0 0x7f8c2413daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.708 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.705+0000 7f8c2bed7640 1 --2- 172.21.15.104:0/791230979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c2413ab80 0x7f8c241da5a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.709 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.705+0000 7f8c2bed7640 1 --2- 172.21.15.104:0/791230979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c240b02e0 0x7f8c241d7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.709 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.705+0000 7f8c2bed7640 1 -- 172.21.15.104:0/791230979 >> 172.21.15.104:0/791230979 conn(0x7f8c240b56f0 msgr2=0x7f8c240add80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:37.709 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.705+0000 7f8c2bed7640 1 -- 172.21.15.104:0/791230979 shutdown_connections 2023-09-13T02:14:37.709 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.705+0000 7f8c2bed7640 1 -- 172.21.15.104:0/791230979 wait complete. 2023-09-13T02:14:37.717 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-13T02:14:37.718 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T02:14:37.820 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.818+0000 7f213d026640 1 -- 172.21.15.104:0/3406009686 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2138144780 msgr2=0x7f21380709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:37.820 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.818+0000 7f213d026640 1 --2- 172.21.15.104:0/3406009686 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2138144780 0x7f21380709e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2128005fd0 tx=0x7f212802bcf0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.820 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.818+0000 7f213d026640 1 -- 172.21.15.104:0/3406009686 shutdown_connections 2023-09-13T02:14:37.821 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.818+0000 7f213d026640 1 --2- 172.21.15.104:0/3406009686 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2138070f20 0x7f21380ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.821 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.818+0000 7f213d026640 1 --2- 172.21.15.104:0/3406009686 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2138144780 0x7f21380709e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.821 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.818+0000 7f213d026640 1 -- 172.21.15.104:0/3406009686 >> 172.21.15.104:0/3406009686 conn(0x7f21380b67f0 msgr2=0x7f21380b6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:37.822 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.818+0000 7f213d026640 1 -- 172.21.15.104:0/3406009686 shutdown_connections 2023-09-13T02:14:37.822 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.818+0000 7f213d026640 1 -- 172.21.15.104:0/3406009686 wait complete. 2023-09-13T02:14:37.824 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.819+0000 7f213d026640 1 Processor -- start 2023-09-13T02:14:37.825 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.819+0000 7f213d026640 1 -- start start 2023-09-13T02:14:37.825 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f213d026640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2138070f20 0x7f21380b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:37.825 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f213d026640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21380af880 0x7f21381dabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:37.826 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f213d026640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2138144780 0x7f21380acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:37.826 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f213d026640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21381da7d0 con 0x7f21380af880 2023-09-13T02:14:37.826 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f213d026640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21381da1e0 con 0x7f2138070f20 2023-09-13T02:14:37.827 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f213d026640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21381db130 con 0x7f2138144780 2023-09-13T02:14:37.827 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f212ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21380af880 0x7f21381dabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:37.827 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f212ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21380af880 0x7f21381dabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34576/0 (socket says 172.21.15.104:34576) 2023-09-13T02:14:37.827 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f212ffff640 1 -- 172.21.15.104:0/2409841924 learned_addr learned my addr 172.21.15.104:0/2409841924 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:14:37.828 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f213759e640 1 --2- 172.21.15.104:0/2409841924 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2138144780 0x7f21380acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:37.828 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f2136d9d640 1 --2- 172.21.15.104:0/2409841924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2138070f20 0x7f21380b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:37.828 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f212ffff640 1 -- 172.21.15.104:0/2409841924 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2138144780 msgr2=0x7f21380acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:37.828 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f212ffff640 1 --2- 172.21.15.104:0/2409841924 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2138144780 0x7f21380acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.829 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f212ffff640 1 -- 172.21.15.104:0/2409841924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2138070f20 msgr2=0x7f21380b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:37.829 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f212ffff640 1 --2- 172.21.15.104:0/2409841924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2138070f20 0x7f21380b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:37.829 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f212ffff640 1 -- 172.21.15.104:0/2409841924 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2128009560 con 0x7f21380af880 2023-09-13T02:14:37.830 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f213759e640 1 --2- 172.21.15.104:0/2409841924 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2138144780 0x7f21380acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:14:37.830 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.820+0000 7f2136d9d640 1 --2- 172.21.15.104:0/2409841924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2138070f20 0x7f21380b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:14:37.830 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.821+0000 7f212ffff640 1 --2- 172.21.15.104:0/2409841924 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21380af880 0x7f21381dabf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f212000b450 tx=0x7f212000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:37.831 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.821+0000 7f212f7fe640 1 -- 172.21.15.104:0/2409841924 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120011890 con 0x7f21380af880 2023-09-13T02:14:37.831 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.821+0000 7f212f7fe640 1 -- 172.21.15.104:0/2409841924 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7f21200119f0 con 0x7f21380af880 2023-09-13T02:14:37.831 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.821+0000 7f213d026640 1 -- 172.21.15.104:0/2409841924 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21381da3f0 con 0x7f21380af880 2023-09-13T02:14:37.831 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.821+0000 7f212f7fe640 1 -- 172.21.15.104:0/2409841924 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120011e20 con 0x7f21380af880 2023-09-13T02:14:37.832 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.821+0000 7f213d026640 1 -- 172.21.15.104:0/2409841924 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213813ed90 con 0x7f21380af880 2023-09-13T02:14:37.832 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.822+0000 7f213d026640 1 -- 172.21.15.104:0/2409841924 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21381da910 con 0x7f21380af880 2023-09-13T02:14:37.832 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.822+0000 7f212f7fe640 1 -- 172.21.15.104:0/2409841924 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f212001a400 con 0x7f21380af880 2023-09-13T02:14:37.832 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.823+0000 7f212f7fe640 1 --2- 172.21.15.104:0/2409841924 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f211806a4f0 0x7f211806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:37.833 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.823+0000 7f2136d9d640 1 --2- 172.21.15.104:0/2409841924 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f211806a4f0 0x7f211806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:37.833 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.823+0000 7f212f7fe640 1 -- 172.21.15.104:0/2409841924 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f2120088fa0 con 0x7f21380af880 2023-09-13T02:14:37.833 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.823+0000 7f2136d9d640 1 --2- 172.21.15.104:0/2409841924 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f211806a4f0 0x7f211806c9b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2128035000 tx=0x7f212802e040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:37.834 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:37.827+0000 7f212f7fe640 1 -- 172.21.15.104:0/2409841924 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f21200bb9b0 con 0x7f21380af880 2023-09-13T02:14:38.029 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.028+0000 7f213d026640 1 -- 172.21.15.104:0/2409841924 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f213804e100 con 0x7f21380af880 2023-09-13T02:14:38.030 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.029+0000 7f212f7fe640 1 -- 172.21.15.104:0/2409841924 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3330 (secure 0 0 0) 0x7f2120015d20 con 0x7f21380af880 2023-09-13T02:14:38.030 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:14:38.031 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/811188307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":811188307},{"type":"v1","addr":"172.21.15.119:6833","nonce":811188307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T02:12:23.916322+0000","modified":"2023-09-13T02:12:26.178874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1426622388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1426622388},{"type":"v1","addr":"172.21.15.104:6835","nonce":1426622388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T02:14:38.032 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 6 2023-09-13T02:14:38.032 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.030+0000 7f213d026640 1 -- 172.21.15.104:0/2409841924 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f211806a4f0 msgr2=0x7f211806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:38.033 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.030+0000 7f213d026640 1 --2- 172.21.15.104:0/2409841924 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f211806a4f0 0x7f211806c9b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2128035000 tx=0x7f212802e040 comp rx=0 tx=0).stop 2023-09-13T02:14:38.033 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.030+0000 7f213d026640 1 -- 172.21.15.104:0/2409841924 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21380af880 msgr2=0x7f21381dabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:38.033 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.030+0000 7f213d026640 1 --2- 172.21.15.104:0/2409841924 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21380af880 0x7f21381dabf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f212000b450 tx=0x7f212000b910 comp rx=0 tx=0).stop 2023-09-13T02:14:38.033 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.030+0000 7f213d026640 1 -- 172.21.15.104:0/2409841924 shutdown_connections 2023-09-13T02:14:38.034 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.030+0000 7f213d026640 1 --2- 172.21.15.104:0/2409841924 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f211806a4f0 0x7f211806c9b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.034 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.030+0000 7f213d026640 1 --2- 172.21.15.104:0/2409841924 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2138144780 0x7f21380acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.034 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.030+0000 7f213d026640 1 --2- 172.21.15.104:0/2409841924 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21380af880 0x7f21381dabf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.035 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.030+0000 7f213d026640 1 --2- 172.21.15.104:0/2409841924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2138070f20 0x7f21380b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.035 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.030+0000 7f213d026640 1 -- 172.21.15.104:0/2409841924 >> 172.21.15.104:0/2409841924 conn(0x7f21380b67f0 msgr2=0x7f213813ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:38.035 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.031+0000 7f213d026640 1 -- 172.21.15.104:0/2409841924 shutdown_connections 2023-09-13T02:14:38.035 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.031+0000 7f213d026640 1 -- 172.21.15.104:0/2409841924 wait complete. 2023-09-13T02:14:38.042 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T02:14:38.145 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.143+0000 7fced90c9640 1 -- 172.21.15.104:0/2268109580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcebc0047c0 msgr2=0x7fcebc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:38.145 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.143+0000 7fced90c9640 1 --2- 172.21.15.104:0/2268109580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcebc0047c0 0x7fcebc004c40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcec800c710 tx=0x7fcebc0057f0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.145 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.143+0000 7fced359e640 1 -- 172.21.15.104:0/2268109580 reap_dead start 2023-09-13T02:14:38.146 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.143+0000 7fced90c9640 1 -- 172.21.15.104:0/2268109580 shutdown_connections 2023-09-13T02:14:38.146 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.143+0000 7fced90c9640 1 -- 172.21.15.104:0/2268109580 >> 172.21.15.104:0/2268109580 conn(0x7fced40b56f0 msgr2=0x7fced40b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:38.146 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.143+0000 7fced90c9640 1 -- 172.21.15.104:0/2268109580 shutdown_connections 2023-09-13T02:14:38.147 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.143+0000 7fced90c9640 1 -- 172.21.15.104:0/2268109580 wait complete. 2023-09-13T02:14:38.150 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.145+0000 7fced90c9640 1 Processor -- start 2023-09-13T02:14:38.150 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.145+0000 7fced90c9640 1 -- start start 2023-09-13T02:14:38.150 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.145+0000 7fced90c9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcebc0047c0 0x7fced413e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:38.150 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.145+0000 7fced90c9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fced41d70f0 0x7fced4136050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:38.151 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.145+0000 7fced90c9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fced4134b10 0x7fced4070a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:38.151 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.145+0000 7fced90c9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced413e5a0 con 0x7fced4134b10 2023-09-13T02:14:38.151 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.145+0000 7fced90c9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced41d6400 con 0x7fcebc0047c0 2023-09-13T02:14:38.152 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.145+0000 7fced90c9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced4136590 con 0x7fced41d70f0 2023-09-13T02:14:38.152 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.145+0000 7fced359e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fced4134b10 0x7fced4070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:38.152 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.145+0000 7fced359e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fced4134b10 0x7fced4070a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34594/0 (socket says 172.21.15.104:34594) 2023-09-13T02:14:38.152 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.145+0000 7fced359e640 1 -- 172.21.15.104:0/1412792881 learned_addr learned my addr 172.21.15.104:0/1412792881 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:14:38.153 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.145+0000 7fced2d9d640 1 --2- 172.21.15.104:0/1412792881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcebc0047c0 0x7fced413e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:38.153 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.145+0000 7fced259c640 1 --2- 172.21.15.104:0/1412792881 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fced41d70f0 0x7fced4136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:38.153 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.146+0000 7fced359e640 1 -- 172.21.15.104:0/1412792881 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fced41d70f0 msgr2=0x7fced4136050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:38.154 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.146+0000 7fced359e640 1 --2- 172.21.15.104:0/1412792881 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fced41d70f0 0x7fced4136050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.154 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.146+0000 7fced359e640 1 -- 172.21.15.104:0/1412792881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcebc0047c0 msgr2=0x7fced413e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:38.154 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.146+0000 7fced359e640 1 --2- 172.21.15.104:0/1412792881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcebc0047c0 0x7fced413e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.154 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.146+0000 7fced359e640 1 -- 172.21.15.104:0/1412792881 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced4136860 con 0x7fced4134b10 2023-09-13T02:14:38.155 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.146+0000 7fced2d9d640 1 --2- 172.21.15.104:0/1412792881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcebc0047c0 0x7fced413e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T02:14:38.155 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.146+0000 7fced359e640 1 --2- 172.21.15.104:0/1412792881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fced4134b10 0x7fced4070a40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fced40b6790 tx=0x7fcecc00b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:38.155 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.146+0000 7fcebb7fe640 1 -- 172.21.15.104:0/1412792881 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc005220 con 0x7fced4134b10 2023-09-13T02:14:38.155 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.146+0000 7fcebb7fe640 1 -- 172.21.15.104:0/1412792881 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcecc0053a0 con 0x7fced4134b10 2023-09-13T02:14:38.156 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.146+0000 7fced90c9640 1 -- 172.21.15.104:0/1412792881 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced41d6610 con 0x7fced4134b10 2023-09-13T02:14:38.156 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.146+0000 7fcebb7fe640 1 -- 172.21.15.104:0/1412792881 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc0047a0 con 0x7fced4134b10 2023-09-13T02:14:38.156 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.146+0000 7fced90c9640 1 -- 172.21.15.104:0/1412792881 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced41d6bd0 con 0x7fced4134b10 2023-09-13T02:14:38.157 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.147+0000 7fced90c9640 1 -- 172.21.15.104:0/1412792881 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced4071a50 con 0x7fced4134b10 2023-09-13T02:14:38.157 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.147+0000 7fcebb7fe640 1 -- 172.21.15.104:0/1412792881 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fcecc017070 con 0x7fced4134b10 2023-09-13T02:14:38.157 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.148+0000 7fcebb7fe640 1 --2- 172.21.15.104:0/1412792881 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fcec006a520 0x7fcec006c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:38.157 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.148+0000 7fcebb7fe640 1 -- 172.21.15.104:0/1412792881 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fcecc089360 con 0x7fced4134b10 2023-09-13T02:14:38.158 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.148+0000 7fced2d9d640 1 --2- 172.21.15.104:0/1412792881 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fcec006a520 0x7fcec006c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:38.158 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.148+0000 7fced2d9d640 1 --2- 172.21.15.104:0/1412792881 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fcec006a520 0x7fcec006c9e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcec4001390 tx=0x7fcec4002010 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:38.159 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.152+0000 7fcebb7fe640 1 -- 172.21.15.104:0/1412792881 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fcecc0548e0 con 0x7fced4134b10 2023-09-13T02:14:38.352 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.352+0000 7fced90c9640 1 -- 172.21.15.104:0/1412792881 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fced41d6dc0 con 0x7fced4134b10 2023-09-13T02:14:38.354 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.352+0000 7fcebb7fe640 1 -- 172.21.15.104:0/1412792881 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3330 (secure 0 0 0) 0x7fcecc057f00 con 0x7fced4134b10 2023-09-13T02:14:38.355 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:14:38.355 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/811188307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":811188307},{"type":"v1","addr":"172.21.15.119:6833","nonce":811188307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T02:12:23.916322+0000","modified":"2023-09-13T02:12:26.178874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1426622388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1426622388},{"type":"v1","addr":"172.21.15.104:6835","nonce":1426622388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T02:14:38.357 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 6 2023-09-13T02:14:38.358 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.354+0000 7fced90c9640 1 -- 172.21.15.104:0/1412792881 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fcec006a520 msgr2=0x7fcec006c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:38.358 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.354+0000 7fced90c9640 1 --2- 172.21.15.104:0/1412792881 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fcec006a520 0x7fcec006c9e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcec4001390 tx=0x7fcec4002010 comp rx=0 tx=0).stop 2023-09-13T02:14:38.359 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.354+0000 7fced90c9640 1 -- 172.21.15.104:0/1412792881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fced4134b10 msgr2=0x7fced4070a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:38.359 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.354+0000 7fced90c9640 1 --2- 172.21.15.104:0/1412792881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fced4134b10 0x7fced4070a40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fced40b6790 tx=0x7fcecc00b980 comp rx=0 tx=0).stop 2023-09-13T02:14:38.360 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.354+0000 7fced90c9640 1 -- 172.21.15.104:0/1412792881 shutdown_connections 2023-09-13T02:14:38.360 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.354+0000 7fced90c9640 1 --2- 172.21.15.104:0/1412792881 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fcec006a520 0x7fcec006c9e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.360 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.354+0000 7fced90c9640 1 --2- 172.21.15.104:0/1412792881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fced4134b10 0x7fced4070a40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.361 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.354+0000 7fced90c9640 1 --2- 172.21.15.104:0/1412792881 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fced41d70f0 0x7fced4136050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.361 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.354+0000 7fced90c9640 1 --2- 172.21.15.104:0/1412792881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcebc0047c0 0x7fced413e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.361 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.354+0000 7fced90c9640 1 -- 172.21.15.104:0/1412792881 >> 172.21.15.104:0/1412792881 conn(0x7fced40b56f0 msgr2=0x7fced40ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:38.362 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.354+0000 7fced90c9640 1 -- 172.21.15.104:0/1412792881 shutdown_connections 2023-09-13T02:14:38.362 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.354+0000 7fced90c9640 1 -- 172.21.15.104:0/1412792881 wait complete. 2023-09-13T02:14:38.365 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T02:14:38.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.466+0000 7fb21531d640 1 -- 172.21.15.104:0/2857115785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1f8003f20 msgr2=0x7fb1f80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:38.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.466+0000 7fb21531d640 1 --2- 172.21.15.104:0/2857115785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1f8003f20 0x7fb1f80047c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb204001680 tx=0x7fb1f80057f0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.466+0000 7fb20f7fe640 1 -- 172.21.15.104:0/2857115785 reap_dead start 2023-09-13T02:14:38.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.466+0000 7fb21531d640 1 -- 172.21.15.104:0/2857115785 shutdown_connections 2023-09-13T02:14:38.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.466+0000 7fb21531d640 1 -- 172.21.15.104:0/2857115785 >> 172.21.15.104:0/2857115785 conn(0x7fb2100708b0 msgr2=0x7fb210070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:38.469 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.466+0000 7fb21531d640 1 -- 172.21.15.104:0/2857115785 shutdown_connections 2023-09-13T02:14:38.470 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.467+0000 7fb21531d640 1 -- 172.21.15.104:0/2857115785 wait complete. 2023-09-13T02:14:38.472 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.468+0000 7fb21531d640 1 Processor -- start 2023-09-13T02:14:38.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.468+0000 7fb21531d640 1 -- start start 2023-09-13T02:14:38.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.468+0000 7fb21531d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1f8003f20 0x7fb2101cf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:38.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.468+0000 7fb21531d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2101dd430 0x7fb21013bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:38.473 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.468+0000 7fb21531d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2101dd8b0 0x7fb21013c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:38.474 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.468+0000 7fb21531d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2101402f0 con 0x7fb2101dd430 2023-09-13T02:14:38.474 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.468+0000 7fb21531d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb210143a30 con 0x7fb2101dd8b0 2023-09-13T02:14:38.474 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.468+0000 7fb21531d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21013ed20 con 0x7fb1f8003f20 2023-09-13T02:14:38.475 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.468+0000 7fb20e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2101dd430 0x7fb21013bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:38.475 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.468+0000 7fb20e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2101dd430 0x7fb21013bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34622/0 (socket says 172.21.15.104:34622) 2023-09-13T02:14:38.475 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.468+0000 7fb20e7fc640 1 -- 172.21.15.104:0/4164744853 learned_addr learned my addr 172.21.15.104:0/4164744853 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:14:38.475 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.468+0000 7fb20effd640 1 --2- 172.21.15.104:0/4164744853 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1f8003f20 0x7fb2101cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:38.476 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.468+0000 7fb20f7fe640 1 --2- 172.21.15.104:0/4164744853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2101dd8b0 0x7fb21013c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:38.476 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.469+0000 7fb20e7fc640 1 -- 172.21.15.104:0/4164744853 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1f8003f20 msgr2=0x7fb2101cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:38.476 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.469+0000 7fb20e7fc640 1 --2- 172.21.15.104:0/4164744853 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1f8003f20 0x7fb2101cf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.476 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.469+0000 7fb20e7fc640 1 -- 172.21.15.104:0/4164744853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2101dd8b0 msgr2=0x7fb21013c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:38.477 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.469+0000 7fb20e7fc640 1 --2- 172.21.15.104:0/4164744853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2101dd8b0 0x7fb21013c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.477 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.469+0000 7fb20e7fc640 1 -- 172.21.15.104:0/4164744853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb210143e50 con 0x7fb2101dd430 2023-09-13T02:14:38.477 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.469+0000 7fb20f7fe640 1 --2- 172.21.15.104:0/4164744853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2101dd8b0 0x7fb21013c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:14:38.478 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.469+0000 7fb20e7fc640 1 --2- 172.21.15.104:0/4164744853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2101dd430 0x7fb21013bb70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb2040011d0 tx=0x7fb204003670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:38.478 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.469+0000 7fb1f77fe640 1 -- 172.21.15.104:0/4164744853 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204003c70 con 0x7fb2101dd430 2023-09-13T02:14:38.478 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.469+0000 7fb1f77fe640 1 -- 172.21.15.104:0/4164744853 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb20402c550 con 0x7fb2101dd430 2023-09-13T02:14:38.479 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.469+0000 7fb1f77fe640 1 -- 172.21.15.104:0/4164744853 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20402c960 con 0x7fb2101dd430 2023-09-13T02:14:38.479 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.469+0000 7fb21531d640 1 -- 172.21.15.104:0/4164744853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2101d0380 con 0x7fb2101dd430 2023-09-13T02:14:38.479 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.469+0000 7fb21531d640 1 -- 172.21.15.104:0/4164744853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21013c5f0 con 0x7fb2101dd430 2023-09-13T02:14:38.479 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.470+0000 7fb21531d640 1 -- 172.21.15.104:0/4164744853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb21004e100 con 0x7fb2101dd430 2023-09-13T02:14:38.480 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.470+0000 7fb1f77fe640 1 -- 172.21.15.104:0/4164744853 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb20402cac0 con 0x7fb2101dd430 2023-09-13T02:14:38.480 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.471+0000 7fb1f77fe640 1 --2- 172.21.15.104:0/4164744853 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb1fc06a520 0x7fb1fc06c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:38.480 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.471+0000 7fb20effd640 1 --2- 172.21.15.104:0/4164744853 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb1fc06a520 0x7fb1fc06c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:38.481 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.471+0000 7fb1f77fe640 1 -- 172.21.15.104:0/4164744853 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fb2040a9a50 con 0x7fb2101dd430 2023-09-13T02:14:38.481 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.471+0000 7fb20effd640 1 --2- 172.21.15.104:0/4164744853 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb1fc06a520 0x7fb1fc06c9e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb200005fd0 tx=0x7fb200009500 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:38.481 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.475+0000 7fb1f77fe640 1 -- 172.21.15.104:0/4164744853 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb204074fd0 con 0x7fb2101dd430 2023-09-13T02:14:38.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.639+0000 7fb21531d640 1 -- 172.21.15.104:0/4164744853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2101457c0 con 0x7fb2101dd430 2023-09-13T02:14:38.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.640+0000 7fb1f77fe640 1 -- 172.21.15.104:0/4164744853 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16854 (secure 0 0 0) 0x7fb204043020 con 0x7fb2101dd430 2023-09-13T02:14:38.642 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-13T02:14:38.642 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":24,"fsid":"ac1f5a95-0d3a-406e-b4ca-c8ea43282cab","created":"2023-09-13T02:11:59.067178+0000","modified":"2023-09-13T02:13:43.858516+0000","last_up_change":"2023-09-13T02:12:11.207888+0000","last_in_change":"2023-09-13T02:12:02.278796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T02:12:12.071023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T02:12:22.114609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T02:12:22.880593+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67190066-4851-4b1f-aae8-bad59e79ebb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6801","nonce":3271772377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6803","nonce":3271772377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6807","nonce":3271772377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3271772377},{"type":"v1","addr":"172.21.15.104:6805","nonce":3271772377}]},"public_addr":"172.21.15.104:6801/3271772377","cluster_addr":"172.21.15.104:6803/3271772377","heartbeat_back_addr":"172.21.15.104:6807/3271772377","heartbeat_front_addr":"172.21.15.104:6805/3271772377","state":["exists","up"]},{"osd":1,"uuid":"f1907075-bb97-4a19-8dd6-322232caaf4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6809","nonce":3786698894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6811","nonce":3786698894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6815","nonce":3786698894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3786698894},{"type":"v1","addr":"172.21.15.104:6813","nonce":3786698894}]},"public_addr":"172.21.15.104:6809/3786698894","cluster_addr":"172.21.15.104:6811/3786698894","heartbeat_back_addr":"172.21.15.104:6815/3786698894","heartbeat_front_addr":"172.21.15.104:6813/3786698894","state":["exists","up"]},{"osd":2,"uuid":"8c323c83-330c-4181-b622-10177c81f975","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6819","nonce":2319361072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6822","nonce":2319361072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6827","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6829","nonce":2319361072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2319361072},{"type":"v1","addr":"172.21.15.104:6826","nonce":2319361072}]},"public_addr":"172.21.15.104:6819/2319361072","cluster_addr":"172.21.15.104:6822/2319361072","heartbeat_back_addr":"172.21.15.104:6829/2319361072","heartbeat_front_addr":"172.21.15.104:6826/2319361072","state":["exists","up"]},{"osd":3,"uuid":"811457f5-c408-488d-a4ed-b947d1c55e82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6818","nonce":621253853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6823","nonce":621253853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6831","nonce":621253853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6825","nonce":621253853},{"type":"v1","addr":"172.21.15.104:6828","nonce":621253853}]},"public_addr":"172.21.15.104:6818/621253853","cluster_addr":"172.21.15.104:6823/621253853","heartbeat_back_addr":"172.21.15.104:6831/621253853","heartbeat_front_addr":"172.21.15.104:6828/621253853","state":["exists","up"]},{"osd":4,"uuid":"552010ea-7d61-47c7-b4ac-657845e55e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6801","nonce":3049794634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6803","nonce":3049794634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6807","nonce":3049794634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3049794634},{"type":"v1","addr":"172.21.15.119:6805","nonce":3049794634}]},"public_addr":"172.21.15.119:6801/3049794634","cluster_addr":"172.21.15.119:6803/3049794634","heartbeat_back_addr":"172.21.15.119:6807/3049794634","heartbeat_front_addr":"172.21.15.119:6805/3049794634","state":["exists","up"]},{"osd":5,"uuid":"41f415b0-6886-44ed-bccc-57c46cc975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6809","nonce":2918159428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6811","nonce":2918159428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6815","nonce":2918159428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2918159428},{"type":"v1","addr":"172.21.15.119:6813","nonce":2918159428}]},"public_addr":"172.21.15.119:6809/2918159428","cluster_addr":"172.21.15.119:6811/2918159428","heartbeat_back_addr":"172.21.15.119:6815/2918159428","heartbeat_front_addr":"172.21.15.119:6813/2918159428","state":["exists","up"]},{"osd":6,"uuid":"1f415570-dbcc-4cb9-930a-ad31a96c3ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6825","nonce":3509665357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6827","nonce":3509665357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6831","nonce":3509665357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3509665357},{"type":"v1","addr":"172.21.15.119:6829","nonce":3509665357}]},"public_addr":"172.21.15.119:6825/3509665357","cluster_addr":"172.21.15.119:6827/3509665357","heartbeat_back_addr":"172.21.15.119:6831/3509665357","heartbeat_front_addr":"172.21.15.119:6829/3509665357","state":["exists","up"]},{"osd":7,"uuid":"ad5a04ab-69ff-4c17-8f5a-dd3b3f9c030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6817","nonce":892749725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6819","nonce":892749725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6823","nonce":892749725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":892749725},{"type":"v1","addr":"172.21.15.119:6821","nonce":892749725}]},"public_addr":"172.21.15.119:6817/892749725","cluster_addr":"172.21.15.119:6819/892749725","heartbeat_back_addr":"172.21.15.119:6823/892749725","heartbeat_front_addr":"172.21.15.119:6821/892749725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.489481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.468615+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.485958+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.407389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.424425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.456308+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T02:12:07.427607+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":2,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T02:14:38.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.642+0000 7fb21531d640 1 -- 172.21.15.104:0/4164744853 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb1fc06a520 msgr2=0x7fb1fc06c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:38.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.642+0000 7fb21531d640 1 --2- 172.21.15.104:0/4164744853 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb1fc06a520 0x7fb1fc06c9e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb200005fd0 tx=0x7fb200009500 comp rx=0 tx=0).stop 2023-09-13T02:14:38.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.642+0000 7fb21531d640 1 -- 172.21.15.104:0/4164744853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2101dd430 msgr2=0x7fb21013bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:38.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.642+0000 7fb21531d640 1 --2- 172.21.15.104:0/4164744853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2101dd430 0x7fb21013bb70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb2040011d0 tx=0x7fb204003670 comp rx=0 tx=0).stop 2023-09-13T02:14:38.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.642+0000 7fb21531d640 1 -- 172.21.15.104:0/4164744853 shutdown_connections 2023-09-13T02:14:38.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.642+0000 7fb21531d640 1 --2- 172.21.15.104:0/4164744853 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fb1fc06a520 0x7fb1fc06c9e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.642+0000 7fb21531d640 1 --2- 172.21.15.104:0/4164744853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2101dd8b0 0x7fb21013c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.642+0000 7fb21531d640 1 --2- 172.21.15.104:0/4164744853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2101dd430 0x7fb21013bb70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.642+0000 7fb21531d640 1 --2- 172.21.15.104:0/4164744853 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1f8003f20 0x7fb2101cf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.642+0000 7fb21531d640 1 -- 172.21.15.104:0/4164744853 >> 172.21.15.104:0/4164744853 conn(0x7fb2100708b0 msgr2=0x7fb2100ba190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:38.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.642+0000 7fb21531d640 1 -- 172.21.15.104:0/4164744853 shutdown_connections 2023-09-13T02:14:38.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.642+0000 7fb21531d640 1 -- 172.21.15.104:0/4164744853 wait complete. 2023-09-13T02:14:38.654 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-13T02:14:38.756 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.755+0000 7fd1a8d90640 1 -- 172.21.15.104:0/1516465330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1a40b5ba0 msgr2=0x7fd1a41482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:38.757 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.755+0000 7fd1a8d90640 1 --2- 172.21.15.104:0/1516465330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1a40b5ba0 0x7fd1a41482f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd19c009860 tx=0x7fd19c02bd60 comp rx=0 tx=0).stop 2023-09-13T02:14:38.757 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.755+0000 7fd1a8d90640 1 -- 172.21.15.104:0/1516465330 shutdown_connections 2023-09-13T02:14:38.758 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.755+0000 7fd1a8d90640 1 --2- 172.21.15.104:0/1516465330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1a40b5ba0 0x7fd1a41482f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.758 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.755+0000 7fd1a8d90640 1 -- 172.21.15.104:0/1516465330 >> 172.21.15.104:0/1516465330 conn(0x7fd1a40708b0 msgr2=0x7fd1a4070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:38.758 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.755+0000 7fd1a8d90640 1 -- 172.21.15.104:0/1516465330 shutdown_connections 2023-09-13T02:14:38.759 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.755+0000 7fd1a8d90640 1 -- 172.21.15.104:0/1516465330 wait complete. 2023-09-13T02:14:38.762 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.756+0000 7fd1a8d90640 1 Processor -- start 2023-09-13T02:14:38.762 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.756+0000 7fd1a8d90640 1 -- start start 2023-09-13T02:14:38.763 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a8d90640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1a40b5ba0 0x7fd1a4140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:38.763 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a8d90640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd1a4147b90 0x7fd1a40b9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:38.763 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a8d90640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1a413f000 0x7fd1a413f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:38.763 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a8d90640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a41418a0 con 0x7fd1a4147b90 2023-09-13T02:14:38.764 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a8d90640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40ba440 con 0x7fd1a413f000 2023-09-13T02:14:38.764 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a8d90640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a413f9f0 con 0x7fd1a40b5ba0 2023-09-13T02:14:38.764 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a1d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd1a4147b90 0x7fd1a40b9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:38.765 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a1d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd1a4147b90 0x7fd1a40b9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34638/0 (socket says 172.21.15.104:34638) 2023-09-13T02:14:38.765 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a1d9b640 1 -- 172.21.15.104:0/1586164624 learned_addr learned my addr 172.21.15.104:0/1586164624 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:14:38.765 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a259c640 1 --2- 172.21.15.104:0/1586164624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1a40b5ba0 0x7fd1a4140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:38.765 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a2d9d640 1 --2- 172.21.15.104:0/1586164624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1a413f000 0x7fd1a413f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:38.766 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a1d9b640 1 -- 172.21.15.104:0/1586164624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1a40b5ba0 msgr2=0x7fd1a4140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:38.766 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a1d9b640 1 --2- 172.21.15.104:0/1586164624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1a40b5ba0 0x7fd1a4140580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.766 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a1d9b640 1 -- 172.21.15.104:0/1586164624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1a413f000 msgr2=0x7fd1a413f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:38.767 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a1d9b640 1 --2- 172.21.15.104:0/1586164624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1a413f000 0x7fd1a413f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.767 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a1d9b640 1 -- 172.21.15.104:0/1586164624 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c009490 con 0x7fd1a4147b90 2023-09-13T02:14:38.768 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a2d9d640 1 --2- 172.21.15.104:0/1586164624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1a413f000 0x7fd1a413f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T02:14:38.768 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd1a1d9b640 1 --2- 172.21.15.104:0/1586164624 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd1a4147b90 0x7fd1a40b9f00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd19800c400 tx=0x7fd19800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:38.768 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.757+0000 7fd192ffd640 1 -- 172.21.15.104:0/1586164624 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1980052d0 con 0x7fd1a4147b90 2023-09-13T02:14:38.768 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.758+0000 7fd192ffd640 1 -- 172.21.15.104:0/1586164624 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd198005430 con 0x7fd1a4147b90 2023-09-13T02:14:38.769 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.758+0000 7fd1a8d90640 1 -- 172.21.15.104:0/1586164624 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a40b1000 con 0x7fd1a4147b90 2023-09-13T02:14:38.769 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.758+0000 7fd192ffd640 1 -- 172.21.15.104:0/1586164624 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd198003850 con 0x7fd1a4147b90 2023-09-13T02:14:38.770 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.758+0000 7fd1a8d90640 1 -- 172.21.15.104:0/1586164624 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a4140ec0 con 0x7fd1a4147b90 2023-09-13T02:14:38.770 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.759+0000 7fd1a8d90640 1 -- 172.21.15.104:0/1586164624 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a413ed20 con 0x7fd1a4147b90 2023-09-13T02:14:38.770 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.759+0000 7fd192ffd640 1 -- 172.21.15.104:0/1586164624 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd198003a70 con 0x7fd1a4147b90 2023-09-13T02:14:38.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.759+0000 7fd192ffd640 1 --2- 172.21.15.104:0/1586164624 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd18406a4f0 0x7fd18406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:38.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.759+0000 7fd192ffd640 1 -- 172.21.15.104:0/1586164624 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd198088210 con 0x7fd1a4147b90 2023-09-13T02:14:38.771 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.759+0000 7fd1a259c640 1 --2- 172.21.15.104:0/1586164624 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd18406a4f0 0x7fd18406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:38.772 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.760+0000 7fd1a259c640 1 --2- 172.21.15.104:0/1586164624 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd18406a4f0 0x7fd18406c9b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd194001560 tx=0x7fd194009040 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:38.772 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.763+0000 7fd192ffd640 1 -- 172.21.15.104:0/1586164624 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd1a413ed20 con 0x7fd1a4147b90 2023-09-13T02:14:38.966 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.965+0000 7fd1a8d90640 1 -- 172.21.15.104:0/1586164624 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd1a413ed20 con 0x7fd1a4147b90 2023-09-13T02:14:38.969 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.968+0000 7fd192ffd640 1 -- 172.21.15.104:0/1586164624 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd1a413ed20 con 0x7fd1a4147b90 2023-09-13T02:14:38.970 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-13T02:14:38.973 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.971+0000 7fd1a8d90640 1 -- 172.21.15.104:0/1586164624 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd18406a4f0 msgr2=0x7fd18406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:38.973 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.971+0000 7fd1a8d90640 1 --2- 172.21.15.104:0/1586164624 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd18406a4f0 0x7fd18406c9b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd194001560 tx=0x7fd194009040 comp rx=0 tx=0).stop 2023-09-13T02:14:38.974 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.971+0000 7fd1a8d90640 1 -- 172.21.15.104:0/1586164624 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd1a4147b90 msgr2=0x7fd1a40b9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:38.974 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.971+0000 7fd1a8d90640 1 --2- 172.21.15.104:0/1586164624 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd1a4147b90 0x7fd1a40b9f00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd19800c400 tx=0x7fd19800c8c0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.971+0000 7fd1a8d90640 1 -- 172.21.15.104:0/1586164624 shutdown_connections 2023-09-13T02:14:38.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.971+0000 7fd1a8d90640 1 --2- 172.21.15.104:0/1586164624 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd18406a4f0 0x7fd18406c9b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.976 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.971+0000 7fd1a8d90640 1 --2- 172.21.15.104:0/1586164624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1a413f000 0x7fd1a413f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.978 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.971+0000 7fd1a8d90640 1 --2- 172.21.15.104:0/1586164624 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd1a4147b90 0x7fd1a40b9f00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.971+0000 7fd1a8d90640 1 --2- 172.21.15.104:0/1586164624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1a40b5ba0 0x7fd1a4140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:38.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.971+0000 7fd1a8d90640 1 -- 172.21.15.104:0/1586164624 >> 172.21.15.104:0/1586164624 conn(0x7fd1a40708b0 msgr2=0x7fd1a40ad830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:38.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.971+0000 7fd1a8d90640 1 -- 172.21.15.104:0/1586164624 shutdown_connections 2023-09-13T02:14:38.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:38.971+0000 7fd1a8d90640 1 -- 172.21.15.104:0/1586164624 wait complete. 2023-09-13T02:14:38.984 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-13T02:14:39.006 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2023-09-13T02:14:39.090 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.088+0000 7f8fea7c5640 1 -- 172.21.15.104:0/4089934338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fcc004d50 msgr2=0x7f8fcc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:39.090 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.088+0000 7f8fea7c5640 1 --2- 172.21.15.104:0/4089934338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fcc004d50 0x7f8fcc0051d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40afc20 tx=0x7f8fcc0057f0 comp rx=0 tx=0).stop 2023-09-13T02:14:39.091 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.088+0000 7f8fe8d62640 1 -- 172.21.15.104:0/4089934338 reap_dead start 2023-09-13T02:14:39.091 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.088+0000 7f8fea7c5640 1 -- 172.21.15.104:0/4089934338 shutdown_connections 2023-09-13T02:14:39.092 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.088+0000 7f8fea7c5640 1 -- 172.21.15.104:0/4089934338 >> 172.21.15.104:0/4089934338 conn(0x7f8fe4069360 msgr2=0x7f8fe4069740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:39.092 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.088+0000 7f8fea7c5640 1 -- 172.21.15.104:0/4089934338 shutdown_connections 2023-09-13T02:14:39.092 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.089+0000 7f8fea7c5640 1 -- 172.21.15.104:0/4089934338 wait complete. 2023-09-13T02:14:39.095 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.089+0000 7f8fea7c5640 1 Processor -- start 2023-09-13T02:14:39.095 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.090+0000 7f8fea7c5640 1 -- start start 2023-09-13T02:14:39.096 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.090+0000 7f8fea7c5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8fe41396e0 0x7f8fe4131f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:39.096 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.090+0000 7f8fea7c5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fe412edd0 0x7f8fe412f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:39.096 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.090+0000 7f8fea7c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fe40b0480 0x7f8fe40b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:39.097 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.090+0000 7f8fea7c5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe40b5340 con 0x7f8fe40b0480 2023-09-13T02:14:39.098 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.090+0000 7f8fea7c5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe4139fb0 con 0x7f8fe412edd0 2023-09-13T02:14:39.098 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.090+0000 7f8fea7c5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe4139ac0 con 0x7f8fe41396e0 2023-09-13T02:14:39.098 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.090+0000 7f8fe8d62640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fe40b0480 0x7f8fe40b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:39.098 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.090+0000 7f8fe8d62640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fe40b0480 0x7f8fe40b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34664/0 (socket says 172.21.15.104:34664) 2023-09-13T02:14:39.099 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.090+0000 7f8fe8d62640 1 -- 172.21.15.104:0/1554903787 learned_addr learned my addr 172.21.15.104:0/1554903787 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:14:39.099 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.090+0000 7f8fe3fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8fe41396e0 0x7f8fe4131f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:39.100 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.090+0000 7f8fe37fe640 1 --2- 172.21.15.104:0/1554903787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fe412edd0 0x7f8fe412f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:39.100 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.091+0000 7f8fe8d62640 1 -- 172.21.15.104:0/1554903787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8fe41396e0 msgr2=0x7f8fe4131f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:39.100 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.091+0000 7f8fe8d62640 1 --2- 172.21.15.104:0/1554903787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8fe41396e0 0x7f8fe4131f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:39.101 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.091+0000 7f8fe8d62640 1 -- 172.21.15.104:0/1554903787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fe412edd0 msgr2=0x7f8fe412f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:39.101 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.091+0000 7f8fe8d62640 1 --2- 172.21.15.104:0/1554903787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fe412edd0 0x7f8fe412f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:39.101 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.091+0000 7f8fe8d62640 1 -- 172.21.15.104:0/1554903787 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe40b4bd0 con 0x7f8fe40b0480 2023-09-13T02:14:39.102 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.091+0000 7f8fe3fff640 1 --2- 172.21.15.104:0/1554903787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8fe41396e0 0x7f8fe4131f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T02:14:39.102 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.091+0000 7f8fe8d62640 1 --2- 172.21.15.104:0/1554903787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fe40b0480 0x7f8fe40b0900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc001e40 tx=0x7f8fdc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:39.103 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.091+0000 7f8fe0ff9640 1 -- 172.21.15.104:0/1554903787 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc02cc70 con 0x7f8fe40b0480 2023-09-13T02:14:39.103 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.091+0000 7f8fe0ff9640 1 -- 172.21.15.104:0/1554903787 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8fdc003e40 con 0x7f8fe40b0480 2023-09-13T02:14:39.103 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.091+0000 7f8fea7c5640 1 -- 172.21.15.104:0/1554903787 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe40b5550 con 0x7f8fe40b0480 2023-09-13T02:14:39.103 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.091+0000 7f8fe0ff9640 1 -- 172.21.15.104:0/1554903787 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc006310 con 0x7f8fe40b0480 2023-09-13T02:14:39.104 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.091+0000 7f8fea7c5640 1 -- 172.21.15.104:0/1554903787 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe413b1f0 con 0x7f8fe40b0480 2023-09-13T02:14:39.104 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.092+0000 7f8fea7c5640 1 -- 172.21.15.104:0/1554903787 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe4145380 con 0x7f8fe40b0480 2023-09-13T02:14:39.104 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.092+0000 7f8fe0ff9640 1 -- 172.21.15.104:0/1554903787 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f8fdc006470 con 0x7f8fe40b0480 2023-09-13T02:14:39.105 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.093+0000 7f8fe0ff9640 1 --2- 172.21.15.104:0/1554903787 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8fd006a4f0 0x7f8fd006c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:39.105 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.093+0000 7f8fe3fff640 1 --2- 172.21.15.104:0/1554903787 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8fd006a4f0 0x7f8fd006c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:39.105 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.093+0000 7f8fe0ff9640 1 -- 172.21.15.104:0/1554903787 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f8fdc0a9e10 con 0x7f8fe40b0480 2023-09-13T02:14:39.106 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.093+0000 7f8fe3fff640 1 --2- 172.21.15.104:0/1554903787 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8fd006a4f0 0x7f8fd006c9b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4001eb0 tx=0x7f8fd4000fc0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:39.107 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.097+0000 7f8fe0ff9640 1 -- 172.21.15.104:0/1554903787 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8fdc075380 con 0x7f8fe40b0480 2023-09-13T02:14:39.299 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.298+0000 7f8fea7c5640 1 -- 172.21.15.104:0/1554903787 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8fe413e8e0 con 0x7f8fe40b0480 2023-09-13T02:14:39.970 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.969+0000 7f8fe0ff9640 1 -- 172.21.15.104:0/1554903787 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8fdc0789a0 con 0x7f8fe40b0480 2023-09-13T02:14:39.972 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.971+0000 7f8fea7c5640 1 -- 172.21.15.104:0/1554903787 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8fd006a4f0 msgr2=0x7f8fd006c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:39.973 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.971+0000 7f8fea7c5640 1 --2- 172.21.15.104:0/1554903787 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8fd006a4f0 0x7f8fd006c9b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4001eb0 tx=0x7f8fd4000fc0 comp rx=0 tx=0).stop 2023-09-13T02:14:39.973 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.971+0000 7f8fea7c5640 1 -- 172.21.15.104:0/1554903787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fe40b0480 msgr2=0x7f8fe40b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:39.973 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.971+0000 7f8fea7c5640 1 --2- 172.21.15.104:0/1554903787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fe40b0480 0x7f8fe40b0900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc001e40 tx=0x7f8fdc003ba0 comp rx=0 tx=0).stop 2023-09-13T02:14:39.973 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.971+0000 7f8fea7c5640 1 -- 172.21.15.104:0/1554903787 shutdown_connections 2023-09-13T02:14:39.974 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.971+0000 7f8fea7c5640 1 --2- 172.21.15.104:0/1554903787 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7f8fd006a4f0 0x7f8fd006c9b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:39.974 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.971+0000 7f8fea7c5640 1 --2- 172.21.15.104:0/1554903787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fe40b0480 0x7f8fe40b0900 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:39.974 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.971+0000 7f8fea7c5640 1 --2- 172.21.15.104:0/1554903787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fe412edd0 0x7f8fe412f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:39.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.971+0000 7f8fea7c5640 1 --2- 172.21.15.104:0/1554903787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8fe41396e0 0x7f8fe4131f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:39.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.971+0000 7f8fea7c5640 1 -- 172.21.15.104:0/1554903787 >> 172.21.15.104:0/1554903787 conn(0x7f8fe4069360 msgr2=0x7f8fe4069740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:39.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.971+0000 7f8fea7c5640 1 -- 172.21.15.104:0/1554903787 shutdown_connections 2023-09-13T02:14:39.975 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:39.971+0000 7f8fea7c5640 1 -- 172.21.15.104:0/1554903787 wait complete. 2023-09-13T02:14:39.984 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-13T02:14:40.134 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.132+0000 7ff85d04f640 1 -- 172.21.15.104:0/2019523820 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8580b20e0 msgr2=0x7ff85813e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:40.135 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.132+0000 7ff85d04f640 1 --2- 172.21.15.104:0/2019523820 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8580b20e0 0x7ff85813e340 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff8580aff40 tx=0x7ff85002c140 comp rx=0 tx=0).stop 2023-09-13T02:14:40.135 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.133+0000 7ff85d04f640 1 -- 172.21.15.104:0/2019523820 shutdown_connections 2023-09-13T02:14:40.135 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.133+0000 7ff85d04f640 1 --2- 172.21.15.104:0/2019523820 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8580b20e0 0x7ff85813e340 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:40.136 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.133+0000 7ff85d04f640 1 --2- 172.21.15.104:0/2019523820 >> v2:172.21.15.119:3300/0 conn(0x7ff8580af4e0 0x7ff85813de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:40.136 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.133+0000 7ff85d04f640 1 -- 172.21.15.104:0/2019523820 >> 172.21.15.104:0/2019523820 conn(0x7ff858069570 msgr2=0x7ff858069980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:40.136 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.133+0000 7ff85d04f640 1 -- 172.21.15.104:0/2019523820 shutdown_connections 2023-09-13T02:14:40.136 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.133+0000 7ff85d04f640 1 -- 172.21.15.104:0/2019523820 wait complete. 2023-09-13T02:14:40.139 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.134+0000 7ff85d04f640 1 Processor -- start 2023-09-13T02:14:40.140 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.134+0000 7ff85d04f640 1 -- start start 2023-09-13T02:14:40.140 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.134+0000 7ff85d04f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8580af4e0 0x7ff85813a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:40.140 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.134+0000 7ff85d04f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8580b20e0 0x7ff8580a6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:40.141 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.134+0000 7ff85d04f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8580b30d0 0x7ff8580a7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:40.141 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.134+0000 7ff85d04f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8581373c0 con 0x7ff8580af4e0 2023-09-13T02:14:40.141 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.134+0000 7ff85d04f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580a9440 con 0x7ff8580b30d0 2023-09-13T02:14:40.141 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.135+0000 7ff85d04f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8581d87d0 con 0x7ff8580b20e0 2023-09-13T02:14:40.142 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.135+0000 7ff856d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8580af4e0 0x7ff85813a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:40.142 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.135+0000 7ff856d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8580af4e0 0x7ff85813a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34684/0 (socket says 172.21.15.104:34684) 2023-09-13T02:14:40.142 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.135+0000 7ff856d9d640 1 -- 172.21.15.104:0/2963496833 learned_addr learned my addr 172.21.15.104:0/2963496833 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:14:40.143 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.135+0000 7ff85759e640 1 --2- 172.21.15.104:0/2963496833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8580b30d0 0x7ff8580a7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:40.143 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.135+0000 7ff85659c640 1 --2- 172.21.15.104:0/2963496833 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8580b20e0 0x7ff8580a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:40.143 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.135+0000 7ff856d9d640 1 -- 172.21.15.104:0/2963496833 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8580b20e0 msgr2=0x7ff8580a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:40.144 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.135+0000 7ff856d9d640 1 --2- 172.21.15.104:0/2963496833 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8580b20e0 0x7ff8580a6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:40.144 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.135+0000 7ff856d9d640 1 -- 172.21.15.104:0/2963496833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8580b30d0 msgr2=0x7ff8580a7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:40.144 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.135+0000 7ff856d9d640 1 --2- 172.21.15.104:0/2963496833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8580b30d0 0x7ff8580a7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:40.144 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.135+0000 7ff856d9d640 1 -- 172.21.15.104:0/2963496833 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff850009900 con 0x7ff8580af4e0 2023-09-13T02:14:40.145 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.135+0000 7ff856d9d640 1 --2- 172.21.15.104:0/2963496833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8580af4e0 0x7ff85813a580 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff84800b3e0 tx=0x7ff84800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:40.145 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.135+0000 7ff83f7fe640 1 -- 172.21.15.104:0/2963496833 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848011830 con 0x7ff8580af4e0 2023-09-13T02:14:40.145 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.135+0000 7ff83f7fe640 1 -- 172.21.15.104:0/2963496833 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff8480119b0 con 0x7ff8580af4e0 2023-09-13T02:14:40.145 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.135+0000 7ff83f7fe640 1 -- 172.21.15.104:0/2963496833 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848011de0 con 0x7ff8580af4e0 2023-09-13T02:14:40.146 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.135+0000 7ff85d04f640 1 -- 172.21.15.104:0/2963496833 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8581d8ab0 con 0x7ff8580af4e0 2023-09-13T02:14:40.146 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.135+0000 7ff85d04f640 1 -- 172.21.15.104:0/2963496833 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8580a9720 con 0x7ff8580af4e0 2023-09-13T02:14:40.146 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.136+0000 7ff85d04f640 1 -- 172.21.15.104:0/2963496833 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8580a6820 con 0x7ff8580af4e0 2023-09-13T02:14:40.147 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.137+0000 7ff83f7fe640 1 -- 172.21.15.104:0/2963496833 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff84801a400 con 0x7ff8580af4e0 2023-09-13T02:14:40.147 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.137+0000 7ff83f7fe640 1 --2- 172.21.15.104:0/2963496833 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff84406a4f0 0x7ff84406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:40.147 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.137+0000 7ff83f7fe640 1 -- 172.21.15.104:0/2963496833 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5911+0+0 (secure 0 0 0) 0x7ff848088cc0 con 0x7ff8580af4e0 2023-09-13T02:14:40.148 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.137+0000 7ff85659c640 1 --2- 172.21.15.104:0/2963496833 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff84406a4f0 0x7ff84406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:40.148 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.137+0000 7ff85659c640 1 --2- 172.21.15.104:0/2963496833 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff84406a4f0 0x7ff84406c9b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff85814b830 tx=0x7ff84c00a2d0 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:40.148 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.141+0000 7ff83f7fe640 1 -- 172.21.15.104:0/2963496833 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff8580a6820 con 0x7ff8580af4e0 2023-09-13T02:14:40.306 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.305+0000 7ff85d04f640 1 -- 172.21.15.104:0/2963496833 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff85813eb40 con 0x7ff8580af4e0 2023-09-13T02:14:40.977 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.976+0000 7ff83f7fe640 1 -- 172.21.15.104:0/2963496833 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff848054230 con 0x7ff8580af4e0 2023-09-13T02:14:40.978 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2023-09-13T02:14:40.979 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.978+0000 7ff85d04f640 1 -- 172.21.15.104:0/2963496833 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff84406a4f0 msgr2=0x7ff84406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:40.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.978+0000 7ff85d04f640 1 --2- 172.21.15.104:0/2963496833 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff84406a4f0 0x7ff84406c9b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff85814b830 tx=0x7ff84c00a2d0 comp rx=0 tx=0).stop 2023-09-13T02:14:40.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.978+0000 7ff85d04f640 1 -- 172.21.15.104:0/2963496833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8580af4e0 msgr2=0x7ff85813a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:40.980 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.978+0000 7ff85d04f640 1 --2- 172.21.15.104:0/2963496833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8580af4e0 0x7ff85813a580 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff84800b3e0 tx=0x7ff84800b8a0 comp rx=0 tx=0).stop 2023-09-13T02:14:40.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.978+0000 7ff85d04f640 1 -- 172.21.15.104:0/2963496833 shutdown_connections 2023-09-13T02:14:40.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.978+0000 7ff85d04f640 1 --2- 172.21.15.104:0/2963496833 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7ff84406a4f0 0x7ff84406c9b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:40.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.978+0000 7ff85d04f640 1 --2- 172.21.15.104:0/2963496833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8580b30d0 0x7ff8580a7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:40.981 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.978+0000 7ff85d04f640 1 --2- 172.21.15.104:0/2963496833 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8580b20e0 0x7ff8580a6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:40.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.978+0000 7ff85d04f640 1 --2- 172.21.15.104:0/2963496833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8580af4e0 0x7ff85813a580 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:40.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.978+0000 7ff85d04f640 1 -- 172.21.15.104:0/2963496833 >> 172.21.15.104:0/2963496833 conn(0x7ff858069570 msgr2=0x7ff8580b6660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:40.982 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.978+0000 7ff85d04f640 1 -- 172.21.15.104:0/2963496833 shutdown_connections 2023-09-13T02:14:40.983 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:40.978+0000 7ff85d04f640 1 -- 172.21.15.104:0/2963496833 wait complete. 2023-09-13T02:14:40.994 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-13T02:14:41.100 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.099+0000 7fd6d78b4640 1 -- 172.21.15.104:0/4201740397 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6d0140dc0 msgr2=0x7fd6d0141210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:41.101 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.099+0000 7fd6d78b4640 1 --2- 172.21.15.104:0/4201740397 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6d0140dc0 0x7fd6d0141210 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0071b30 tx=0x7fd6c802c080 comp rx=0 tx=0).stop 2023-09-13T02:14:41.101 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.099+0000 7fd6d78b4640 1 -- 172.21.15.104:0/4201740397 shutdown_connections 2023-09-13T02:14:41.102 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.099+0000 7fd6d78b4640 1 --2- 172.21.15.104:0/4201740397 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6d0140dc0 0x7fd6d0141210 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:41.102 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.099+0000 7fd6d78b4640 1 --2- 172.21.15.104:0/4201740397 >> v2:172.21.15.119:3300/0 conn(0x7fd6d013b290 0x7fd6d01443b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:41.102 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.099+0000 7fd6d78b4640 1 -- 172.21.15.104:0/4201740397 >> 172.21.15.104:0/4201740397 conn(0x7fd6d00b56f0 msgr2=0x7fd6d00b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:41.102 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.099+0000 7fd6d78b4640 1 -- 172.21.15.104:0/4201740397 shutdown_connections 2023-09-13T02:14:41.103 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.099+0000 7fd6d78b4640 1 -- 172.21.15.104:0/4201740397 wait complete. 2023-09-13T02:14:41.105 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.100+0000 7fd6d78b4640 1 Processor -- start 2023-09-13T02:14:41.106 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.100+0000 7fd6d78b4640 1 -- start start 2023-09-13T02:14:41.106 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6d78b4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6d00b02e0 0x7fd6d00b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:41.106 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6d78b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6d013b290 0x7fd6d01da3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:41.107 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6d78b4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6d0140dc0 0x7fd6d01da920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:41.107 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6d78b4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d01dae60 con 0x7fd6d0140dc0 2023-09-13T02:14:41.107 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6d78b4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d0141f80 con 0x7fd6d013b290 2023-09-13T02:14:41.107 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6d78b4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d0142260 con 0x7fd6d00b02e0 2023-09-13T02:14:41.108 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6d5e51640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6d0140dc0 0x7fd6d01da920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:41.108 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6d5e51640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6d0140dc0 0x7fd6d01da920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34698/0 (socket says 172.21.15.104:34698) 2023-09-13T02:14:41.108 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6d5e51640 1 -- 172.21.15.104:0/1938556564 learned_addr learned my addr 172.21.15.104:0/1938556564 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-09-13T02:14:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6d5e51640 1 -- 172.21.15.104:0/1938556564 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6d00b02e0 msgr2=0x7fd6d00b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6d5e51640 1 --2- 172.21.15.104:0/1938556564 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6d00b02e0 0x7fd6d00b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6d5e51640 1 -- 172.21.15.104:0/1938556564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6d013b290 msgr2=0x7fd6d01da3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6d5e51640 1 --2- 172.21.15.104:0/1938556564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6d013b290 0x7fd6d01da3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:41.110 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6d5e51640 1 -- 172.21.15.104:0/1938556564 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c8009840 con 0x7fd6d0140dc0 2023-09-13T02:14:41.110 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6d5e51640 1 --2- 172.21.15.104:0/1938556564 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6d0140dc0 0x7fd6d01da920 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8036040 tx=0x7fd6c8004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:41.110 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6c5ffb640 1 -- 172.21.15.104:0/1938556564 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8004820 con 0x7fd6d0140dc0 2023-09-13T02:14:41.111 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6c5ffb640 1 -- 172.21.15.104:0/1938556564 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd6c803e560 con 0x7fd6d0140dc0 2023-09-13T02:14:41.111 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6c5ffb640 1 -- 172.21.15.104:0/1938556564 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c803e950 con 0x7fd6d0140dc0 2023-09-13T02:14:41.111 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.101+0000 7fd6d78b4640 1 -- 172.21.15.104:0/1938556564 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d0142540 con 0x7fd6d0140dc0 2023-09-13T02:14:41.111 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.102+0000 7fd6d78b4640 1 -- 172.21.15.104:0/1938556564 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d00b53a0 con 0x7fd6d0140dc0 2023-09-13T02:14:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.103+0000 7fd6d78b4640 1 -- 172.21.15.104:0/1938556564 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d0142a60 con 0x7fd6d0140dc0 2023-09-13T02:14:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.103+0000 7fd6c5ffb640 1 -- 172.21.15.104:0/1938556564 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd6c803eab0 con 0x7fd6d0140dc0 2023-09-13T02:14:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.103+0000 7fd6c5ffb640 1 --2- 172.21.15.104:0/1938556564 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd6b406a4f0 0x7fd6b406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T02:14:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.104+0000 7fd6d5650640 1 --2- 172.21.15.104:0/1938556564 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd6b406a4f0 0x7fd6b406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T02:14:41.113 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.104+0000 7fd6c5ffb640 1 -- 172.21.15.104:0/1938556564 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5473+0+0 (secure 0 0 0) 0x7fd6c80abbd0 con 0x7fd6d0140dc0 2023-09-13T02:14:41.113 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.104+0000 7fd6d5650640 1 --2- 172.21.15.104:0/1938556564 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd6b406a4f0 0x7fd6b406c9b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc001600 tx=0x7fd6cc007910 comp rx=0 tx=0).ready entity=mgr.4182 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T02:14:41.114 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.108+0000 7fd6c5ffb640 1 -- 172.21.15.104:0/1938556564 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd6d0142a60 con 0x7fd6d0140dc0 2023-09-13T02:14:41.277 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.276+0000 7fd6d78b4640 1 -- 172.21.15.104:0/1938556564 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd6d0142a60 con 0x7fd6d0140dc0 2023-09-13T02:14:41.984 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.983+0000 7fd6c5ffb640 1 -- 172.21.15.104:0/1938556564 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd6d0142a60 con 0x7fd6d0140dc0 2023-09-13T02:14:41.984 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2023-09-13T02:14:41.986 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.985+0000 7fd6d78b4640 1 -- 172.21.15.104:0/1938556564 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd6b406a4f0 msgr2=0x7fd6b406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:41.987 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.985+0000 7fd6d78b4640 1 --2- 172.21.15.104:0/1938556564 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd6b406a4f0 0x7fd6b406c9b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc001600 tx=0x7fd6cc007910 comp rx=0 tx=0).stop 2023-09-13T02:14:41.987 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.985+0000 7fd6d78b4640 1 -- 172.21.15.104:0/1938556564 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6d0140dc0 msgr2=0x7fd6d01da920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T02:14:41.987 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.985+0000 7fd6d78b4640 1 --2- 172.21.15.104:0/1938556564 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6d0140dc0 0x7fd6d01da920 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8036040 tx=0x7fd6c8004360 comp rx=0 tx=0).stop 2023-09-13T02:14:41.987 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.985+0000 7fd6d78b4640 1 -- 172.21.15.104:0/1938556564 shutdown_connections 2023-09-13T02:14:41.988 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.985+0000 7fd6d78b4640 1 --2- 172.21.15.104:0/1938556564 >> [v2:172.21.15.104:6832/3152101627,v1:172.21.15.104:6833/3152101627] conn(0x7fd6b406a4f0 0x7fd6b406c9b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:41.988 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.985+0000 7fd6d78b4640 1 --2- 172.21.15.104:0/1938556564 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6d0140dc0 0x7fd6d01da920 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:41.988 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.985+0000 7fd6d78b4640 1 --2- 172.21.15.104:0/1938556564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6d013b290 0x7fd6d01da3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:41.989 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.985+0000 7fd6d78b4640 1 --2- 172.21.15.104:0/1938556564 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6d00b02e0 0x7fd6d00b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T02:14:41.989 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.985+0000 7fd6d78b4640 1 -- 172.21.15.104:0/1938556564 >> 172.21.15.104:0/1938556564 conn(0x7fd6d00b56f0 msgr2=0x7fd6d00b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T02:14:41.989 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.985+0000 7fd6d78b4640 1 -- 172.21.15.104:0/1938556564 shutdown_connections 2023-09-13T02:14:41.989 INFO:teuthology.orchestra.run.smithi104.stderr:2023-09-13T02:14:41.985+0000 7fd6d78b4640 1 -- 172.21.15.104:0/1938556564 wait complete. 2023-09-13T02:14:42.001 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-13T02:14:42.002 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-13T02:14:42.002 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T02:14:42.010 INFO:tasks.ceph.mds.a:Stopped 2023-09-13T02:14:42.011 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-13T02:14:42.011 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T02:14:42.021 INFO:tasks.ceph.mds.b:Stopped 2023-09-13T02:14:42.022 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-13T02:14:42.022 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-13T02:14:42.023 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T02:14:42.074 INFO:tasks.ceph.osd.0:Stopped 2023-09-13T02:14:42.075 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-13T02:14:42.077 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T02:14:42.141 INFO:tasks.ceph.osd.1:Stopped 2023-09-13T02:14:42.142 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-13T02:14:42.142 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T02:14:42.211 INFO:tasks.ceph.osd.2:Stopped 2023-09-13T02:14:42.211 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-13T02:14:42.212 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T02:14:42.277 INFO:tasks.ceph.osd.3:Stopped 2023-09-13T02:14:42.277 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-09-13T02:14:42.278 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T02:14:42.309 INFO:tasks.ceph.osd.4:Stopped 2023-09-13T02:14:42.310 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-09-13T02:14:42.310 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T02:14:42.376 INFO:tasks.ceph.osd.5:Stopped 2023-09-13T02:14:42.377 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-09-13T02:14:42.377 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T02:14:42.443 INFO:tasks.ceph.osd.6:Stopped 2023-09-13T02:14:42.444 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-09-13T02:14:42.444 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T02:14:42.515 INFO:tasks.ceph.osd.7:Stopped 2023-09-13T02:14:42.516 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-13T02:14:42.516 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-09-13T02:14:42.516 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T02:14:42.539 INFO:tasks.ceph.mgr.y:Stopped 2023-09-13T02:14:42.540 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-13T02:14:42.540 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T02:14:42.579 INFO:tasks.ceph.mgr.x:Stopped 2023-09-13T02:14:42.580 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-13T02:14:42.581 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-13T02:14:42.581 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T02:14:42.591 INFO:tasks.ceph.mon.a:Stopped 2023-09-13T02:14:42.592 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-13T02:14:42.592 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T02:14:42.631 INFO:tasks.ceph.mon.b:Stopped 2023-09-13T02:14:42.632 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-13T02:14:42.632 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T02:14:42.683 INFO:tasks.ceph.mon.c:Stopped 2023-09-13T02:14:42.684 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-13T02:14:42.684 DEBUG:teuthology.orchestra.run.smithi104:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-09-13T02:14:42.719 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi104.front.sepia.ceph.com 2023-09-13T02:14:42.719 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-13T02:14:42.957 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi104.front.sepia.ceph.com 2023-09-13T02:14:42.958 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-13T02:14:43.029 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi104.front.sepia.ceph.com 2023-09-13T02:14:43.029 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-13T02:14:43.080 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi104.front.sepia.ceph.com 2023-09-13T02:14:43.081 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-09-13T02:14:43.121 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi119.front.sepia.ceph.com 2023-09-13T02:14:43.122 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-09-13T02:14:43.327 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi119.front.sepia.ceph.com 2023-09-13T02:14:43.328 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-09-13T02:14:43.397 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi119.front.sepia.ceph.com 2023-09-13T02:14:43.398 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-09-13T02:14:43.451 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi119.front.sepia.ceph.com 2023-09-13T02:14:43.452 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-09-13T02:14:43.508 INFO:tasks.ceph:Archiving mon data... 2023-09-13T02:14:43.509 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395228/data/mon.a.tgz 2023-09-13T02:14:43.510 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2023-09-13T02:14:43.526 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.xRNoNNf52J 2023-09-13T02:14:43.526 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.xRNoNNf52J 2023-09-13T02:14:43.645 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.xRNoNNf52J 2023-09-13T02:14:43.731 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.xRNoNNf52J is 263KB 2023-09-13T02:14:43.830 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.xRNoNNf52J 2023-09-13T02:14:43.844 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395228/data/mon.b.tgz 2023-09-13T02:14:43.845 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2023-09-13T02:14:43.861 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.2sWWT1pZo8 2023-09-13T02:14:43.861 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.2sWWT1pZo8 2023-09-13T02:14:44.024 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.2sWWT1pZo8 2023-09-13T02:14:44.107 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.2sWWT1pZo8 is 352KB 2023-09-13T02:14:44.205 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.2sWWT1pZo8 2023-09-13T02:14:44.219 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395228/data/mon.c.tgz 2023-09-13T02:14:44.220 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2023-09-13T02:14:44.274 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.Z4wkSIfZwF 2023-09-13T02:14:44.274 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Z4wkSIfZwF 2023-09-13T02:14:44.403 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.Z4wkSIfZwF 2023-09-13T02:14:44.487 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.Z4wkSIfZwF is 352KB 2023-09-13T02:14:44.583 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.Z4wkSIfZwF 2023-09-13T02:14:44.597 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-13T02:14:44.597 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-13T02:14:44.601 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-13T02:14:44.662 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-13T02:14:44.663 DEBUG:teuthology.orchestra.run.smithi104:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-13T02:14:44.669 DEBUG:teuthology.orchestra.run.smithi119:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-13T02:14:44.697 INFO:teuthology.orchestra.run.smithi104.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-13T02:14:44.730 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-13T02:14:44.734 INFO:tasks.ceph:Archiving crash dumps... 2023-09-13T02:14:44.736 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395228/remote/smithi104/crash 2023-09-13T02:14:44.737 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-13T02:14:44.771 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395228/remote/smithi119/crash 2023-09-13T02:14:44.772 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-13T02:14:44.800 INFO:tasks.ceph:Shutting down logrotate 2023-09-13T02:14:44.800 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:14:44.816 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:14:44.895 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-13T02:14:44.923 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-13T02:14:44.949 INFO:tasks.ceph:Compressing logs... 2023-09-13T02:14:44.950 DEBUG:teuthology.orchestra.run.smithi104:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-13T02:14:44.966 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-13T02:14:44.990 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93657.log 2023-09-13T02:14:44.991 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97768.log 2023-09-13T02:14:44.991 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.93657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93855.log 2023-09-13T02:14:45.037 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-09-13T02:14:45.037 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86710.log 2023-09-13T02:14:45.038 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86750.log 2023-09-13T02:14:45.038 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.86710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86670.log 2023-09-13T02:14:45.038 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.86750.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-09-13T02:14:45.038 INFO:teuthology.orchestra.run.smithi119.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.86710.log.gz 2023-09-13T02:14:45.039 INFO:teuthology.orchestra.run.smithi119.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.86750.log.gz 2023-09-13T02:14:45.039 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.86670.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-09-13T02:14:45.039 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.audit.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.86670.log.gz 2023-09-13T02:14:45.040 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-09-13T02:14:45.040 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86550.log 2023-09-13T02:14:45.041 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-09-13T02:14:45.041 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.86550.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-09-13T02:14:45.041 INFO:teuthology.orchestra.run.smithi119.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-09-13T02:14:45.042 INFO:teuthology.orchestra.run.smithi119.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.86550.log.gz 2023-09-13T02:14:45.042 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86790.log 2023-09-13T02:14:45.043 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.5.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-09-13T02:14:45.043 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86830.log 2023-09-13T02:14:45.044 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.86790.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-09-13T02:14:45.044 INFO:teuthology.orchestra.run.smithi119.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.86790.log.gz 2023-09-13T02:14:45.045 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.86830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86590.log 2023-09-13T02:14:45.046 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mgr.x.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.86830.log.gz 2023-09-13T02:14:45.046 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-09-13T02:14:45.047 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.86590.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.86590.log.gz 2023-09-13T02:14:45.047 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86630.log 2023-09-13T02:14:45.047 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-09-13T02:14:45.048 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.86630.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-09-13T02:14:45.048 INFO:teuthology.orchestra.run.smithi119.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.86630.log.gz 2023-09-13T02:14:45.048 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-mon.c.log: 91.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-09-13T02:14:45.049 INFO:teuthology.orchestra.run.smithi119.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-09-13T02:14:45.066 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93657.log.gz 2023-09-13T02:14:45.066 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.97768.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-09-13T02:14:45.066 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.97768.log.gz 2023-09-13T02:14:45.067 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.93855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94498.log 2023-09-13T02:14:45.067 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96833.log 2023-09-13T02:14:45.067 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.93855.log.gz 2023-09-13T02:14:45.068 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87407.log 2023-09-13T02:14:45.068 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.96833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87005.log 2023-09-13T02:14:45.068 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.94498.log.gz 2023-09-13T02:14:45.068 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87407.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96833.log.gz 2023-09-13T02:14:45.069 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87509.log 2023-09-13T02:14:45.069 INFO:teuthology.orchestra.run.smithi104.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.87407.log.gz 2023-09-13T02:14:45.069 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96302.log 2023-09-13T02:14:45.070 INFO:teuthology.orchestra.run.smithi104.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.87005.log.gz 2023-09-13T02:14:45.070 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93531.log 2023-09-13T02:14:45.070 INFO:teuthology.orchestra.run.smithi104.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.87509.log.gz 2023-09-13T02:14:45.070 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.96302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95915.log 2023-09-13T02:14:45.071 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.93531.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96302.log.gz 2023-09-13T02:14:45.071 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94235.log 2023-09-13T02:14:45.071 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4%/var/log/ceph/ceph-client.admin.95915.log: -- replaced with /var/log/ceph/ceph-client.admin.93531.log.gz 2023-09-13T02:14:45.071 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94193.log 2023-09-13T02:14:45.072 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95915.log.gz 2023-09-13T02:14:45.072 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93743.log 2023-09-13T02:14:45.072 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94235.log.gz 2023-09-13T02:14:45.073 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95411.log 2023-09-13T02:14:45.073 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.93743.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94193.log.gz 2023-09-13T02:14:45.073 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94277.log 2023-09-13T02:14:45.073 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93743.log.gz 2023-09-13T02:14:45.074 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94500.log 2023-09-13T02:14:45.074 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96325.log 2023-09-13T02:14:45.074 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95411.log.gz 2023-09-13T02:14:45.074 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94277.log.gz 2023-09-13T02:14:45.075 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94837.log 2023-09-13T02:14:45.075 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.94500.log.gz 2023-09-13T02:14:45.075 INFO:teuthology.orchestra.run.smithi104.stderr:gzip/var/log/ceph/ceph-client.admin.96325.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.93615.log 2023-09-13T02:14:45.076 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96325.log.gz/var/log/ceph/ceph-client.admin.94837.log: 2023-09-13T02:14:45.076 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94495.log 2023-09-13T02:14:45.076 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.93615.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94837.log.gz 2023-09-13T02:14:45.076 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88065.log 2023-09-13T02:14:45.077 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93615.log.gz 2023-09-13T02:14:45.077 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96413.log 2023-09-13T02:14:45.077 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.88065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94835.log 2023-09-13T02:14:45.077 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94495.log.gz 2023-09-13T02:14:45.078 INFO:teuthology.orchestra.run.smithi104.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.88065.log.gz 2023-09-13T02:14:45.078 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.96413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95495.log 2023-09-13T02:14:45.078 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96413.log.gz 2023-09-13T02:14:45.079 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87033.log 2023-09-13T02:14:45.079 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94835.log.gz 2023-09-13T02:14:45.079 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93385.log 2023-09-13T02:14:45.079 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87033.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95495.log.gzgzip 2023-09-13T02:14:45.080 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.87846.log 2023-09-13T02:14:45.080 INFO:teuthology.orchestra.run.smithi104.stderr: 76.9% -- replaced with /var/log/ceph/ceph-client.admin.87033.log.gz 2023-09-13T02:14:45.080 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.93385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94319.log 2023-09-13T02:14:45.081 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93385.log.gz 2023-09-13T02:14:45.081 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96875.log 2023-09-13T02:14:45.081 INFO:teuthology.orchestra.run.smithi104.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.87846.log.gz 2023-09-13T02:14:45.081 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94834.log 2023-09-13T02:14:45.082 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94319.log: /var/log/ceph/ceph-client.admin.96875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96623.log 2023-09-13T02:14:45.082 INFO:teuthology.orchestra.run.smithi104.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94319.log.gz 2023-09-13T02:14:45.082 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94834.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.96875.log.gz 2023-09-13T02:14:45.083 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96497.log 2023-09-13T02:14:45.083 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.94834.log.gz 2023-09-13T02:14:45.083 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.96623.log: /var/log/ceph/ceph.audit.log 2023-09-13T02:14:45.083 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.96497.log: gzip 87.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.96623.log.gz --verbose 2023-09-13T02:14:45.084 INFO:teuthology.orchestra.run.smithi104.stderr: -- /var/log/ceph/ceph-client.admin.95579.log 2023-09-13T02:14:45.084 INFO:teuthology.orchestra.run.smithi104.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.96497.log.gz 2023-09-13T02:14:45.084 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95071.log 2023-09-13T02:14:45.085 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97211.log 2023-09-13T02:14:45.085 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95579.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.95071.log: /var/log/ceph/ceph-client.admin.97085.log 2023-09-13T02:14:45.085 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95579.log.gz 2023-09-13T02:14:45.085 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.97211.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.95071.log.gz 2023-09-13T02:14:45.086 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93573.log 2023-09-13T02:14:45.086 INFO:teuthology.orchestra.run.smithi104.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-09-13T02:14:45.086 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.97211.log.gz 2023-09-13T02:14:45.086 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.97085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86949.log 2023-09-13T02:14:45.087 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97085.log.gz 2023-09-13T02:14:45.087 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.93573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95073.log 2023-09-13T02:14:45.087 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93573.log.gz 2023-09-13T02:14:45.088 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.86949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93489.log 2023-09-13T02:14:45.088 INFO:teuthology.orchestra.run.smithi104.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.86949.log.gz 2023-09-13T02:14:45.088 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93447.log 2023-09-13T02:14:45.088 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95073.log.gz 2023-09-13T02:14:45.089 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.93489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97581.log 2023-09-13T02:14:45.089 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93489.log.gz 2023-09-13T02:14:45.089 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.93447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96665.log 2023-09-13T02:14:45.089 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.97581.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93447.log.gz 2023-09-13T02:14:45.090 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95170.log 2023-09-13T02:14:45.090 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.97581.log.gz 2023-09-13T02:14:45.090 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.96665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87540.log 2023-09-13T02:14:45.091 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.96665.log.gz 2023-09-13T02:14:45.091 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97127.log 2023-09-13T02:14:45.091 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87540.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.95170.log.gz 2023-09-13T02:14:45.091 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96539.log 2023-09-13T02:14:45.092 INFO:teuthology.orchestra.run.smithi104.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.87540.log.gz 2023-09-13T02:14:45.092 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.97127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87435.log 2023-09-13T02:14:45.092 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.97127.log.gz 2023-09-13T02:14:45.093 INFO:teuthology.orchestra.run.smithi104.stderr:gzip/var/log/ceph/ceph-client.admin.96539.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.94836.log 2023-09-13T02:14:45.093 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87435.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96539.log.gzgzip 2023-09-13T02:14:45.093 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.93216.log 2023-09-13T02:14:45.093 INFO:teuthology.orchestra.run.smithi104.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.87435.log.gz 2023-09-13T02:14:45.094 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96791.log 2023-09-13T02:14:45.094 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94836.log.gz 2023-09-13T02:14:45.094 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.93216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97539.log 2023-09-13T02:14:45.095 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93216.log.gz 2023-09-13T02:14:45.095 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.96791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87508.log 2023-09-13T02:14:45.095 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.97539.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.96791.log.gz 2023-09-13T02:14:45.095 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95072.log 2023-09-13T02:14:45.096 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.97539.log.gz 2023-09-13T02:14:45.096 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95537.log 2023-09-13T02:14:45.096 INFO:teuthology.orchestra.run.smithi104.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.87508.log.gz 2023-09-13T02:14:45.096 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93699.log 2023-09-13T02:14:45.097 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95072.log.gz 2023-09-13T02:14:45.097 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95663.log 2023-09-13T02:14:45.097 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7%/var/log/ceph/ceph-client.admin.93699.log: -- replaced with /var/log/ceph/ceph-client.admin.95537.log.gz 2023-09-13T02:14:45.098 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87145.log 2023-09-13T02:14:45.098 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95663.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93699.log.gz 2023-09-13T02:14:45.098 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-09-13T02:14:45.098 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95663.log.gz 2023-09-13T02:14:45.099 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95747.log 2023-09-13T02:14:45.099 INFO:teuthology.orchestra.run.smithi104.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.87145.log.gz 2023-09-13T02:14:45.099 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95173.log 2023-09-13T02:14:45.100 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95621.log 2023-09-13T02:14:45.100 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95747.log.gz 2023-09-13T02:14:45.100 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87388.log 2023-09-13T02:14:45.100 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95173.log.gz 2023-09-13T02:14:45.101 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94829.log 2023-09-13T02:14:45.101 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95621.log: /var/log/ceph/ceph-client.admin.87388.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95621.log.gz 2023-09-13T02:14:45.101 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94497.log 2023-09-13T02:14:45.101 INFO:teuthology.orchestra.run.smithi104.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.87388.log.gz 2023-09-13T02:14:45.102 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95957.log 2023-09-13T02:14:45.102 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94829.log: /var/log/ceph/ceph-client.admin.94497.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94829.log.gz 2023-09-13T02:14:45.102 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97169.log 2023-09-13T02:14:45.103 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94497.log.gz 2023-09-13T02:14:45.103 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93983.log 2023-09-13T02:14:45.103 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95957.log: /var/log/ceph/ceph-client.admin.97169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94109.log 2023-09-13T02:14:45.103 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95957.log.gz 2023-09-13T02:14:45.104 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.93983.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97169.log.gz 2023-09-13T02:14:45.104 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94499.log 2023-09-13T02:14:45.104 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94833.log 2023-09-13T02:14:45.104 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93983.log.gz 2023-09-13T02:14:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94109.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.94109.log.gz 2023-09-13T02:14:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87581.log 2023-09-13T02:14:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87219.log 2023-09-13T02:14:45.106 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94833.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94499.log.gz 2023-09-13T02:14:45.106 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87581.log: gzip 87.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.94833.log.gz --verbose 2023-09-13T02:14:45.106 INFO:teuthology.orchestra.run.smithi104.stderr: -- /var/log/ceph/ceph-client.admin.94151.log 2023-09-13T02:14:45.106 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97683.log 2023-09-13T02:14:45.107 INFO:teuthology.orchestra.run.smithi104.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.87581.log.gz 2023-09-13T02:14:45.107 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87219.log: /var/log/ceph/ceph-client.admin.94151.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.87219.log.gz 2023-09-13T02:14:45.107 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87506.log 2023-09-13T02:14:45.107 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.94151.log.gz 2023-09-13T02:14:45.108 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95453.log 2023-09-13T02:14:45.108 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.97683.log: /var/log/ceph/ceph-client.admin.87506.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-09-13T02:14:45.108 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.97683.log.gz 2023-09-13T02:14:45.109 INFO:teuthology.orchestra.run.smithi104.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.87506.log.gz 2023-09-13T02:14:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93939.log 2023-09-13T02:14:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94067.log 2023-09-13T02:14:45.109 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95453.log.gz 2023-09-13T02:14:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.93939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94831.log 2023-09-13T02:14:45.110 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93939.log.gz 2023-09-13T02:14:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97001.log 2023-09-13T02:14:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95369.log 2023-09-13T02:14:45.111 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94067.log.gz 2023-09-13T02:14:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94831.log: /var/log/ceph/ceph-client.admin.97001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94025.log 2023-09-13T02:14:45.111 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.94831.log.gz 2023-09-13T02:14:45.112 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95789.log 2023-09-13T02:14:45.112 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.97001.log.gz 2023-09-13T02:14:45.112 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.95369.log.gz 2023-09-13T02:14:45.113 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94501.log 2023-09-13T02:14:45.113 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94025.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-09-13T02:14:45.113 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95789.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94025.log.gz 2023-09-13T02:14:45.113 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87117.log 2023-09-13T02:14:45.114 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95789.log.gz 2023-09-13T02:14:45.114 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96749.log 2023-09-13T02:14:45.114 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.94501.log.gz 2023-09-13T02:14:45.114 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97623.log 2023-09-13T02:14:45.115 INFO:teuthology.orchestra.run.smithi104.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.87117.log.gz 2023-09-13T02:14:45.115 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.96749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96959.log 2023-09-13T02:14:45.115 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.97623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97253.log 2023-09-13T02:14:45.116 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96749.log.gz 2023-09-13T02:14:45.116 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.96959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94493.log 2023-09-13T02:14:45.116 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97623.log.gz 2023-09-13T02:14:45.116 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.96959.log.gz 2023-09-13T02:14:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97497.log 2023-09-13T02:14:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.97253.log: /var/log/ceph/ceph-client.admin.94493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95999.log 2023-09-13T02:14:45.117 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% 87.4%/var/log/ceph/ceph-client.admin.97497.log: -- replaced with /var/log/ceph/ceph-client.admin.94493.log.gz 2023-09-13T02:14:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95831.log 2023-09-13T02:14:45.118 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97253.log.gz 2023-09-13T02:14:45.118 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95999.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97497.log.gz 2023-09-13T02:14:45.118 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97455.log 2023-09-13T02:14:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97043.log 2023-09-13T02:14:45.119 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95831.log.gz 91.1% -- replaced with /var/log/ceph/ceph-client.admin.95999.log.gz 2023-09-13T02:14:45.119 INFO:teuthology.orchestra.run.smithi104.stderr: 2023-09-13T02:14:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.97455.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-09-13T02:14:45.120 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97455.log.gz 2023-09-13T02:14:45.120 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.97043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97726.log 2023-09-13T02:14:45.120 INFO:teuthology.orchestra.run.smithi104.stderr:gzip/var/log/ceph/ceph-osd.0.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.97043.log.gz 2023-09-13T02:14:45.121 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.87507.log 2023-09-13T02:14:45.121 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.97726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87321.log 2023-09-13T02:14:45.121 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97726.log.gz 2023-09-13T02:14:45.121 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87256.log 2023-09-13T02:14:45.122 INFO:teuthology.orchestra.run.smithi104.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.87507.log.gz 2023-09-13T02:14:45.122 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93787.log 2023-09-13T02:14:45.122 INFO:teuthology.orchestra.run.smithi104.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.87321.log.gz 2023-09-13T02:14:45.123 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95172.log 2023-09-13T02:14:45.123 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87256.log: /var/log/ceph/ceph-client.admin.93787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94496.log 2023-09-13T02:14:45.123 INFO:teuthology.orchestra.run.smithi104.stderr: 86.2%/var/log/ceph/ceph-client.admin.95172.log: -- replaced with /var/log/ceph/ceph-client.admin.87256.log.gz 2023-09-13T02:14:45.123 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93787.log.gz 2023-09-13T02:14:45.124 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.95172.log.gz -5 2023-09-13T02:14:45.124 INFO:teuthology.orchestra.run.smithi104.stderr: --verbose -- /var/log/ceph/ceph-client.admin.96581.log 2023-09-13T02:14:45.124 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5/var/log/ceph/ceph-client.admin.94496.log: --verbose -- /var/log/ceph/ceph.log 2023-09-13T02:14:45.124 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.96581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87089.log 2023-09-13T02:14:45.125 INFO:teuthology.orchestra.run.smithi104.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.94496.log.gz 2023-09-13T02:14:45.125 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96581.log.gz 2023-09-13T02:14:45.125 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93308.log 2023-09-13T02:14:45.126 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87089.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-09-13T02:14:45.126 INFO:teuthology.orchestra.run.smithi104.stderr: 75.2% -- replaced with /var/log/ceph/ceph-client.admin.87089.log.gz 2023-09-13T02:14:45.126 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.93308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93897.log 2023-09-13T02:14:45.126 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93308.log.gz 2023-09-13T02:14:45.127 INFO:teuthology.orchestra.run.smithi104.stderr: 85.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-09-13T02:14:45.127 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97355.log 2023-09-13T02:14:45.127 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.93897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87287.log 2023-09-13T02:14:45.127 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93897.log.gz 2023-09-13T02:14:45.128 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.97355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97313.log 2023-09-13T02:14:45.128 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.97355.log.gz 2023-09-13T02:14:45.128 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95873.log 2023-09-13T02:14:45.129 INFO:teuthology.orchestra.run.smithi104.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.87287.log.gz/var/log/ceph/ceph-client.admin.97313.log: 2023-09-13T02:14:45.129 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96917.log 2023-09-13T02:14:45.129 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97313.log.gz 2023-09-13T02:14:45.129 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87565.log 2023-09-13T02:14:45.130 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95873.log.gz 2023-09-13T02:14:45.130 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.96917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95169.log 2023-09-13T02:14:45.130 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87565.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.96917.log.gz 2023-09-13T02:14:45.130 INFO:teuthology.orchestra.run.smithi104.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.87565.log.gz 2023-09-13T02:14:45.131 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96707.log 2023-09-13T02:14:45.131 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95705.log 2023-09-13T02:14:45.131 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95169.log: /var/log/ceph/ceph-client.admin.96707.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95169.log.gz 2023-09-13T02:14:45.132 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94827.log 2023-09-13T02:14:45.132 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96707.log.gz 2023-09-13T02:14:45.132 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.81101.log 2023-09-13T02:14:45.132 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95705.log: /var/log/ceph/ceph-client.admin.94827.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95705.log.gz 2023-09-13T02:14:45.133 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.94827.log.gz 2023-09-13T02:14:45.133 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95171.log 2023-09-13T02:14:45.133 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96455.log 2023-09-13T02:14:45.134 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.tmp-client.admin.81101.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.81101.log.gz 2023-09-13T02:14:45.134 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88189.log 2023-09-13T02:14:45.134 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95171.log.gz 2023-09-13T02:14:45.134 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.96455.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-09-13T02:14:45.135 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.88189.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.96455.log.gz 2023-09-13T02:14:45.135 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96221.log 2023-09-13T02:14:45.135 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.88189.log.gz 2023-09-13T02:14:45.135 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87061.log 2023-09-13T02:14:45.136 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.96221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97415.log 2023-09-13T02:14:45.136 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87061.log.gz 2023-09-13T02:14:45.136 INFO:teuthology.orchestra.run.smithi104.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-09-13T02:14:45.137 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.97415.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.97415.log.gz 2023-09-13T02:14:45.137 INFO:teuthology.orchestra.run.smithi104.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.96221.log.gz 2023-09-13T02:14:45.138 INFO:teuthology.orchestra.run.smithi119.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-09-13T02:14:45.138 INFO:teuthology.orchestra.run.smithi119.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-09-13T02:14:45.179 INFO:teuthology.orchestra.run.smithi104.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-09-13T02:14:45.195 INFO:teuthology.orchestra.run.smithi104.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-09-13T02:14:45.201 INFO:teuthology.orchestra.run.smithi119.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-09-13T02:14:45.207 INFO:teuthology.orchestra.run.smithi104.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-09-13T02:14:45.211 INFO:teuthology.orchestra.run.smithi119.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-09-13T02:14:45.227 INFO:teuthology.orchestra.run.smithi119.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-09-13T02:14:45.262 INFO:teuthology.orchestra.run.smithi104.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-09-13T02:14:45.263 INFO:teuthology.orchestra.run.smithi104.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-09-13T02:14:45.265 INFO:teuthology.orchestra.run.smithi104.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-09-13T02:14:45.267 INFO:teuthology.orchestra.run.smithi104.stderr: 2023-09-13T02:14:45.267 INFO:teuthology.orchestra.run.smithi104.stderr:real 0m0.289s 2023-09-13T02:14:45.267 INFO:teuthology.orchestra.run.smithi104.stderr:user 0m1.427s 2023-09-13T02:14:45.268 INFO:teuthology.orchestra.run.smithi104.stderr:sys 0m0.123s 2023-09-13T02:14:45.287 INFO:teuthology.orchestra.run.smithi119.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-09-13T02:14:45.288 INFO:teuthology.orchestra.run.smithi119.stderr: 2023-09-13T02:14:45.289 INFO:teuthology.orchestra.run.smithi119.stderr:real 0m0.283s 2023-09-13T02:14:45.289 INFO:teuthology.orchestra.run.smithi119.stderr:user 0m0.997s 2023-09-13T02:14:45.289 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m0.063s 2023-09-13T02:14:45.290 INFO:tasks.ceph:Archiving logs... 2023-09-13T02:14:45.290 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395228/remote/smithi104/log 2023-09-13T02:14:45.291 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-13T02:14:45.602 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395228/remote/smithi119/log 2023-09-13T02:14:45.604 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-13T02:14:45.764 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-13T02:14:45.785 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-13T02:14:45.786 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-13T02:14:45.789 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-13T02:14:45.870 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-13T02:14:45.881 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-13T02:14:45.882 DEBUG:teuthology.orchestra.run.smithi104:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-13T02:14:45.884 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-13T02:14:45.895 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2023-09-13T02:14:45.898 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2023-09-13T02:14:45.899 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-13T02:14:45.899 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2023-09-13T02:14:45.900 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 64 -383us[ -383us] +/- 88ms 2023-09-13T02:14:45.900 INFO:teuthology.orchestra.run.smithi104.stdout:^* hv02.front.sepia.ceph.com 3 6 377 64 -344us[ -346us] +/- 56ms 2023-09-13T02:14:45.900 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 +894us[ +894us] +/- 82ms 2023-09-13T02:14:45.901 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T02:14:45.902 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-13T02:14:45.903 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2023-09-13T02:14:45.903 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 64 -377us[ -377us] +/- 88ms 2023-09-13T02:14:45.903 INFO:teuthology.orchestra.run.smithi119.stdout:^* hv02.front.sepia.ceph.com 3 6 377 64 -335us[ -327us] +/- 56ms 2023-09-13T02:14:45.903 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 +905us[ +905us] +/- 82ms 2023-09-13T02:14:45.904 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T02:14:45.904 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-13T02:14:45.915 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-13T02:14:45.915 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-13T02:14:45.926 DEBUG:teuthology.orchestra.run.smithi104:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-13T02:14:46.033 DEBUG:teuthology.orchestra.run.smithi119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-13T02:14:46.122 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-13T02:14:46.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T02:14:46.155 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-13T02:14:46.186 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T02:14:46.187 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-13T02:14:46.197 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-13T02:14:46.207 INFO:teuthology.task.internal:Duration was 647.784332 seconds 2023-09-13T02:14:46.207 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-13T02:14:46.220 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-13T02:14:46.220 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-13T02:14:46.223 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-13T02:14:46.263 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-13T02:14:46.270 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-13T02:14:46.667 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-13T02:14:46.667 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi104.front.sepia.ceph.com 2023-09-13T02:14:46.668 DEBUG:teuthology.orchestra.run.smithi104:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-13T02:14:46.728 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2023-09-13T02:14:46.728 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-13T02:14:46.761 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-13T02:14:46.761 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-13T02:14:46.770 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-13T02:14:46.829 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-13T02:14:46.830 DEBUG:teuthology.orchestra.run.smithi104:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-13T02:14:46.838 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-13T02:14:46.960 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-13T02:14:46.970 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-13T02:14:46.971 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-13T02:14:46.997 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-13T02:14:47.024 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-13T02:14:47.068 DEBUG:teuthology.orchestra.run.smithi104:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-13T02:14:47.071 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-13T02:14:47.094 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = core 2023-09-13T02:14:47.096 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2023-09-13T02:14:47.123 DEBUG:teuthology.orchestra.run.smithi104:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-13T02:14:47.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T02:14:47.178 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-13T02:14:47.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T02:14:47.192 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-13T02:14:47.204 INFO:teuthology.task.internal:Transferring archived files... 2023-09-13T02:14:47.205 DEBUG:teuthology.misc:Transferring archived files from smithi104:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395228/remote/smithi104 2023-09-13T02:14:47.205 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-13T02:14:47.255 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395228/remote/smithi119 2023-09-13T02:14:47.255 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-13T02:14:47.292 INFO:teuthology.task.internal:Removing archive directory... 2023-09-13T02:14:47.292 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-13T02:14:47.296 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-13T02:14:47.339 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-13T02:14:47.352 INFO:teuthology.task.internal:Not uploading archives. 2023-09-13T02:14:47.353 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-13T02:14:47.368 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-13T02:14:47.368 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-13T02:14:47.371 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-13T02:14:47.383 INFO:teuthology.orchestra.run.smithi104.stdout: 265750 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 13 02:14 /home/ubuntu/cephtest 2023-09-13T02:14:47.383 INFO:teuthology.orchestra.run.smithi104.stdout: 395011 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 13 02:12 /home/ubuntu/cephtest/mnt.0 2023-09-13T02:14:47.383 INFO:teuthology.orchestra.run.smithi104.stdout: 395012 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 13 02:13 /home/ubuntu/cephtest/mnt.0/client.0 2023-09-13T02:14:47.384 INFO:teuthology.orchestra.run.smithi104.stdout: 408834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 02:13 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-09-13T02:14:47.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T02:14:47.385 INFO:teuthology.orchestra.run.smithi104.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-09-13T02:14:47.386 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi104 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-09-13T02:14:47.393 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-13T02:14:47.406 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-13T02:14:47.421 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi104 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-09-13T02:14:47.422 INFO:teuthology.nuke:Checking targets against current locks 2023-09-13T02:14:47.430 INFO:teuthology.orchestra.run.smithi119.stdout: 265233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 02:14 /home/ubuntu/cephtest 2023-09-13T02:14:47.460 DEBUG:teuthology.nuke:shortname: smithi104 2023-09-13T02:14:47.461 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T02:14:47.482 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 01:55:45.128920', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKuQ/0LipsdT8eZcYRT8/ja79YLlkHp0ISoVAfz0fiD4/ik40V9DG7dDEPYltC0Axq4hXPXvvKyzcnXfGoLn/qI='} 2023-09-13T02:14:47.487 DEBUG:teuthology.nuke:shortname: smithi119 2023-09-13T02:14:47.487 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T02:14:47.508 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 01:55:45.130433', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLvm45jl5lLd1bnFw9AbofDjpFQ7TaYZ7PxHiJUzszOYx89jnE/xvpxFdpFkvcr0pAUFeoMQTK+RR2ZqG4+au38='} 2023-09-13T02:14:47.532 INFO:teuthology.orchestra.console.smithi104:Power off 2023-09-13T02:14:47.533 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T02:14:47.576 INFO:teuthology.orchestra.console.smithi119:Power off 2023-09-13T02:14:47.576 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T02:14:47.655 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2023-09-13T02:14:47.656 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:14:47.665 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2023-09-13T02:14:47.666 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:14:47.683 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2023-09-13T02:14:47.688 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-09-13T02:14:51.685 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:14:51.695 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:14:51.797 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2023-09-13T02:14:51.806 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-09-13T02:14:55.800 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:14:55.810 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:14:55.912 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2023-09-13T02:14:55.922 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-09-13T02:14:56.023 INFO:teuthology.orchestra.console.smithi119:Power off completed 2023-09-13T02:14:59.914 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:15:00.025 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-09-13T02:15:00.127 INFO:teuthology.orchestra.console.smithi104:Power off completed 2023-09-13T02:15:00.233 INFO:teuthology.run:Summary data: description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} duration: 647.784332036972 failure_reason: 'Command failed (workunit test fs/test_python.sh) on smithi104 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh''' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=106d2fffd2954685970ea7f3aa01363b status: fail success: false 2023-09-13T02:15:00.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T02:15:00.332 INFO:teuthology.run:FAIL